00000001:02000400:3.0F:1788529897.700106:0:3303:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg241-server.virtnet: executing set_hostid 00000001:02000400:1.0F:1788529921.930976:0:3524:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg241-server.virtnet: executing load_modules_local 00000001:01000000:1.0:1788529924.305171:0:3586:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 467 MB/s 00000001:01000000:3.0:1788529924.555128:0:3586:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 443 MB/s 00000001:01000000:3.0:1788529924.804612:0:3586:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4099 MB/s 00000020:02000000:1.0:1788529925.826549:0:3616:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_5_ge0db421 00000400:02000000:2.0F:1788529927.010239:0:3631:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.202.141@tcp [8/256/0/180] 00008000:02000000:3.0:1788529931.447717:0:3780:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0:1788530007.503071:0:5750:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg241-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1788530024.503938:0:6500:0:(obd_mount.c:925:lmd_print()) mount data: 00000020:01000004:3.0:1788530024.503948:0:6500:0:(obd_mount.c:928:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1788530024.503950:0:6500:0:(obd_mount.c:931:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1788530024.505445:0:6500:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000006c13d774 00000080:02000400:3.0:1788530024.505460:0:6500:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1788530024.512200:0:6500:0:(tgt_mount.c:2585:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1788530024.512214:0:6500:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788530024.513225:0:6500:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000cba784eb) 00000020:00000080:2.0:1788530024.513261:0:6500:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788530024.573240:0:6500:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1788530024.573486:0:6500:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:2.0:1788530024.602966:0:6500:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788530024.604183:0:6500:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788530024.604192:0:6500:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788530024.604204:0:6500:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb28d70e12574ffc5 00000020:01000004:2.0:1788530024.604210:0:6500:0:(tgt_mount.c:2670:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1788530024.604215:0:6500:0:(tgt_mount.c:234:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788530024.604219:0:6500:0:(tgt_mount.c:115:server_register_mount()) register mount 000000006c13d774 from MGS 00000020:01000004:2.0:1788530024.604224:0:6500:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788530024.604234:0:6500:0:(genops.c:413:class_newdev()) Allocate new device MGS (0000000051772896) 00000020:00000080:2.0:1788530024.604244:0:6500:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788530024.604425:0:6500:0:(tgt_mount.c:167:server_get_mount()) get mount 000000006c13d774 from MGS, refs=2 00080000:01000000:2.0:1788530024.604431:0:6500:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788530024.604437:0:6500:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb28d70e12574ffd3 00000100:00100000:2.0:1788530024.604532:0:6500:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788530024.605188:0:6500:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788530024.605195:0:6500:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788530024.606450:0:6500:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788530024.606460:0:6500:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1788530024.608796:0:6500:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788530024.610176:0:6500:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1788530024.610189:0:6500:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788530024.612242:0:6500:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1788530024.612255:0:6500:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1788530024.620305:0:6500:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1788530024.620323:0:6500:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1788530024.621348:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530024.621352:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530024.621354:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530024.625613:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530024.625622:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530024.625624:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530024.626674:0:6500:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1788530024.633222:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:0.0F:1788530024.875940:0:6500:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2883 MB/s 00000001:01000000:2.0:1788530025.126887:0:6500:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 4215 MB/s 00000001:01000000:0.0:1788530025.381152:0:6500:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 437 MB/s 00000001:01000000:3.0:1788530025.630671:0:6500:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 483 MB/s 00080000:10000000:3.0:1788530025.640243:0:6500:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00010000:00010000:1.0:1788530025.665818:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1788530025.669274:0:6500:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1788530025.677228:0:6515:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1788530025.677317:0:6500:0:(mgs_nids.c:684:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1788530025.677419:0:6500:0:(mgs_llog.c:690:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:2.0:1788530025.678051:0:6500:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1788530025.678090:0:6500:0:(mgs_llog.c:690:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1788530025.679698:0:6500:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788530025.680189:0:6500:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1788530025.680195:0:6500:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1788530025.681929:0:6500:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1788530025.681944:0:6500:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1788530025.686744:0:6500:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788530025.686760:0:6500:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1788530025.690519:0:6500:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1788530025.690591:0:6500:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.141@tcp' 00000020:01000004:1.0:1788530025.690593:0:6500:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1788530025.690659:0:6500:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.141@tcp (typ=mgc) 00000020:00000080:1.0:1788530025.690686:0:6500:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.141@tcp (00000000dfb9adb4) 00000020:00000080:1.0:1788530025.690707:0:6500:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00000100:00080000:2.0:1788530025.691273:0:6519:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00080000:1.0:1788530025.691318:0:6500:0:(ldlm_lib.c:102:import_set_conn()) imp 000000005f1e38da@MGC192.168.202.141@tcp: add connection 192.168.202.141@tcp at head 00010000:00010000:1.0:1788530025.691508:0:6500:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.141@tcp-0 is initialized 00000040:01000000:1.0:1788530025.691516:0:6500:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.141@tcp ctxt 1 is initialized 10000000:01000000:2.0:1788530025.702151:0:6521:0:(mgc_request.c:893:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1788530025.702250:0:6500:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.141@tcp (uuid 9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b) 00000020:00000080:1.0:1788530025.702276:0:6500:0:(genops.c:1385:class_connect()) connect: client 9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b, cookie 0xb28d70e12574ffe1 00000100:00080000:1.0:1788530025.702291:0:6500:0:(import.c:545:import_select_connection()) MGC192.168.202.141@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788530025.702296:0:6500:0:(import.c:665:import_select_connection()) MGC192.168.202.141@tcp: import 000000005f1e38da using connection 192.168.202.141@tcp/0@lo 00000100:00100000:1.0:1788530025.702359:0:6500:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000a4f6b3ff x1875409555685504/t0(0) o250->MGC192.168.202.141@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788530025.702394:0:6500:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b->MGS 00000020:01000004:1.0:1788530025.702423:0:6500:0:(tgt_mount.c:1882:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1788530025.702429:0:6500:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1788530025.702443:0:6500:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000a99812ef) 00000020:00000080:1.0:1788530025.702467:0:6500:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1788530025.703972:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a4f6b3ff pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3646:1875409555685504:0@lo:250: 00000100:00100000:2.0:1788530025.704089:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530025.706162:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555685504 00000100:00100000:3.0:1788530025.706177:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555685504 00000100:00100000:3.0:1788530025.706222:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788530025.706229:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007c83d835 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3646:x1875409555685504:12345-0@lo:250: 00010000:00080000:3.0:1788530025.706256:0:6516:0:(ldlm_lib.c:1458:target_handle_connect()) MGS: connection from 9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b@0@lo t0 exp 0000000000000000 cur 233 last 0 00000020:00000080:3.0:1788530025.706284:0:6516:0:(genops.c:1385:class_connect()) connect: client 9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b, cookie 0xb28d70e12574ffef 00000100:00080000:3.0:1788530025.706444:0:6516:0:(import.c:65:import_set_state_nolock()) 00000000b70441b4 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788530025.706523:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007c83d835 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+5:3646:x1875409555685504:12345-0@lo:250: Request processed in 293us (2435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530025.706531:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788530025.706628:0:3646:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.202.141@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1788530025.706638:0:3646:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.202.141@tcp: connect to target with instance 0 00000100:00080000:3.0:1788530025.706651:0:3646:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.202.141@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788530025.706655:0:3646:0:(mgc_request.c:1469:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788530025.706658:0:3646:0:(import.c:65:import_set_state_nolock()) 000000005f1e38da MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788530025.706661:0:3646:0:(mgc_request.c:1469:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788530025.706668:0:3646:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788530025.706673:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a4f6b3ff pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3646:1875409555685504:0@lo:250: 00000100:00100000:1.0:1788530025.715328:0:6500:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788530025.715552:0:6500:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1788530025.719515:0:6500:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1788530025.722610:0:6500:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1788530025.722621:0:6500:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1788530025.723256:0:6500:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1788530025.723264:0:6500:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1788530025.724164:0:6500:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788530025.724353:0:6500:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1788530025.724359:0:6500:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1788530025.731250:0:6500:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1788530025.731267:0:6500:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1788530025.795201:0:6500:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788530025.795515:0:6500:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1788530025.795523:0:6500:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1788530025.800147:0:6500:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1788530025.800170:0:6500:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1788530025.801530:0:6500:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788530025.802336:0:6500:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788530025.802343:0:6500:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1788530025.803307:0:6500:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788530025.803319:0:6500:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1788530025.804286:0:6500:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788530025.805297:0:6500:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788530025.805306:0:6500:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1788530025.806286:0:6500:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788530025.806295:0:6500:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1788530025.807291:0:6500:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788530025.807666:0:6500:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788530025.807673:0:6500:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1788530025.808694:0:6500:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788530025.808702:0:6500:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788530025.830994:0:6500:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788530025.831391:0:6500:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788530025.831402:0:6500:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1788530025.834054:0:6500:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788530025.834075:0:6500:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1788530025.835322:0:6500:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788530025.835355:0:6500:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1788530025.836540:0:6500:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1788530025.837045:0:6500:0:(tgt_mount.c:1482:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.141@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1788530025.837055:0:6500:0:(tgt_mount.c:1239:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788530025.837059:0:6500:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788530025.837060:0:6500:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788530025.837061:0:6500:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:2.0:1788530025.837063:0:6500:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:2.0:1788530025.837065:0:6500:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:2.0:1788530025.837066:0:6500:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788530025.837068:0:6500:0:(tgt_mount.c:1250:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788530025.837069:0:6500:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788530025.837071:0:6500:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788530025.837073:0:6500:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788530025.837079:0:6500:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788530025.837085:0:6500:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1788530025.837088:0:6500:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788530025.837089:0:6500:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788530025.837090:0:6500:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788530025.837091:0:6500:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:2.0:1788530025.837092:0:6500:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:2.0:1788530025.837092:0:6500:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:2.0:1788530025.837093:0:6500:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788530025.837094:0:6500:0:(tgt_mount.c:1250:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788530025.837095:0:6500:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788530025.837095:0:6500:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788530025.837096:0:6500:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788530025.837097:0:6500:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788530025.837141:0:6500:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788530025.837164:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d1dca734 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6500:1875409555685632:0@lo:253: 00000100:00100000:2.0:1788530025.837272:0:6500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530025.837408:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e4e918df going to sleep for 11 seconds 00000100:00100000:1.0:1788530025.837510:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555685632 00000100:00100000:1.0:1788530025.837521:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555685632 00000100:00100000:1.0:1788530025.839091:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788530025.839117:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bb9b869f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+5:6500:x1875409555685632:12345-0@lo:253: 20000000:01000000:1.0:1788530025.839211:0:6518:0:(mgs_llog.c:690:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788530025.839216:0:6518:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1788530025.839967:0:6539:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1788530025.840037:0:6518:0:(mgs_nids.c:684:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1788530025.840495:0:6518:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788530025.843154:0:6540:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:2.0:1788530025.843590:0:6518:0:(mgs_llog.c:690:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788530025.843699:0:6518:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:2.0:1788530025.843707:0:6518:0:(mgs_llog.c:875:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:2.0:1788530025.843774:0:6518:0:(mgs_llog.c:3618:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:2.0:1788530025.843962:0:6518:0:(mgs_llog.c:3178:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:2.0:1788530025.844206:0:6518:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788530025.844406:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:2.0:1788530025.844423:0:6518:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788530025.844442:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:2.0:1788530025.844458:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:2.0:1788530025.844474:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:2.0:1788530025.844535:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:2.0:1788530025.844543:0:6518:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:2.0:1788530025.844555:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:2.0:1788530025.844612:0:6518:0:(mgs_llog.c:1545:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:2.0:1788530025.844636:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:2.0:1788530025.844643:0:6518:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:2.0:1788530025.844656:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:2.0:1788530025.844669:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:2.0:1788530025.844699:0:6518:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1788530025.844705:0:6518:0:(mgs_llog.c:3178:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:2.0:1788530025.844723:0:6518:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788530025.845303:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:2.0:1788530025.845316:0:6518:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788530025.845349:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:2.0:1788530025.845386:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:2.0:1788530025.845404:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:2.0:1788530025.845416:0:6518:0:(mgs_llog.c:3135:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:2.0:1788530025.845451:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:2.0:1788530025.845459:0:6518:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1788530025.845485:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:2.0:1788530025.845503:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:2.0:1788530025.845519:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:2.0:1788530025.845530:0:6518:0:(mgs_llog.c:3100:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:2.0:1788530025.845552:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:2.0:1788530025.845879:0:6518:0:(mgs_llog.c:1545:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:2.0:1788530025.845981:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:2.0:1788530025.846001:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1788530025.846077:0:6518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1788530025.846104:0:6518:0:(mgs_llog.c:3315:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1788530025.846113:0:6518:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:1.0:1788530025.847406:0:6541:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1788530025.848884:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1788530025.849009:0:6518:0:(mgs_llog.c:3361:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.141@tcp for mdt 20000000:01000000:2.0:1788530025.849014:0:6518:0:(mgs_llog.c:1545:record_base_raw()) lcfg (null) 0xcf005 192.168.202.141@tcp (null) (null) (null) 00000040:00080000:2.0:1788530025.849033:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1788530025.849041:0:6518:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1788530025.849055:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1788530025.849086:0:6518:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.202.141@tcp (null) (null) 00000040:00080000:2.0:1788530025.849103:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1788530025.849110:0:6518:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1788530025.849122:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1788530025.849136:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1788530025.849169:0:6518:0:(mgs_llog.c:5258:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788530025.849174:0:6518:0:(mgs_llog.c:4754:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788530025.849180:0:6518:0:(mgs_llog.c:4187:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788530025.849264:0:6518:0:(mgs_llog.c:2556:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788530025.849268:0:6518:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788530025.850243:0:6542:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1788530025.850538:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1788530025.850702:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1788530025.850871:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:2.0:1788530025.850962:0:6518:0:(mgs_llog.c:2556:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788530025.850965:0:6518:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788530025.851307:0:6543:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:2.0:1788530025.851503:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1788530025.851523:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:2.0:1788530025.851536:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:2.0:1788530025.851546:0:6518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788530025.851548:0:6518:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:2.0:1788530025.851554:0:6518:0:(mgs_llog.c:5258:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788530025.851557:0:6518:0:(mgs_llog.c:4754:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788530025.852065:0:6518:0:(mgs_llog.c:5078:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1788530025.852076:0:6518:0:(mgs_llog.c:1385:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1788530025.852493:0:6544:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:2.0:1788530025.852996:0:6518:0:(mgs_llog.c:4126:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1788530025.862528:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:3.0:1788530025.862587:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:3.0:1788530025.862727:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:3.0:1788530025.862765:0:6518:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788530025.862807:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000083712434/0xb28d70e12574fff6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530025.862834:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000083712434/0xb28d70e12574fff6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530025.862846:0:6518:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000083712434/0xb28d70e12574fff6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530025.862853:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000083712434/0xb28d70e12574fff6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530025.862860:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000083712434/0xb28d70e12574fff6 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530025.862865:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000083712434/0xb28d70e12574fff6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530025.862874:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000083712434 already unused, calling callback (0000000096f15eee) 00010000:00010000:3.0:1788530025.862886:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000083712434/0xb28d70e12574fff6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530025.863076:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000083712434/0xb28d70e12574fff6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530025.863092:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000083712434/0xb28d70e12574fff6 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530025.863100:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000083712434/0xb28d70e12574fff6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530025.863107:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000083712434/0xb28d70e12574fff6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788530025.863130:0:6518:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788530025.875305:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bb9b869f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+5:6500:x1875409555685632:12345-0@lo:253: Request processed in 36183us (38019us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530025.875338:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788530025.875476:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d1dca734 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6500:1875409555685632:0@lo:253: 10000000:01000000:2.0:1788530025.875498:0:6500:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788530025.875502:0:6500:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788530025.875504:0:6500:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788530025.875516:0:6500:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788530025.875518:0:6500:0:(tgt_mount.c:1242:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1788530025.875519:0:6500:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:2.0:1788530025.875521:0:6500:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:2.0:1788530025.875522:0:6500:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788530025.875523:0:6500:0:(tgt_mount.c:1250:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788530025.875525:0:6500:0:(tgt_mount.c:1260:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788530025.875526:0:6500:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788530025.875528:0:6500:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788530025.875548:0:6500:0:(tgt_mount.c:115:server_register_mount()) register mount 000000006c13d774 from lustre-MDT0000 10000000:01000000:2.0:1788530025.876053:0:6500:0:(mgc_request.c:2342:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788530025.876058:0:6500:0:(mgc_request.c:424:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788530025.876064:0:6500:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9a9f0aaed800 10000000:01000000:2.0:1788530025.876070:0:6500:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788530025.876098:0:6500:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-sptlrpc-ffff9a9f0aaed800 from 1 10000000:01000000:2.0:1788530025.876102:0:6500:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788530025.876153:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: 000000007bd13ed4/0xb28d70e12574fffd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530025.876166:0:6500:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: 000000007bd13ed4/0xb28d70e12574fffd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530025.876178:0:6500:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: 000000007bd13ed4/0xb28d70e12574fffd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530025.876204:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d1dca734 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6500:1875409555685760:0@lo:101: 00000100:00100000:2.0:1788530025.876269:0:6500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530025.876410:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set 000000009c1c4e5e going to sleep for 11 seconds 00000100:00100000:0.0:1788530025.876473:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555685760 00000100:00100000:0.0:1788530025.876486:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555685760 00000100:00100000:0.0:1788530025.877028:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788530025.877041:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cda4ce8b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+5:6500:x1875409555685760:12345-0@lo:101: 00010000:00010000:0.0:1788530025.877063:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530025.877088:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a3916e29/0xb28d70e125750004 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e12574fffd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530025.877116:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a3916e29/0xb28d70e125750004 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e12574fffd expref: 6 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530025.877127:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a3916e29/0xb28d70e125750004 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e12574fffd expref: 6 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530025.877136:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a3916e29, rc 0) 00000100:00100000:0.0:1788530025.877201:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cda4ce8b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+6:6500:x1875409555685760:12345-0@lo:101: Request processed in 164us (932us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530025.877209:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788530025.877299:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d1dca734 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6500:1875409555685760:0@lo:101: 00010000:00010000:2.0:1788530025.877316:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: 000000007bd13ed4/0xb28d70e12574fffd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125750004 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530025.877325:0:6500:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: 000000007bd13ed4/0xb28d70e12574fffd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e125750004 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530025.877390:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d1dca734 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6500:1875409555685888:0@lo:501: 00000100:00100000:2.0:1788530025.877417:0:6500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530025.877502:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set 000000009c1c4e5e going to sleep for 11 seconds 00000100:00100000:3.0:1788530025.877584:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555685888 00000100:00100000:3.0:1788530025.877591:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555685888 00000100:00100000:3.0:1788530025.877841:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788530025.877847:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000628b3f28 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+6:6500:x1875409555685888:12345-0@lo:501: 00000100:00100000:3.0:1788530025.877956:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000628b3f28 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+6:6500:x1875409555685888:12345-0@lo:501: Request processed in 108us (538us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788530025.877962:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788530025.878089:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d1dca734 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6500:1875409555685888:0@lo:501: 10000000:01000000:2.0:1788530025.878104:0:6500:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788530025.878124:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: 000000007bd13ed4/0xb28d70e12574fffd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125750004 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530025.878134:0:6500:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: 000000007bd13ed4/0xb28d70e12574fffd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125750004 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788530025.878143:0:6500:0:(mgc_request.c:206:do_config_log_add()) do adding config log params-ffff9a9f0aaed800 10000000:01000000:2.0:1788530025.878149:0:6500:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788530025.878180:0:6500:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-barrier-ffff9a9f0aaed800 10000000:01000000:2.0:1788530025.878183:0:6500:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788530025.878218:0:6500:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-barrier-ffff9a9f0aaed800 from 1 10000000:01000000:2.0:1788530025.878222:0:6500:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788530025.878248:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: 00000000f7ca14a1/0xb28d70e12575000b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530025.878256:0:6500:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: 00000000f7ca14a1/0xb28d70e12575000b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530025.878267:0:6500:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: 00000000f7ca14a1/0xb28d70e12575000b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530025.878279:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d1dca734 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6500:1875409555686016:0@lo:101: 00000100:00100000:2.0:1788530025.878315:0:6500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530025.878343:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set 000000009c1c4e5e going to sleep for 11 seconds 00000100:00100000:0.0:1788530025.878463:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555686016 00000100:00100000:0.0:1788530025.878468:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555686016 00000100:00100000:0.0:1788530025.878489:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788530025.878494:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008629a1b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+6:6500:x1875409555686016:12345-0@lo:101: 00010000:00010000:0.0:1788530025.878501:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530025.878514:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001b1b11de/0xb28d70e125750012 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e12575000b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530025.878531:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001b1b11de/0xb28d70e125750012 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e12575000b expref: 7 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530025.878552:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001b1b11de/0xb28d70e125750012 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e12575000b expref: 7 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530025.878576:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001b1b11de, rc 0) 00000100:00100000:0.0:1788530025.878616:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008629a1b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+7:6500:x1875409555686016:12345-0@lo:101: Request processed in 121us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530025.878622:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788530025.878751:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d1dca734 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6500:1875409555686016:0@lo:101: 00010000:00010000:2.0:1788530025.878763:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: 00000000f7ca14a1/0xb28d70e12575000b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125750012 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530025.878770:0:6500:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: 00000000f7ca14a1/0xb28d70e12575000b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e125750012 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788530025.878782:0:6500:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788530025.878784:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: 00000000f7ca14a1/0xb28d70e12575000b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125750012 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530025.878790:0:6500:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: 00000000f7ca14a1/0xb28d70e12575000b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125750012 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788530025.878805:0:6500:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788530025.878808:0:6500:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788530025.878829:0:6500:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-mdtir-ffff9a9f0aaed800 10000000:01000000:2.0:1788530025.878832:0:6500:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788530025.878856:0:6500:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788530025.878859:0:6500:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788530025.878873:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: 000000003338f9a9/0xb28d70e125750019 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530025.878879:0:6500:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: 000000003338f9a9/0xb28d70e125750019 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530025.878885:0:6500:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: 000000003338f9a9/0xb28d70e125750019 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530025.878909:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d1dca734 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6500:1875409555686144:0@lo:101: 00000100:00100000:2.0:1788530025.878935:0:6500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530025.878958:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set 000000009c1c4e5e going to sleep for 11 seconds 00000100:00100000:0.0:1788530025.879148:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555686144 00000100:00100000:0.0:1788530025.879152:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555686144 00000100:00100000:0.0:1788530025.879168:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788530025.879173:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007c719b37 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+7:6500:x1875409555686144:12345-0@lo:101: 00010000:00010000:0.0:1788530025.879180:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530025.879187:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ee4bff5b/0xb28d70e125750020 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e125750019 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530025.879199:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ee4bff5b/0xb28d70e125750020 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e125750019 expref: 8 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530025.879206:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ee4bff5b/0xb28d70e125750020 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125750019 expref: 8 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530025.879212:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ee4bff5b, rc 0) 00000100:00100000:0.0:1788530025.879265:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007c719b37 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+8:6500:x1875409555686144:12345-0@lo:101: Request processed in 92us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530025.879272:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788530025.879343:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d1dca734 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6500:1875409555686144:0@lo:101: 00010000:00010000:2.0:1788530025.879352:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: 000000003338f9a9/0xb28d70e125750019 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125750020 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530025.879358:0:6500:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: 000000003338f9a9/0xb28d70e125750019 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e125750020 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530025.879381:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d1dca734 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6500:1875409555686272:0@lo:501: 00000100:00100000:2.0:1788530025.879400:0:6500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530025.879417:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set 000000009c1c4e5e going to sleep for 11 seconds 00000100:00100000:3.0:1788530025.879489:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555686272 00000100:00100000:3.0:1788530025.879493:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555686272 00000100:00100000:3.0:1788530025.879509:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788530025.879514:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cfedee14 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+8:6500:x1875409555686272:12345-0@lo:501: 00000100:00100000:3.0:1788530025.879740:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cfedee14 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+9:6500:x1875409555686272:12345-0@lo:501: Request processed in 225us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530025.879747:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788530025.879897:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d1dca734 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6500:1875409555686272:0@lo:501: 00000100:00100000:2.0:1788530025.879924:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d1dca734 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6500:1875409555686400:0@lo:503: 00000100:00100000:2.0:1788530025.879958:0:6500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530025.879983:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set 000000009c1c4e5e going to sleep for 11 seconds 00000100:00100000:3.0:1788530025.880075:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555686400 00000100:00100000:3.0:1788530025.880080:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555686400 00000100:00100000:3.0:1788530025.880095:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788530025.880100:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c0d5e0d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+9:6500:x1875409555686400:12345-0@lo:503: 00000100:00100000:3.0:1788530025.880172:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c0d5e0d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+9:6500:x1875409555686400:12345-0@lo:503: Request processed in 72us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530025.880179:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788530025.880315:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d1dca734 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6500:1875409555686400:0@lo:503: 00000100:00100000:2.0:1788530025.881184:0:6545:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d1dca734 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6545:1875409555686528:0@lo:502: 00000100:00100000:2.0:1788530025.881242:0:6545:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530025.881279:0:6545:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d39baac6 going to sleep for 11 seconds 00000100:00100000:3.0:1788530025.881346:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555686528 00000100:00100000:3.0:1788530025.881353:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555686528 00000100:00100000:3.0:1788530025.881394:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788530025.881401:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008d495ed0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+9:6545:x1875409555686528:12345-0@lo:502: 00000100:00100000:3.0:1788530025.881583:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008d495ed0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+9:6545:x1875409555686528:12345-0@lo:502: Request processed in 182us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530025.881591:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788530025.882111:0:6545:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d1dca734 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6545:1875409555686528:0@lo:502: 00000020:01000000:2.0:1788530025.882145:0:6545:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788530025.882159:0:6545:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788530025.882169:0:6545:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788530025.882175:0:6545:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1788530025.882179:0:6545:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788530025.882195:0:6545:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000e4d3df1e) 00000020:00000080:2.0:1788530025.882214:0:6545:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1788530025.882219:0:6545:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788530025.882369:0:6545:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788530025.882378:0:6545:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb28d70e12575002e 00000020:00000080:2.0:1788530025.882994:0:6545:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788530025.883000:0:6545:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788530025.883004:0:6545:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788530025.883006:0:6545:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788530025.883008:0:6545:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788530025.883013:0:6545:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788530025.883014:0:6545:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1788530025.883017:0:6545:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788530025.883025:0:6545:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (0000000088920cc4) 00000020:00000080:2.0:1788530025.883036:0:6545:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1788530025.883040:0:6545:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788530025.883042:0:6545:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1788530025.883044:0:6545:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1788530025.883051:0:6545:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788530025.883096:0:6545:0:(tgt_mount.c:167:server_get_mount()) get mount 000000006c13d774 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1788530025.883108:0:6545:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000007bdd6822) 00000020:00000080:2.0:1788530025.883115:0:6545:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1788530025.883193:0:6545:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788530025.883199:0:6545:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb28d70e125750043 00000020:00000080:2.0:1788530025.883296:0:6545:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1788530025.883302:0:6545:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788530025.883306:0:6545:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xb28d70e12575004a 00080000:01000000:2.0:1788530025.883310:0:6545:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788530025.883314:0:6545:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb28d70e125750051 00080000:10000000:2.0:1788530025.884231:0:6545:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:2.0:1788530025.884433:0:6545:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1788530025.895012:0:6545:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:0.0:1788530025.971795:0:6545:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:0.0:1788530025.972454:0:6545:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:0.0:1788530025.977039:0:6545:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:0.0:1788530025.977758:0:6545:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788530025.981414:0:6545:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (0000000097f8087f) 00000020:00000080:2.0:1788530025.981440:0:6545:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788530025.981529:0:6545:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788530025.981537:0:6545:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb28d70e12575005f 00000020:00000080:1.0:1788530025.990414:0:6545:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1788530025.996269:0:6545:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:1.0:1788530026.001169:0:6545:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:1.0:1788530026.004084:0:6545:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:1.0:1788530026.007103:0:6545:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:1.0:1788530026.010384:0:6545:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:1.0:1788530026.013213:0:6545:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:1.0:1788530026.015521:0:6545:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xb28d70e125750066 00000020:00000080:3.0:1788530026.016084:0:6545:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1788530026.016096:0:6545:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788530026.016102:0:6545:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788530026.016104:0:6545:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1788530026.016107:0:6545:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788530026.016112:0:6545:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788530026.016113:0:6545:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788530026.016116:0:6545:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788530026.016117:0:6545:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788530026.016121:0:6545:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788530026.016123:0:6545:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788530026.016131:0:6545:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788530026.016134:0:6545:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788530026.016139:0:6545:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788530026.016140:0:6545:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1788530026.016145:0:6545:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788530026.016194:0:6545:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:3.0:1788530026.016281:0:6545:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000229dda04 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6545:1875409555686656:0@lo:502: 00000100:00100000:3.0:1788530026.016379:0:6545:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530026.016432:0:6545:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b6d5052d going to sleep for 11 seconds 00000100:00100000:0.0:1788530026.016530:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555686656 00000100:00100000:0.0:1788530026.016539:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555686656 00000100:00100000:0.0:1788530026.016782:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788530026.016793:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007259a438 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+9:6545:x1875409555686656:12345-0@lo:502: 00000100:00100000:0.0:1788530026.016947:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007259a438 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+9:6545:x1875409555686656:12345-0@lo:502: Request processed in 155us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530026.016956:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788530026.017044:0:6545:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000229dda04 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6545:1875409555686656:0@lo:502: 00000020:01000000:3.0:1788530026.017082:0:6545:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788530026.017088:0:6545:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788530026.017090:0:6545:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:3.0:1788530026.017093:0:6545:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:3.0:1788530026.017169:0:6500:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:3.0:1788530026.017177:0:6500:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788530026.017193:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: 000000003338f9a9/0xb28d70e125750019 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125750020 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530026.017205:0:6500:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: 000000003338f9a9/0xb28d70e125750019 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125750020 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788530026.017213:0:6500:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-mdtir-ffff9a9f0aaed800 from 1 10000000:01000000:3.0:1788530026.017217:0:6500:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788530026.017254:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: 0000000083712434/0xb28d70e12575006d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530026.017261:0:6500:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: 0000000083712434/0xb28d70e12575006d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530026.017281:0:6500:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: 0000000083712434/0xb28d70e12575006d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530026.017295:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000229dda04 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6500:1875409555686784:0@lo:101: 00000100:00100000:3.0:1788530026.017344:0:6500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530026.019211:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set 00000000843cc6b1 going to sleep for 11 seconds 00000100:00100000:1.0:1788530026.019282:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555686784 00000100:00100000:1.0:1788530026.019295:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555686784 00000100:00100000:2.0:1788530026.019380:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788530026.019391:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c4868980 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+9:6500:x1875409555686784:12345-0@lo:101: 00010000:00010000:2.0:1788530026.019409:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530026.019433:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000088441a49/0xb28d70e125750074 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e12575006d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530026.019465:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000088441a49/0xb28d70e125750074 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e12575006d expref: 10 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530026.019477:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000088441a49/0xb28d70e125750074 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e12575006d expref: 10 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530026.019488:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000088441a49, rc 0) 00000100:00100000:2.0:1788530026.019689:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c4868980 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+10:6500:x1875409555686784:12345-0@lo:101: Request processed in 300us (2363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530026.019697:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788530026.019982:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000229dda04 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6500:1875409555686784:0@lo:101: 00010000:00010000:3.0:1788530026.020010:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: 0000000083712434/0xb28d70e12575006d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125750074 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530026.020021:0:6500:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: 0000000083712434/0xb28d70e12575006d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e125750074 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530026.020968:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000229dda04 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6500:1875409555686912:0@lo:256: 00000100:00100000:3.0:1788530026.021040:0:6500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530026.021084:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set 00000000843cc6b1 going to sleep for 11 seconds 00000100:00100000:0.0:1788530026.021172:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555686912 00000100:00100000:0.0:1788530026.021181:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555686912 00000100:00100000:0.0:1788530026.021240:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788530026.021249:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f1c8bdbd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+10:6500:x1875409555686912:12345-0@lo:256: 20000000:01000000:0.0:1788530026.021271:0:6516:0:(mgs_nids.c:1159:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788530026.021279:0:6516:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1788530026.021387:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f1c8bdbd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+10:6500:x1875409555686912:12345-0@lo:256: Request processed in 138us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530026.021395:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788530026.022027:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000229dda04 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6500:1875409555686912:0@lo:256: 10000000:01000000:3.0:1788530026.022818:0:6500:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788530026.022857:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: 0000000083712434/0xb28d70e12575006d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125750074 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530026.022874:0:6500:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: 0000000083712434/0xb28d70e12575006d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125750074 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788530026.023033:0:6500:0:(mgc_request.c:2194:mgc_process_log()) Process log params-ffff9a9f0aaed800 from 1 10000000:01000000:3.0:1788530026.023040:0:6500:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788530026.023112:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: 00000000d2cba6a1/0xb28d70e12575007b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530026.023120:0:6500:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: 00000000d2cba6a1/0xb28d70e12575007b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530026.023130:0:6500:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: 00000000d2cba6a1/0xb28d70e12575007b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530026.023151:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000229dda04 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6500:1875409555687040:0@lo:101: 00000100:00100000:3.0:1788530026.023219:0:6500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530026.023305:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set 00000000843cc6b1 going to sleep for 11 seconds 00000100:00100000:0.0:1788530026.024067:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555687040 00000100:00100000:0.0:1788530026.024078:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555687040 00000100:00100000:0.0:1788530026.024180:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788530026.024190:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009d3fa3cf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+10:6500:x1875409555687040:12345-0@lo:101: 00010000:00010000:0.0:1788530026.024204:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530026.024223:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000247abbd4/0xb28d70e125750082 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e12575007b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530026.024252:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000247abbd4/0xb28d70e125750082 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e12575007b expref: 11 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530026.024263:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000247abbd4/0xb28d70e125750082 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e12575007b expref: 11 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530026.024283:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000247abbd4, rc 0) 00000100:00100000:0.0:1788530026.024372:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009d3fa3cf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+11:6500:x1875409555687040:12345-0@lo:101: Request processed in 184us (1152us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530026.024379:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788530026.024482:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000229dda04 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6500:1875409555687040:0@lo:101: 00010000:00010000:1.0:1788530026.024504:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: 00000000d2cba6a1/0xb28d70e12575007b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125750082 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530026.024514:0:6500:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: 00000000d2cba6a1/0xb28d70e12575007b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e125750082 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530026.024614:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ce2e39d7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6500:1875409555687168:0@lo:501: 00000100:00100000:1.0:1788530026.024679:0:6500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530026.024916:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set 000000009f264f7c going to sleep for 11 seconds 00000100:00100000:3.0:1788530026.025045:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555687168 00000100:00100000:3.0:1788530026.025051:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555687168 00000100:00100000:3.0:1788530026.025078:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788530026.025085:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006afaede1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+11:6500:x1875409555687168:12345-0@lo:501: 00000100:00100000:3.0:1788530026.025255:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006afaede1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+11:6500:x1875409555687168:12345-0@lo:501: Request processed in 170us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530026.025263:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788530026.025377:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ce2e39d7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6500:1875409555687168:0@lo:501: 00000100:00100000:1.0:1788530026.025409:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ce2e39d7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6500:1875409555687296:0@lo:503: 00000100:00100000:1.0:1788530026.025448:0:6500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530026.025470:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set 000000009f264f7c going to sleep for 11 seconds 00000100:00100000:3.0:1788530026.025531:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555687296 00000100:00100000:3.0:1788530026.025536:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555687296 00000100:00100000:3.0:1788530026.025554:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788530026.025576:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ead59bfc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+11:6500:x1875409555687296:12345-0@lo:503: 00000040:00080000:3.0:1788530026.025618:0:6516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788530026.025667:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ead59bfc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+11:6500:x1875409555687296:12345-0@lo:503: Request processed in 108us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530026.025674:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788530026.025821:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ce2e39d7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6500:1875409555687296:0@lo:503: 00000040:00080000:1.0:1788530026.027218:0:6549:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:3.0:1788530026.027439:0:6500:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1788530026.027454:0:6500:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788530026.027503:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: 00000000d2cba6a1/0xb28d70e12575007b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125750082 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530026.027518:0:6500:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: 00000000d2cba6a1/0xb28d70e12575007b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125750082 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788530026.028044:0:6500:0:(mgc_request.c:2342:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788530026.028048:0:6500:0:(mgc_request.c:424:config_log_add()) add config log lustre-client-ffff9a9f0aaed800 10000000:01000000:3.0:1788530026.028054:0:6500:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-client-ffff9a9f0aaed800 10000000:01000000:3.0:1788530026.028061:0:6500:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788530026.028095:0:6500:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-client-ffff9a9f0aaed800 from 1 10000000:01000000:3.0:1788530026.028101:0:6500:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788530026.028167:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: 0000000016f931cf/0xb28d70e125750089 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530026.028178:0:6500:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: 0000000016f931cf/0xb28d70e125750089 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530026.028193:0:6500:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: 0000000016f931cf/0xb28d70e125750089 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530026.028225:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000001302903 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6500:1875409555687424:0@lo:101: 00000100:00100000:3.0:1788530026.028320:0:6500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530026.028397:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set 0000000012f9d65a going to sleep for 11 seconds 00000100:00100000:1.0:1788530026.028696:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555687424 00000100:00100000:1.0:1788530026.028707:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555687424 00000100:00100000:1.0:1788530026.028760:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788530026.028770:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c5ab3b4b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+11:6500:x1875409555687424:12345-0@lo:101: 00010000:00010000:1.0:1788530026.028785:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530026.028802:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000044a67cb0/0xb28d70e125750090 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e125750089 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530026.028830:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000044a67cb0/0xb28d70e125750090 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e125750089 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530026.028841:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000044a67cb0/0xb28d70e125750090 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125750089 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530026.028852:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000044a67cb0, rc 0) 00000100:00100000:1.0:1788530026.028975:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c5ab3b4b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+12:6500:x1875409555687424:12345-0@lo:101: Request processed in 206us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530026.028982:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788530026.029092:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000001302903 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6500:1875409555687424:0@lo:101: 00010000:00010000:3.0:1788530026.029117:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: 0000000016f931cf/0xb28d70e125750089 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125750090 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530026.029128:0:6500:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: 0000000016f931cf/0xb28d70e125750089 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e125750090 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530026.029205:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000001302903 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6500:1875409555687552:0@lo:501: 00000100:00100000:3.0:1788530026.029232:0:6500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530026.029261:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set 0000000012f9d65a going to sleep for 11 seconds 00000100:00100000:0.0:1788530026.029379:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555687552 00000100:00100000:0.0:1788530026.029384:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555687552 00000100:00100000:0.0:1788530026.029409:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788530026.029414:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000780550ba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+12:6500:x1875409555687552:12345-0@lo:501: 00000100:00100000:0.0:1788530026.029676:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000780550ba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+12:6500:x1875409555687552:12345-0@lo:501: Request processed in 260us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530026.029683:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788530026.029881:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000001302903 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6500:1875409555687552:0@lo:501: 00000100:00100000:3.0:1788530026.029994:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000001302903 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6500:1875409555687680:0@lo:503: 00000100:00100000:3.0:1788530026.030039:0:6500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530026.030105:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set 0000000012f9d65a going to sleep for 11 seconds 00000100:00100000:2.0:1788530026.030186:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555687680 00000100:00100000:2.0:1788530026.030191:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555687680 00000100:00100000:0.0:1788530026.030237:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788530026.030244:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000415bb39c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+12:6500:x1875409555687680:12345-0@lo:503: 00000100:00100000:0.0:1788530026.030539:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000415bb39c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+12:6500:x1875409555687680:12345-0@lo:503: Request processed in 296us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530026.030547:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788530026.030876:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000001302903 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6500:1875409555687680:0@lo:503: 00000100:00100000:1.0:1788530026.031361:0:6550:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ce2e39d7 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6550:1875409555687808:0@lo:502: 00000100:00100000:1.0:1788530026.031413:0:6550:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530026.031486:0:6550:0:(client.c:2716:ptlrpc_set_wait()) set 000000007dfe0d63 going to sleep for 11 seconds 00000100:00100000:0.0:1788530026.031520:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555687808 00000100:00100000:0.0:1788530026.031526:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555687808 00000100:00100000:0.0:1788530026.031791:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788530026.031801:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a5c7fb3f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+12:6550:x1875409555687808:12345-0@lo:502: 00000100:00100000:0.0:1788530026.031950:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a5c7fb3f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+12:6550:x1875409555687808:12345-0@lo:502: Request processed in 151us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530026.031958:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788530026.032030:0:6550:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ce2e39d7 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6550:1875409555687808:0@lo:502: 00000020:01000004:1.0:1788530026.032093:0:6550:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1788530026.032108:0:6550:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (0000000021c74fc1) 00000020:00000080:1.0:1788530026.032130:0:6550:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:1.0:1788530026.032238:0:6550:0:(tgt_mount.c:167:server_get_mount()) get mount 000000006c13d774 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788530026.032242:0:6550:0:(tgt_mount.c:201:server_put_mount()) put mount 000000006c13d774 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788530026.032249:0:6550:0:(obd_mount.c:712:lustre_put_lsi()) put 000000006c13d774 4 00010000:00080000:1.0:1788530026.032278:0:6550:0:(ldlm_lib.c:102:import_set_conn()) imp 000000003d86fa5a@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.141@tcp at head 00010000:00010000:1.0:1788530026.036363:0:6550:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:1.0:1788530026.037756:0:6550:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1788530026.037812:0:6550:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788530026.037827:0:6550:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xb28d70e12575009e 00000100:00080000:1.0:1788530026.037840:0:6550:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788530026.037848:0:6550:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000003d86fa5a using connection 192.168.202.141@tcp/0@lo 00000100:00100000:1.0:1788530026.038061:0:6550:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000ce2e39d7 x1875409555687936/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788530026.038096:0:6550:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788530026.041872:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ce2e39d7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875409555687936:0@lo:38: 00000100:00100000:0.0:1788530026.042020:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530026.042456:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555687936 00000100:00100000:2.0:1788530026.042467:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555687936 00000100:00100000:2.0:1788530026.042525:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788530026.042533:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dd153c8a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1875409555687936:12345-0@lo:38: 00000100:00100000:2.0:1788530026.042635:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dd153c8a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1875409555687936:12345-0@lo:38: Request processed in 102us (616us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788530026.042643:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788530026.042995:0:6550:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006e3f04d9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6550:1875409555688064:0@lo:502: 00000100:00100000:1.0:1788530026.043050:0:6550:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530026.043076:0:6550:0:(client.c:2716:ptlrpc_set_wait()) set 000000007f41e5b9 going to sleep for 11 seconds 00000100:00100000:1.0:1788530026.043099:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555688064 00000100:00100000:1.0:1788530026.043102:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555688064 00000100:00100000:1.0:1788530026.043134:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788530026.043140:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004444cc6c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+12:6550:x1875409555688064:12345-0@lo:502: 00000100:00100000:1.0:1788530026.043256:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004444cc6c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+12:6550:x1875409555688064:12345-0@lo:502: Request processed in 116us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530026.043263:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788530026.043340:0:6550:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006e3f04d9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6550:1875409555688064:0@lo:502: 00000040:00080000:1.0:1788530026.043371:0:6550:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000100:00100000:0.0:1788530026.043704:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788530026.043711:0:3646:0:(import.c:65:import_set_state_nolock()) 000000003d86fa5a lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788530026.043715:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788530026.043717:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ce2e39d7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875409555687936:0@lo:38: 00000020:01000000:3.0:1788530026.043879:0:6500:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:3.0:1788530026.043976:0:6500:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788530026.044040:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: 0000000016f931cf/0xb28d70e125750089 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125750090 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530026.044052:0:6500:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: 0000000016f931cf/0xb28d70e125750089 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125750090 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788530026.044115:0:6500:0:(tgt_mount.c:1239:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788530026.044117:0:6500:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788530026.044118:0:6500:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788530026.044120:0:6500:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:3.0:1788530026.044121:0:6500:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:3.0:1788530026.044123:0:6500:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:3.0:1788530026.044124:0:6500:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788530026.044126:0:6500:0:(tgt_mount.c:1250:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788530026.044128:0:6500:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788530026.044129:0:6500:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788530026.044130:0:6500:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788530026.044132:0:6500:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788530026.044136:0:6500:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:3.0:1788530026.044142:0:6500:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788530026.044143:0:6500:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788530026.044144:0:6500:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788530026.044145:0:6500:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:3.0:1788530026.044146:0:6500:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:3.0:1788530026.044147:0:6500:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:3.0:1788530026.044148:0:6500:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788530026.044148:0:6500:0:(tgt_mount.c:1250:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788530026.044149:0:6500:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788530026.044150:0:6500:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788530026.044151:0:6500:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788530026.044152:0:6500:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788530026.044172:0:6500:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788530026.044183:0:6500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000001302903 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6500:1875409555688192:0@lo:253: 00000100:00100000:3.0:1788530026.044231:0:6500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530026.044272:0:6500:0:(client.c:2716:ptlrpc_set_wait()) set 00000000132f21a5 going to sleep for 11 seconds 00000100:00100000:2.0:1788530026.045085:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555688192 00000100:00100000:2.0:1788530026.045097:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555688192 00000100:00100000:2.0:1788530026.045159:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788530026.045169:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003b54d9c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+12:6500:x1875409555688192:12345-0@lo:253: 20000000:01000000:2.0:1788530026.045202:0:6518:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788530026.045221:0:6518:0:(mgs_nids.c:468:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788530026.052192:0:6518:0:(mgs_nids.c:833:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788530026.052219:0:6518:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788530026.052519:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003b54d9c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+12:6500:x1875409555688192:12345-0@lo:253: Request processed in 7347us (8283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530026.052548:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788530026.052674:0:6500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000001302903 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6500:1875409555688192:0@lo:253: 10000000:01000000:1.0:1788530026.052691:0:6500:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788530026.052694:0:6500:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788530026.052696:0:6500:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788530026.052697:0:6500:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788530026.052698:0:6500:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:1.0:1788530026.052700:0:6500:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:1.0:1788530026.052701:0:6500:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:1.0:1788530026.052703:0:6500:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788530026.052705:0:6500:0:(tgt_mount.c:1250:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788530026.052706:0:6500:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788530026.052707:0:6500:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788530026.052709:0:6500:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788530026.052711:0:6500:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788530026.052731:0:6500:0:(tgt_mount.c:2823:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:0.0:1788530026.056296:0:6539:0:(mgs_nids.c:730:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788530026.056306:0:6539:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788530026.056365:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000031f80656/0xb28d70e1257500a5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530026.056391:0:6539:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000088441a49/0xb28d70e125750074 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e12575006d expref: 11 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530026.056399:0:6539:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000031f80656/0xb28d70e1257500a5 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530026.056462:0:6539:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000088441a49/0xb28d70e125750074 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb28d70e12575006d expref: 11 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530026.056485:0:6539:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000088441a49/0xb28d70e125750074 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb28d70e12575006d expref: 11 pid: 6518 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530026.056505:0:6539:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000df1b706c pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6539:1875409555688320:0@lo:104: 00000100:00100000:0.0:1788530026.056635:0:6539:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530026.056703:0:6539:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b14f2723 going to sleep for 11 seconds 00000100:00100000:2.0:1788530026.056805:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555688320 00000100:00100000:2.0:1788530026.056815:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555688320 00000100:00100000:2.0:1788530026.056878:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788530026.057008:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b1ec120e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+3:6539:x1875409555688320:12345-0@lo:104: 00010000:00010000:2.0:1788530026.057026:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: 0000000083712434/0xb28d70e12575006d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e125750074 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530026.057144:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788530026.057150:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b1ec120e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+3:6539:x1875409555688320:12345-0@lo:104: Request processed in 148us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530026.057157:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1788530026.057242:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788530026.057249:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: 0000000083712434/0xb28d70e12575006d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e125750074 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530026.057257:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000083712434 already unused, calling callback (00000000f0300a12) 10000000:00010000:3.0:1788530026.057260:0:6511:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: 0000000083712434/0xb28d70e12575006d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb28d70e125750074 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530026.057268:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: 0000000083712434/0xb28d70e12575006d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb28d70e125750074 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788530026.057274:0:6511:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: 0000000083712434/0xb28d70e12575006d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb28d70e125750074 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788530026.057279:0:6511:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788530026.057335:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: 0000000083712434/0xb28d70e12575006d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125750074 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530026.057363:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788530026.057381:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: 0000000083712434/0xb28d70e12575006d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125750074 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530026.057388:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: 0000000083712434/0xb28d70e12575006d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125750074 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530026.057405:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530026.057407:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530026.057408:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788530026.057522:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005273308d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3648:1875409555688448:0@lo:103: 00000100:00100000:3.0:1788530026.057557:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530026.059026:0:6539:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000df1b706c pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6539:1875409555688320:0@lo:104: 00010000:00010000:0.0:1788530026.059053:0:6539:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000031f80656/0xb28d70e1257500a5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530026.059094:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555688448 00000100:00100000:0.0:1788530026.059100:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555688448 00010000:00010000:0.0:1788530026.059126:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000088441a49/0xb28d70e125750074 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e12575006d expref: 12 pid: 6518 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530026.059157:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788530026.059163:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a5fce3e3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+12:3648:x1875409555688448:12345-0@lo:103: 00010000:00010000:0.0:1788530026.059174:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788530026.059177:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000088441a49/0xb28d70e125750074 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e12575006d expref: 12 pid: 6518 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530026.059186:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000088441a49/0xb28d70e125750074 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb28d70e12575006d expref: 12 pid: 6518 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530026.059199:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000088441a49/0xb28d70e125750074 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb28d70e12575006d expref: 12 pid: 6518 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530026.059212:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000031f80656/0xb28d70e1257500a5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530026.059219:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000031f80656/0xb28d70e1257500a5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788530026.059231:0:6508:0:(mgs_nids.c:706:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002926800s 00010000:00010000:0.0:1788530026.059234:0:6508:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000031f80656/0xb28d70e1257500a5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530026.059240:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000031f80656/0xb28d70e1257500a5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530026.059246:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000031f80656/0xb28d70e1257500a5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530026.059251:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000031f80656/0xb28d70e1257500a5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530026.059262:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000031f80656 already unused, calling callback (0000000096f15eee) 00010000:00010000:0.0:1788530026.059265:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000031f80656/0xb28d70e1257500a5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530026.059271:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000031f80656/0xb28d70e1257500a5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530026.059291:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000031f80656/0xb28d70e1257500a5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530026.059300:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788530026.059354:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a5fce3e3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+11:3648:x1875409555688448:12345-0@lo:103: Request processed in 191us (1797us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530026.059360:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788530026.059387:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005273308d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3648:1875409555688448:0@lo:103: 00010000:00010000:2.0:1788530026.059454:0:6539:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000031f80656/0xb28d70e1257500a5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530026.059462:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000031f80656/0xb28d70e1257500a5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530026.059467:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000031f80656/0xb28d70e1257500a5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:1.0:1788530026.061003:0:6500:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:1.0:1788530026.061240:0:6500:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1788530026.061463:0:6500:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:1.0:1788530026.062173:0:6500:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1788530026.062446:0:6500:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:1.0:1788530026.063235:0:6500:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:1.0:1788530026.064505:0:6500:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:1.0:1788530026.064998:0:6500:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:1.0:1788530026.065203:0:6500:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:1.0:1788530026.065381:0:6500:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:1.0:1788530026.065790:0:6500:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:1.0:1788530026.066054:0:6500:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:1.0:1788530026.070881:0:6500:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:3.0:1788530026.082771:0:6500:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1788530026.083202:0:6555:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1788530026.083214:0:6555:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:3.0:1788530026.083293:0:6556:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:00080000:1.0:1788530026.086144:0:6556:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:1.0:1788530026.091374:0:6500:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1788530026.091512:0:6500:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788530026.092417:0:6500:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788530026.092435:0:6500:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1788530026.094022:0:6500:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788530026.096537:0:6500:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788530026.097493:0:6556:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788530026.097693:0:6556:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788530026.097698:0:6556:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:1.0:1788530026.098105:0:6500:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788530026.098175:0:6500:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1788530026.098506:0:6500:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1788530026.099194:0:6500:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:1.0:1788530026.100384:0:6500:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1788530026.100540:0:6500:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1788530026.101031:0:6500:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1788530026.101190:0:6500:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1788530026.101346:0:6500:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1788530026.101488:0:6500:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1788530026.102007:0:6500:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1788530026.102170:0:6500:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1788530026.102299:0:6500:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1788530026.102454:0:6500:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1788530026.102862:0:6500:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1788530026.103107:0:6500:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1788530026.103250:0:6500:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1788530026.103408:0:6500:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1788530026.104118:0:6500:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1788530026.104487:0:6500:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1788530026.105222:0:6500:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1788530026.105413:0:6500:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1788530026.105557:0:6500:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1788530026.106385:0:6500:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1788530026.106527:0:6500:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1788530026.106865:0:6500:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1788530026.107153:0:6500:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1788530026.107299:0:6500:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1788530026.107446:0:6500:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1788530026.107805:0:6500:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1788530026.108041:0:6500:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1788530026.108205:0:6500:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1788530026.108375:0:6500:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1788530026.108540:0:6500:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1788530026.109236:0:6500:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1788530026.109394:0:6500:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1788530026.109674:0:6500:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:0.0:1788530026.115047:0:6500:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788530026.115103:0:6500:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb37801c5f9b8 00100000:10000000:0.0:1788530026.115113:0:6500:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1788530026.115868:0:6500:0:(tgt_mount.c:2543:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1788530026.115972:0:6500:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1788530026.117989:0:6500:0:(tgt_mount.c:2429:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788530026.118239:0:6500:0:(tgt_mount.c:2444:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:1.0:1788530026.700516:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530027.712715:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530028.737487:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530029.760673:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530030.789065:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788530031.172344:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788530031.172354:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788530031.172358:0:36:0:(import.c:65:import_set_state_nolock()) 000000003d86fa5a lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788530031.172374:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000003d86fa5a using connection 192.168.202.141@tcp/0@lo 00000100:00100000:1.0:1788530031.172407:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000005f9a9d6e x1875409555688704/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788530031.172450:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005f9a9d6e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875409555688704:0@lo:38: 00000100:00100000:1.0:1788530031.172531:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530031.172646:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555688704 00000100:00100000:1.0:1788530031.172654:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555688704 00000100:00100000:1.0:1788530031.172686:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788530031.172693:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000499f5cd3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1875409555688704:12345-0@lo:38: 00010000:00080000:1.0:1788530031.172717:0:6525:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 239 last 0 00000020:00000080:1.0:1788530031.173019:0:6525:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xb28d70e1257500ac 00000004:00100000:1.0:1788530031.173100:0:6525:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788530031.173411:0:6525:0:(import.c:65:import_set_state_nolock()) 00000000508eb9e3 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788530031.173482:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000499f5cd3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875409555688704:12345-0@lo:38: Request processed in 788us (950us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530031.173490:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788530031.173544:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000005f9a9d6e x1875409555688704/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788530041 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788530031.173588:0:3646:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788530031.173598:0:3646:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788530031.173603:0:3646:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788530031.173605:0:3646:0:(import.c:65:import_set_state_nolock()) 000000003d86fa5a lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788530031.173621:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005f9a9d6e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875409555688704:0@lo:38: 00000100:00100000:3.0:1788530031.173854:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006e3f04d9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3649:1875409555688576:0@lo:400: 00000100:00100000:3.0:1788530031.173899:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530031.174591:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555688576 00000100:00100000:1.0:1788530031.174599:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555688576 00000100:00100000:1.0:1788530031.174637:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788530031.174643:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000838c20fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+11:3649:x1875409555688576:12345-0@lo:400: 00000100:00100000:1.0:1788530031.174690:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000838c20fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+11:3649:x1875409555688576:12345-0@lo:400: Request processed in 47us (792us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530031.174697:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788530031.177768:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006e3f04d9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3649:1875409555688576:0@lo:400: 00010000:00010000:0.0:1788530031.809447:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788530032.577031:0:6801:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg241-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788530032.836286:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530033.858513:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788530033.936957:0:6853:0:(tgt_mount.c:2429:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788530033.937854:0:6853:0:(tgt_mount.c:2444:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:2.0:1788530034.753141:0:6521:0:(mgc_request.c:715:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788530034.753148:0:6521:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-mdtir-ffff9a9f0aaed800 from 3 10000000:01000000:2.0:1788530034.753153:0:6521:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788530034.753209:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: 0000000088441a49/0xb28d70e1257500b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530034.753221:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: 0000000088441a49/0xb28d70e1257500b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530034.753231:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: 0000000088441a49/0xb28d70e1257500b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530034.753263:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d1dca734 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555688832:0@lo:101: 00000100:00100000:2.0:1788530034.753329:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530034.753378:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set 00000000293bbf0a going to sleep for 11 seconds 00000100:00100000:1.0:1788530034.753454:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555688832 00000100:00100000:1.0:1788530034.753462:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555688832 00000100:00100000:1.0:1788530034.753521:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788530034.753529:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004a5b0550 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+11:6521:x1875409555688832:12345-0@lo:101: 00010000:00010000:1.0:1788530034.753542:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530034.753554:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007056ff89/0xb28d70e1257500ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e1257500b3 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530034.753889:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007056ff89/0xb28d70e1257500ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e1257500b3 expref: 12 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530034.753901:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007056ff89/0xb28d70e1257500ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e1257500b3 expref: 12 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530034.753911:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007056ff89, rc 0) 00000100:00100000:1.0:1788530034.753967:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004a5b0550 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+12:6521:x1875409555688832:12345-0@lo:101: Request processed in 439us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530034.753974:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788530034.754070:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d1dca734 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555688832:0@lo:101: 00010000:00010000:0.0:1788530034.754087:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: 0000000088441a49/0xb28d70e1257500b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257500ba expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530034.754095:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: 0000000088441a49/0xb28d70e1257500b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e1257500ba expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530034.754158:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000df1b706c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555688960:0@lo:256: 00000100:00100000:0.0:1788530034.754205:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530034.754239:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c1b2149d going to sleep for 11 seconds 00000100:00100000:1.0:1788530034.754303:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555688960 00000100:00100000:1.0:1788530034.754308:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555688960 00000100:00100000:1.0:1788530034.754351:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788530034.754357:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007c1c3201 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+12:6521:x1875409555688960:12345-0@lo:256: 20000000:01000000:1.0:1788530034.754372:0:6516:0:(mgs_nids.c:1159:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788530034.754388:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788530034.754391:0:6516:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1788530034.754468:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007c1c3201 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+12:6521:x1875409555688960:12345-0@lo:256: Request processed in 110us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530034.754475:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788530034.754505:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000df1b706c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555688960:0@lo:256: 10000000:01000000:1.0:1788530034.754547:0:6521:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788530034.754553:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: 0000000088441a49/0xb28d70e1257500b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257500ba expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530034.754586:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: 0000000088441a49/0xb28d70e1257500b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257500ba expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530034.885162:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530035.905004:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788530036.292922:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788530036.292948:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005f9a9d6e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3649:1875409555689088:0@lo:400: 00000100:00100000:1.0:1788530036.293030:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530036.293080:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788530036.293088:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003d082350 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875409555689216:0@lo:400: 00000100:00100000:1.0:1788530036.293115:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530036.293146:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555689088 00000100:00100000:1.0:1788530036.293152:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555689088 00000100:00100000:1.0:1788530036.293196:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788530036.293204:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000024ce17fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+12:3649:x1875409555689088:12345-0@lo:400: 00000100:00100000:1.0:1788530036.293259:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000024ce17fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+12:3649:x1875409555689088:12345-0@lo:400: Request processed in 55us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530036.293281:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788530036.293328:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005f9a9d6e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3649:1875409555689088:0@lo:400: 00000100:00100000:1.0:1788530036.293362:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555689216 00000100:00100000:1.0:1788530036.293365:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555689216 00000100:00100000:1.0:1788530036.293388:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788530036.293394:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fb9bcbed pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875409555689216:12345-0@lo:400: 00000100:00100000:1.0:1788530036.293427:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fb9bcbed pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875409555689216:12345-0@lo:400: Request processed in 33us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530036.293433:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788530036.293458:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000003d082350 x1875409555689216/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530052 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530036.293469:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003d082350 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875409555689216:0@lo:400: 00010000:00010000:0.0:1788530036.935734:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788530037.405376:0:6954:0:(tgt_mount.c:2429:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788530037.405870:0:6954:0:(tgt_mount.c:2444:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788530037.952963:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530038.977033:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530040.001741:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530041.025713:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788530041.420655:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788530041.420676:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000912317d2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3647:1875409555689344:0@lo:400: 00000100:00100000:2.0:1788530041.420743:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530041.420790:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788530041.420798:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000022a922a6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875409555689472:0@lo:400: 00000100:00100000:2.0:1788530041.420827:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530041.423675:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555689344 00000100:00100000:2.0:1788530041.423690:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555689344 00000100:00100000:2.0:1788530041.423745:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788530041.423755:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000888000ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+12:3647:x1875409555689344:12345-0@lo:400: 00000100:00100000:2.0:1788530041.423859:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000888000ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+12:3647:x1875409555689344:12345-0@lo:400: Request processed in 105us (3114us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530041.423866:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788530041.423881:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000912317d2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3647:1875409555689344:0@lo:400: 00000100:00100000:1.0:1788530041.424409:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555689472 00000100:00100000:1.0:1788530041.424417:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555689472 00000100:00100000:1.0:1788530041.425777:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788530041.425795:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009f7c475a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875409555689472:12345-0@lo:400: 00000100:00100000:1.0:1788530041.425911:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009f7c475a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875409555689472:12345-0@lo:400: Request processed in 123us (5084us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530041.425920:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788530041.429686:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000022a922a6 x1875409555689472/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530057 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530041.429709:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000022a922a6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875409555689472:0@lo:400: 00010000:00010000:0.0:1788530042.051605:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530043.082554:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530044.099831:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530045.120712:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530046.146696:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788530046.532185:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788530046.533228:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004809179b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875409555689728:0@lo:400: 00000100:00100000:2.0:1788530046.533333:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530046.537749:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555689728 00000100:00100000:3.0:1788530046.537777:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555689728 00000100:00100000:3.0:1788530046.537880:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788530046.537895:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000022a922a6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875409555689728:12345-0@lo:400: 00000100:00100000:3.0:1788530046.538056:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000022a922a6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875409555689728:12345-0@lo:400: Request processed in 165us (4724us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530046.538068:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788530046.538276:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000004809179b x1875409555689728/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530062 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530046.538299:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004809179b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875409555689728:0@lo:400: 00000100:00100000:1.0:1788530046.538457:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000387685f1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3649:1875409555689600:0@lo:400: 00000100:00100000:1.0:1788530046.539890:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530046.540130:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555689600 00000100:00100000:2.0:1788530046.540155:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555689600 00000100:00100000:2.0:1788530046.540243:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788530046.540256:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c515ce1f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+12:3649:x1875409555689600:12345-0@lo:400: 00000100:00100000:2.0:1788530046.540344:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c515ce1f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+12:3649:x1875409555689600:12345-0@lo:400: Request processed in 91us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530046.540356:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788530046.545953:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000387685f1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3649:1875409555689600:0@lo:400: 00010000:00010000:0.0:1788530047.169811:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530048.195797:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788530049.068222:0:7453:0:(obd_mount.c:925:lmd_print()) mount data: 00000020:01000004:3.0:1788530049.068226:0:7453:0:(obd_mount.c:928:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:3.0:1788530049.068228:0:7453:0:(obd_mount.c:931:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1788530049.069170:0:7453:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000de32919a 00000020:01000004:3.0:1788530049.069186:0:7453:0:(tgt_mount.c:2585:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:3.0:1788530049.069198:0:7453:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788530049.069222:0:7453:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (00000000f141f220) 00000020:00000080:3.0:1788530049.069237:0:7453:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788530049.126761:0:7453:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:2.0:1788530049.126857:0:7453:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:2.0:1788530049.154787:0:7453:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788530049.155047:0:7453:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1788530049.155059:0:7453:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788530049.155073:0:7453:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb28d70e1257500c8 00000020:01000004:2.0:1788530049.155080:0:7453:0:(tgt_mount.c:2670:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1788530049.155105:0:7453:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.141@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788530049.155119:0:7453:0:(mgc_request.c:1372:mgc_set_info_async()) InitRecov MGC192.168.202.141@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788530049.155126:0:7453:0:(tgt_mount.c:1882:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1788530049.155155:0:7453:0:(tgt_mount.c:1482:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.202.141@tcp, index=0001, flags=0x20061 00000020:01000004:2.0:1788530049.155159:0:7453:0:(tgt_mount.c:1239:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788530049.155161:0:7453:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788530049.155162:0:7453:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788530049.155163:0:7453:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:2.0:1788530049.155168:0:7453:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:2.0:1788530049.155169:0:7453:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:2.0:1788530049.155171:0:7453:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788530049.155172:0:7453:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788530049.155173:0:7453:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788530049.155174:0:7453:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788530049.155176:0:7453:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788530049.155178:0:7453:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:2.0:1788530049.155181:0:7453:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788530049.155182:0:7453:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788530049.155183:0:7453:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788530049.155184:0:7453:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:2.0:1788530049.155185:0:7453:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:2.0:1788530049.155186:0:7453:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:2.0:1788530049.155187:0:7453:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788530049.155187:0:7453:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788530049.155188:0:7453:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788530049.155189:0:7453:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788530049.155190:0:7453:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788530049.155216:0:7453:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1788530049.155235:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c3370756 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:7453:1875409555689856:0@lo:253: 00000100:00100000:2.0:1788530049.155331:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530049.155413:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f6f6156e going to sleep for 11 seconds 00000100:00100000:0.0:1788530049.155847:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555689856 00000100:00100000:0.0:1788530049.155859:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555689856 00000100:00100000:0.0:1788530049.155923:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788530049.155932:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006d75df18 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+12:7453:x1875409555689856:12345-0@lo:253: 20000000:01000000:0.0:1788530049.155976:0:6516:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788530049.155981:0:6516:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:0.0:1788530049.155988:0:6516:0:(mgs_llog.c:875:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:0.0:1788530049.155991:0:6516:0:(mgs_llog.c:3618:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:0.0:1788530049.156056:0:6516:0:(mgs_llog.c:3178:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:0.0:1788530049.156434:0:6516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788530049.156639:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1788530049.156653:0:6516:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788530049.156672:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:0.0:1788530049.156690:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:0.0:1788530049.156707:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:0.0:1788530049.156771:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:0.0:1788530049.156780:0:6516:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:0.0:1788530049.156795:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:0.0:1788530049.156801:0:6516:0:(mgs_llog.c:1545:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:0.0:1788530049.156814:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:0.0:1788530049.156830:0:6516:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:0.0:1788530049.156846:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:0.0:1788530049.156861:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:0.0:1788530049.156994:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:0.0:1788530049.157004:0:6516:0:(mgs_llog.c:1545:record_base_raw()) lcfg (null) 0xcf005 192.168.202.141@tcp (null) (null) (null) 00000040:00080000:0.0:1788530049.157017:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:0.0:1788530049.157024:0:6516:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788530049.157038:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:0.0:1788530049.157044:0:6516:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.202.141@tcp (null) (null) 00000040:00080000:0.0:1788530049.157057:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:0.0:1788530049.157062:0:6516:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1788530049.157075:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:0.0:1788530049.157090:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:0.0:1788530049.157102:0:6516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:0.0:1788530049.157202:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:0.0:1788530049.157213:0:6516:0:(mgs_llog.c:1545:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:0.0:1788530049.157244:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:0.0:1788530049.157264:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:0.0:1788530049.157278:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:0.0:1788530049.157284:0:6516:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:0.0:1788530049.157295:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:0.0:1788530049.157313:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:0.0:1788530049.157318:0:6516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:0.0:1788530049.157341:0:6516:0:(mgs_llog.c:3315:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1788530049.157350:0:6516:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:0.0:1788530049.157648:0:7459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:0.0:1788530049.157749:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1788530049.157774:0:6516:0:(mgs_llog.c:3361:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.141@tcp for mdt 20000000:01000000:0.0:1788530049.157776:0:6516:0:(mgs_llog.c:1545:record_base_raw()) lcfg (null) 0xcf005 192.168.202.141@tcp (null) (null) (null) 00000040:00080000:0.0:1788530049.157791:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1788530049.157807:0:6516:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1788530049.157823:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1788530049.157829:0:6516:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.202.141@tcp (null) (null) 00000040:00080000:0.0:1788530049.157846:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1788530049.157855:0:6516:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:0.0:1788530049.157867:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:0.0:1788530049.157881:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:0.0:1788530049.157921:0:6516:0:(mgs_llog.c:3441:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:0.0:1788530049.157929:0:6516:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:3.0:1788530049.159779:0:7460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:0.0:1788530049.160098:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1788530049.160136:0:6516:0:(mgs_llog.c:3499:mgs_write_log_osp_to_mdt()) add nid 192.168.202.141@tcp for mdt 20000000:01000000:0.0:1788530049.160139:0:6516:0:(mgs_llog.c:1545:record_base_raw()) lcfg (null) 0xcf005 192.168.202.141@tcp (null) (null) (null) 00000040:00080000:0.0:1788530049.160155:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1788530049.160161:0:6516:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788530049.160174:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1788530049.160179:0:6516:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.202.141@tcp (null) (null) 00000040:00080000:0.0:1788530049.160193:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1788530049.160200:0:6516:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:0.0:1788530049.160211:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1788530049.160225:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:0.0:1788530049.160248:0:6516:0:(mgs_llog.c:5258:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788530049.160252:0:6516:0:(mgs_llog.c:4754:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788530049.160257:0:6516:0:(mgs_llog.c:4187:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788530049.160335:0:6516:0:(mgs_llog.c:2556:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788530049.160338:0:6516:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788530049.161179:0:7461:0:(mgs_llog.c:1082:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:3.0:1788530049.161209:0:7461:0:(mgs_llog.c:1082:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:3.0:1788530049.161226:0:7461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1788530049.165672:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:0.0:1788530049.165707:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:0.0:1788530049.165725:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:0.0:1788530049.165738:0:6516:0:(mgs_llog.c:2556:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788530049.165740:0:6516:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788530049.170718:0:7462:0:(mgs_llog.c:1082:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:1.0:1788530049.170795:0:7462:0:(mgs_llog.c:1082:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:1.0:1788530049.170814:0:7462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1788530049.171604:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1788530049.171650:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1788530049.171691:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:0.0:1788530049.171702:0:6516:0:(mgs_llog.c:2556:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1788530049.171705:0:6516:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788530049.173884:0:7463:0:(mgs_llog.c:1082:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:0.0:1788530049.173937:0:7463:0:(mgs_llog.c:1082:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:0.0:1788530049.174363:0:7463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:1.0:1788530049.177782:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:1.0:1788530049.177824:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:1.0:1788530049.177841:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:1.0:1788530049.177859:0:6516:0:(mgs_llog.c:5258:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1788530049.177862:0:6516:0:(mgs_llog.c:4754:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1788530049.177868:0:6516:0:(mgs_llog.c:5078:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1788530049.177876:0:6516:0:(mgs_llog.c:1385:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1788530049.179280:0:7464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:1.0:1788530049.180049:0:6516:0:(mgs_llog.c:1456:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788530049.191908:0:6516:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788530049.192124:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000060ad5f15/0xb28d70e1257500cf lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530049.192149:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000a3916e29/0xb28d70e125750004 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e12574fffd expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530049.192157:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000ee4bff5b/0xb28d70e125750020 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125750019 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530049.192163:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000044a67cb0/0xb28d70e125750090 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125750089 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530049.192170:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000060ad5f15/0xb28d70e1257500cf lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530049.192236:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000044a67cb0/0xb28d70e125750090 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb28d70e125750089 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530049.192259:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000044a67cb0/0xb28d70e125750090 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb28d70e125750089 expref: 12 pid: 6516 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530049.192279:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000049cbb968 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6516:1875409555689984:0@lo:104: 00000100:00100000:0.0:1788530049.192518:0:6516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788530049.193326:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000ee4bff5b/0xb28d70e125750020 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb28d70e125750019 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530049.193368:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000ee4bff5b/0xb28d70e125750020 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb28d70e125750019 expref: 12 pid: 6517 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530049.193390:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fa37a8ca pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6516:1875409555690112:0@lo:104: 00000100:00100000:0.0:1788530049.193426:0:6516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788530049.193844:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000a3916e29/0xb28d70e125750004 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb28d70e12574fffd expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530049.193853:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000a3916e29/0xb28d70e125750004 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb28d70e12574fffd expref: 12 pid: 6517 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530049.193862:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f230cb1e pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6516:1875409555690240:0@lo:104: 00000100:00100000:0.0:1788530049.193888:0:6516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530049.193945:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555689984 00000100:00100000:2.0:1788530049.194024:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555689984 00000100:00100000:2.0:1788530049.194071:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555690112 00000100:00100000:2.0:1788530049.194073:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555690112 00000100:00100000:2.0:1788530049.194087:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788530049.194095:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f3ba5d6e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+4:6516:x1875409555689984:12345-0@lo:104: 00010000:00010000:2.0:1788530049.194120:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: 0000000016f931cf/0xb28d70e125750089 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e125750090 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530049.194579:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788530049.194586:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f3ba5d6e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+4:6516:x1875409555689984:12345-0@lo:104: Request processed in 492us (2069us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530049.194604:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788530049.194623:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788530049.194630:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007cf0bb1f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+3:6516:x1875409555690112:12345-0@lo:104: 00010000:00010000:2.0:1788530049.194637:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: 000000003338f9a9/0xb28d70e125750019 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e125750020 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530049.194721:0:6516:0:(client.c:2716:ptlrpc_set_wait()) set 0000000069ef915a going to sleep for 11 seconds 00000100:00100000:0.0:1788530049.194748:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000049cbb968 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6516:1875409555689984:0@lo:104: 00000100:00100000:0.0:1788530049.194756:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fa37a8ca pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6516:1875409555690112:0@lo:104: 00000100:00100000:1.0:1788530049.194810:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555690240 00000100:00100000:1.0:1788530049.194816:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555690240 00010000:00010000:3.0:1788530049.198593:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788530049.198614:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: 0000000016f931cf/0xb28d70e125750089 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e125750090 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530049.198634:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000016f931cf already unused, calling callback (00000000f0300a12) 10000000:00010000:3.0:1788530049.198638:0:6512:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: 0000000016f931cf/0xb28d70e125750089 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb28d70e125750090 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530049.198650:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: 0000000016f931cf/0xb28d70e125750089 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb28d70e125750090 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788530049.198657:0:6512:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: 0000000016f931cf/0xb28d70e125750089 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb28d70e125750090 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788530049.198698:0:6512:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788530049.198784:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: 0000000016f931cf/0xb28d70e125750089 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125750090 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530049.198791:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788530049.198832:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: 0000000016f931cf/0xb28d70e125750089 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125750090 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530049.198839:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: 0000000016f931cf/0xb28d70e125750089 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125750090 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530049.198863:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788530049.198866:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: 000000003338f9a9/0xb28d70e125750019 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e125750020 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530049.198872:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003338f9a9 already unused, calling callback (00000000f0300a12) 10000000:00010000:3.0:1788530049.198874:0:6512:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: 000000003338f9a9/0xb28d70e125750019 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb28d70e125750020 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530049.198880:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: 000000003338f9a9/0xb28d70e125750019 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb28d70e125750020 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788530049.198886:0:6512:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: 000000003338f9a9/0xb28d70e125750019 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb28d70e125750020 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788530049.198891:0:6512:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788530049.198906:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: 000000003338f9a9/0xb28d70e125750019 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125750020 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530049.198911:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788530049.198932:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: 000000003338f9a9/0xb28d70e125750019 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125750020 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530049.198938:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: 000000003338f9a9/0xb28d70e125750019 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125750020 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530049.198948:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530049.198950:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530049.198952:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788530049.198967:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788530049.198989:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005aa0d843 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3647:1875409555690368:0@lo:103: 00000100:00100000:3.0:1788530049.199079:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530049.199141:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cc837508 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3649:1875409555690496:0@lo:103: 00000100:00100000:3.0:1788530049.199165:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530049.199201:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555690368 00000100:00100000:3.0:1788530049.199209:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555690368 00010000:00010000:3.0:1788530049.199240:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000044a67cb0/0xb28d70e125750090 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e125750089 expref: 13 pid: 6516 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530049.199267:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555690496 00000100:00100000:3.0:1788530049.199270:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555690496 00010000:00010000:3.0:1788530049.199280:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000ee4bff5b/0xb28d70e125750020 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e125750019 expref: 14 pid: 6517 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530049.199295:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788530049.199303:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000081a44bf1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+14:3647:x1875409555690368:12345-0@lo:103: 00010000:00010000:3.0:1788530049.199317:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788530049.199321:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000044a67cb0/0xb28d70e125750090 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e125750089 expref: 14 pid: 6516 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530049.199354:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000044a67cb0/0xb28d70e125750090 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb28d70e125750089 expref: 14 pid: 6516 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530049.199371:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000044a67cb0/0xb28d70e125750090 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb28d70e125750089 expref: 14 pid: 6516 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530049.199681:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788530049.199735:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000081a44bf1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+13:3647:x1875409555690368:12345-0@lo:103: Request processed in 432us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530049.199742:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788530049.199763:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788530049.199769:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000001ce108e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+12:3649:x1875409555690496:12345-0@lo:103: 00010000:00010000:3.0:1788530049.199777:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788530049.199780:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000ee4bff5b/0xb28d70e125750020 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e125750019 expref: 12 pid: 6517 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530049.199788:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000ee4bff5b/0xb28d70e125750020 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb28d70e125750019 expref: 12 pid: 6517 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530049.199798:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ee4bff5b/0xb28d70e125750020 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb28d70e125750019 expref: 12 pid: 6517 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530049.199806:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788530049.199872:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000001ce108e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+11:3649:x1875409555690496:12345-0@lo:103: Request processed in 103us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530049.199879:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788530049.199942:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005aa0d843 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3647:1875409555690368:0@lo:103: 00010000:00010000:2.0:1788530049.200018:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1788530049.200025:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007cf0bb1f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+4:6516:x1875409555690112:12345-0@lo:104: Request processed in 5396us (6598us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530049.200033:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788530049.200052:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788530049.200060:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fadade15 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+3:6516:x1875409555690240:12345-0@lo:104: 00010000:00010000:2.0:1788530049.200069:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: 000000007bd13ed4/0xb28d70e12574fffd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e125750004 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530049.200130:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788530049.200135:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fadade15 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+3:6516:x1875409555690240:12345-0@lo:104: Request processed in 78us (6247us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530049.200140:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1788530049.200190:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788530049.200195:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: 000000007bd13ed4/0xb28d70e12574fffd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e125750004 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530049.200201:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000007bd13ed4 already unused, calling callback (00000000f0300a12) 10000000:00010000:0.0:1788530049.200204:0:6511:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: 000000007bd13ed4/0xb28d70e12574fffd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb28d70e125750004 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530049.200210:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: 000000007bd13ed4/0xb28d70e12574fffd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb28d70e125750004 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788530049.200227:0:6511:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: 000000007bd13ed4/0xb28d70e12574fffd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb28d70e125750004 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788530049.200232:0:6511:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788530049.200264:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: 000000007bd13ed4/0xb28d70e12574fffd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125750004 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530049.200270:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788530049.200279:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: 000000007bd13ed4/0xb28d70e12574fffd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125750004 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530049.200284:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: 000000007bd13ed4/0xb28d70e12574fffd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125750004 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530049.200301:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530049.200302:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530049.200303:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788530049.200497:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001e31744e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3650:1875409555690624:0@lo:103: 00000100:00100000:3.0:1788530049.200531:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788530049.200604:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788530049.200623:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f230cb1e pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6516:1875409555690240:0@lo:104: 00010000:00010000:3.0:1788530049.200642:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000060ad5f15/0xb28d70e1257500cf lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530049.200695:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555690624 00000100:00100000:0.0:1788530049.200701:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555690624 00010000:00010000:0.0:1788530049.200720:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000a3916e29/0xb28d70e125750004 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e12574fffd expref: 11 pid: 6517 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530049.200744:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788530049.200750:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a50b4bb0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+11:3650:x1875409555690624:12345-0@lo:103: 00010000:00010000:0.0:1788530049.200757:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788530049.200760:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000a3916e29/0xb28d70e125750004 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e12574fffd expref: 11 pid: 6517 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530049.200768:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000a3916e29/0xb28d70e125750004 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb28d70e12574fffd expref: 11 pid: 6517 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530049.200783:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a3916e29/0xb28d70e125750004 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb28d70e12574fffd expref: 11 pid: 6517 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530049.200794:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000060ad5f15/0xb28d70e1257500cf lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530049.200801:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000060ad5f15/0xb28d70e1257500cf lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530049.200814:0:6508:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000060ad5f15/0xb28d70e1257500cf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530049.200820:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000060ad5f15/0xb28d70e1257500cf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530049.200826:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000060ad5f15/0xb28d70e1257500cf lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530049.200831:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000060ad5f15/0xb28d70e1257500cf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530049.200836:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000060ad5f15 already unused, calling callback (0000000096f15eee) 00010000:00010000:0.0:1788530049.200839:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000060ad5f15/0xb28d70e1257500cf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530049.200845:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000060ad5f15/0xb28d70e1257500cf lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530049.200860:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000060ad5f15/0xb28d70e1257500cf lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530049.200879:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788530049.200908:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a50b4bb0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+10:3650:x1875409555690624:12345-0@lo:103: Request processed in 159us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530049.200914:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788530049.200938:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001e31744e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3650:1875409555690624:0@lo:103: 00010000:00010000:2.0:1788530049.201014:0:6516:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000060ad5f15/0xb28d70e1257500cf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530049.201022:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000060ad5f15/0xb28d70e1257500cf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530049.201028:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000060ad5f15/0xb28d70e1257500cf lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788530049.201057:0:6516:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1788530049.207189:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cc837508 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3649:1875409555690496:0@lo:103: 00000100:00100000:0.0:1788530049.211694:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006d75df18 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+9:7453:x1875409555689856:12345-0@lo:253: Request processed in 55752us (56352us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530049.211715:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788530049.214519:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c3370756 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:7453:1875409555689856:0@lo:253: 10000000:01000000:2.0:1788530049.214545:0:7453:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1788530049.214548:0:7453:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788530049.214550:0:7453:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788530049.214551:0:7453:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788530049.214552:0:7453:0:(tgt_mount.c:1242:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:2.0:1788530049.214553:0:7453:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:2.0:1788530049.214554:0:7453:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:2.0:1788530049.214555:0:7453:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788530049.214557:0:7453:0:(tgt_mount.c:1260:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788530049.214585:0:7453:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788530049.214587:0:7453:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788530049.214719:0:7453:0:(tgt_mount.c:115:server_register_mount()) register mount 00000000de32919a from lustre-MDT0001 10000000:01000000:0.0:1788530049.214755:0:7453:0:(mgc_request.c:2342:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1788530049.214759:0:7453:0:(mgc_request.c:424:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1788530049.214765:0:7453:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9a9f32bea000 10000000:01000000:0.0:1788530049.214770:0:7453:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788530049.214788:0:7453:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.202.141@tcp: setup lustre-MDT0001-osd 00010000:00010000:1.0:1788530049.225548:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1788530049.232248:0:7453:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.141@tcp ctxt 1 is initialized 00000040:01000000:3.0:1788530049.264220:0:7453:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.141@tcp ctxt 0 is initialized 10000000:01000000:3.0:1788530049.264242:0:7453:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-sptlrpc-ffff9a9f32bea000 from 1 10000000:01000000:3.0:1788530049.264245:0:7453:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788530049.264289:0:7453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: 0000000016f931cf/0xb28d70e1257500d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530049.264300:0:7453:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: 0000000016f931cf/0xb28d70e1257500d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530049.264310:0:7453:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: 0000000016f931cf/0xb28d70e1257500d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530049.264332:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000db76e783 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:7453:1875409555690752:0@lo:101: 00000100:00100000:3.0:1788530049.265521:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530049.265674:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a34af055 going to sleep for 11 seconds 00000100:00100000:2.0:1788530049.268745:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555690752 00000100:00100000:2.0:1788530049.268761:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555690752 00000100:00100000:0.0:1788530049.270836:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788530049.270849:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000f75ce53 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+9:7453:x1875409555690752:12345-0@lo:101: 00010000:00010000:0.0:1788530049.270868:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530049.270887:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a3916e29/0xb28d70e1257500dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e1257500d6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530049.270913:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a3916e29/0xb28d70e1257500dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e1257500d6 expref: 10 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530049.270924:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a3916e29/0xb28d70e1257500dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e1257500d6 expref: 10 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530049.270933:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a3916e29, rc 0) 00000100:00100000:0.0:1788530049.271025:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000f75ce53 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+10:7453:x1875409555690752:12345-0@lo:101: Request processed in 178us (5508us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530049.271032:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788530049.271124:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000db76e783 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:7453:1875409555690752:0@lo:101: 00010000:00010000:3.0:1788530049.271144:0:7453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: 0000000016f931cf/0xb28d70e1257500d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257500dd expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530049.271152:0:7453:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: 0000000016f931cf/0xb28d70e1257500d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e1257500dd expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530049.271256:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000db76e783 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:7453:1875409555690880:0@lo:501: 00000100:00100000:3.0:1788530049.271293:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530049.281259:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555690880 00000100:00100000:2.0:1788530049.281281:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555690880 00000100:00100000:2.0:1788530049.281353:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788530049.281363:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b81daf5b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+10:7453:x1875409555690880:12345-0@lo:501: 00000100:00100000:2.0:1788530049.281672:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b81daf5b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+10:7453:x1875409555690880:12345-0@lo:501: Request processed in 310us (10378us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788530049.281680:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788530049.283674:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a34af055 going to sleep for 11 seconds 00000100:00100000:0.0:1788530049.283717:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000db76e783 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:7453:1875409555690880:0@lo:501: 10000000:01000000:0.0:1788530049.283738:0:7453:0:(mgc_request_server.c:748:mgc_llog_local_copy()) MGC192.168.202.141@tcp: no remote llog for lustre-sptlrpc, check MGS config 00000100:00100000:0.0:1788530049.283811:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001e31744e pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:7453:1875409555691008:0@lo:501: 00000100:00100000:0.0:1788530049.283864:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530049.283897:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d32f805b going to sleep for 11 seconds 00000100:00100000:3.0:1788530049.284460:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555691008 00000100:00100000:3.0:1788530049.284467:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555691008 00000100:00100000:3.0:1788530049.284520:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788530049.284528:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000029c71cd9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+10:7453:x1875409555691008:12345-0@lo:501: 00000100:00100000:3.0:1788530049.284622:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000029c71cd9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+10:7453:x1875409555691008:12345-0@lo:501: Request processed in 95us (758us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788530049.284631:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788530049.286474:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001e31744e pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:7453:1875409555691008:0@lo:501: 10000000:01000000:0.0:1788530049.286531:0:7453:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788530049.286591:0:7453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: 0000000016f931cf/0xb28d70e1257500d6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257500dd expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530049.286602:0:7453:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: 0000000016f931cf/0xb28d70e1257500d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257500dd expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788530049.286613:0:7453:0:(mgc_request.c:206:do_config_log_add()) do adding config log params-ffff9a9f32bea000 10000000:01000000:0.0:1788530049.286619:0:7453:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788530049.286647:0:7453:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.202.141@tcp: setup lustre-MDT0001-osd 00000040:01000000:0.0:1788530049.286742:0:7453:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.141@tcp ctxt 1 is initialized 00000040:01000000:0.0:1788530049.286751:0:7453:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.141@tcp ctxt 0 is initialized 10000000:01000000:0.0:1788530049.286758:0:7453:0:(mgc_request.c:206:do_config_log_add()) do adding config log nodemap-ffff9a9f2c14cc98 10000000:01000000:0.0:1788530049.286762:0:7453:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1788530049.286803:0:7453:0:(mgc_request.c:2194:mgc_process_log()) Process log nodemap-ffff9a9f2c14cc98 from 1 10000000:01000000:0.0:1788530049.286807:0:7453:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788530049.286850:0:7453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: 000000004d377fd1/0xb28d70e1257500e4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530049.286868:0:7453:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: 000000004d377fd1/0xb28d70e1257500e4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530049.286878:0:7453:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: 000000004d377fd1/0xb28d70e1257500e4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530049.286895:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001e31744e pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:7453:1875409555691136:0@lo:101: 00000100:00100000:0.0:1788530049.286951:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530049.286980:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 00000000294f57b9 going to sleep for 11 seconds 00000100:00100000:1.0:1788530049.287226:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555691136 00000100:00100000:1.0:1788530049.287233:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555691136 00000100:00100000:1.0:1788530049.287279:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788530049.287287:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000714428ed pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+10:7453:x1875409555691136:12345-0@lo:101: 00010000:00010000:1.0:1788530049.287299:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530049.287310:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000044a67cb0/0xb28d70e1257500eb lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e1257500e4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530049.287331:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000044a67cb0/0xb28d70e1257500eb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e1257500e4 expref: 11 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530049.287350:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000044a67cb0/0xb28d70e1257500eb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e1257500e4 expref: 11 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530049.287359:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000044a67cb0, rc 0) 00000100:00100000:1.0:1788530049.287414:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000714428ed pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+11:7453:x1875409555691136:12345-0@lo:101: Request processed in 128us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530049.287420:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788530049.287512:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001e31744e pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:7453:1875409555691136:0@lo:101: 00010000:00010000:3.0:1788530049.287526:0:7453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: 000000004d377fd1/0xb28d70e1257500e4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257500eb expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530049.287535:0:7453:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: 000000004d377fd1/0xb28d70e1257500e4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e1257500eb expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788530049.287551:0:7453:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788530049.287583:0:7453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: 000000004d377fd1/0xb28d70e1257500e4 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257500eb expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530049.287590:0:7453:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: 000000004d377fd1/0xb28d70e1257500e4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257500eb expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788530049.287599:0:7453:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-barrier-ffff9a9f32bea000 10000000:01000000:3.0:1788530049.287604:0:7453:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788530049.287628:0:7453:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-barrier-ffff9a9f32bea000 from 1 10000000:01000000:3.0:1788530049.287630:0:7453:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788530049.287648:0:7453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: 0000000083712434/0xb28d70e1257500f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530049.287654:0:7453:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: 0000000083712434/0xb28d70e1257500f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530049.287668:0:7453:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: 0000000083712434/0xb28d70e1257500f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530049.287681:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c4a7a65b pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:7453:1875409555691264:0@lo:101: 00000100:00100000:3.0:1788530049.287708:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530049.287726:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b32653e3 going to sleep for 11 seconds 00000100:00100000:0.0:1788530049.287937:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555691264 00000100:00100000:0.0:1788530049.287942:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555691264 00000100:00100000:0.0:1788530049.287976:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788530049.287983:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eb6b7205 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+11:7453:x1875409555691264:12345-0@lo:101: 00010000:00010000:0.0:1788530049.287991:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530049.287999:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000031f80656/0xb28d70e1257500f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e1257500f2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530049.288013:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000031f80656/0xb28d70e1257500f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e1257500f2 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530049.288020:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000031f80656/0xb28d70e1257500f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e1257500f2 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530049.288027:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000031f80656, rc 0) 00000100:00100000:0.0:1788530049.288102:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eb6b7205 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+12:7453:x1875409555691264:12345-0@lo:101: Request processed in 120us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530049.288120:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788530049.291667:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c4a7a65b pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:7453:1875409555691264:0@lo:101: 00010000:00010000:3.0:1788530049.291717:0:7453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: 0000000083712434/0xb28d70e1257500f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257500f9 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530049.291733:0:7453:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: 0000000083712434/0xb28d70e1257500f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e1257500f9 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788530049.291761:0:7453:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788530049.291998:0:7453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: 0000000083712434/0xb28d70e1257500f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257500f9 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530049.292007:0:7453:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: 0000000083712434/0xb28d70e1257500f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257500f9 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788530049.292016:0:7453:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1788530049.292026:0:7453:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788530049.292085:0:7453:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.202.141@tcp: setup lustre-MDT0001-osd 00000040:01000000:3.0:1788530049.292204:0:7453:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.141@tcp ctxt 1 is initialized 00000040:01000000:3.0:1788530049.292212:0:7453:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.141@tcp ctxt 0 is initialized 10000000:01000000:3.0:1788530049.292221:0:7453:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-mdtir-ffff9a9f32bea000 10000000:01000000:3.0:1788530049.292225:0:7453:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788530049.292243:0:7453:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:3.0:1788530049.292251:0:7453:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1788530049.292283:0:7453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: 0000000072921087/0xb28d70e125750100 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530049.292290:0:7453:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: 0000000072921087/0xb28d70e125750100 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530049.292299:0:7453:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: 0000000072921087/0xb28d70e125750100 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530049.292316:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c4a7a65b pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:7453:1875409555691392:0@lo:101: 00000100:00100000:3.0:1788530049.293995:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530049.294123:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 00000000487cf40b going to sleep for 11 seconds 00000100:00100000:0.0:1788530049.299722:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555691392 00000100:00100000:0.0:1788530049.299786:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555691392 00000100:00100000:1.0:1788530049.300073:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788530049.300083:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008af19e02 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+12:7453:x1875409555691392:12345-0@lo:101: 00010000:00010000:1.0:1788530049.300103:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530049.300132:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000025315d1a/0xb28d70e125750107 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e125750100 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530049.300164:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000025315d1a/0xb28d70e125750107 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e125750100 expref: 13 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530049.300178:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000025315d1a/0xb28d70e125750107 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125750100 expref: 13 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530049.300186:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000025315d1a, rc 0) 00000100:00100000:1.0:1788530049.300319:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008af19e02 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+13:7453:x1875409555691392:12345-0@lo:101: Request processed in 237us (6329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530049.300326:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788530049.303163:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c4a7a65b pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:7453:1875409555691392:0@lo:101: 00010000:00010000:3.0:1788530049.303199:0:7453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: 0000000072921087/0xb28d70e125750100 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125750107 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530049.303211:0:7453:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: 0000000072921087/0xb28d70e125750100 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e125750107 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530049.303338:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c4a7a65b pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:7453:1875409555691520:0@lo:501: 00000100:00100000:3.0:1788530049.304692:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530049.304773:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 00000000487cf40b going to sleep for 11 seconds 00000100:00100000:1.0:1788530049.304980:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555691520 00000100:00100000:1.0:1788530049.304989:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555691520 00000100:00100000:1.0:1788530049.305095:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788530049.305105:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004ee8f0fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+13:7453:x1875409555691520:12345-0@lo:501: 00000100:00100000:1.0:1788530049.305299:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004ee8f0fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+13:7453:x1875409555691520:12345-0@lo:501: Request processed in 195us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530049.305306:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788530049.305395:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c4a7a65b pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:7453:1875409555691520:0@lo:501: 00000100:00100000:3.0:1788530049.305451:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c4a7a65b pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:7453:1875409555691648:0@lo:503: 00000100:00100000:3.0:1788530049.305512:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530049.315364:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 00000000487cf40b going to sleep for 11 seconds 00000100:00100000:0.0:1788530049.315592:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555691648 00000100:00100000:0.0:1788530049.315606:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555691648 00000100:00100000:0.0:1788530049.315787:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788530049.315798:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004c3748b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+13:7453:x1875409555691648:12345-0@lo:503: 00000100:00100000:0.0:1788530049.316010:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004c3748b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+13:7453:x1875409555691648:12345-0@lo:503: Request processed in 213us (10497us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530049.316021:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788530049.317688:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c4a7a65b pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:7453:1875409555691648:0@lo:503: 00000040:00080000:3.0:1788530049.318188:0:7453:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788530049.318282:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c4a7a65b pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:7453:1875409555691776:0@lo:502: 00000100:00100000:3.0:1788530049.318363:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530049.318772:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 00000000487cf40b going to sleep for 11 seconds 00000100:00100000:1.0:1788530049.321601:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555691776 00000100:00100000:1.0:1788530049.321627:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555691776 00000100:00100000:0.0:1788530049.323557:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788530049.323611:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d90cabdf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+13:7453:x1875409555691776:12345-0@lo:502: 00000100:00100000:3.0:1788530049.324071:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c4a7a65b pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:7453:1875409555691776:0@lo:502: 00000040:00080000:3.0:1788530049.324383:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788530049.324420:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:3.0:1788530049.324434:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:3.0:1788530049.324445:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:3.0:1788530049.324457:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:3.0:1788530049.324468:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:3.0:1788530049.324477:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:3.0:1788530049.324487:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:3.0:1788530049.324511:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:3.0:1788530049.324524:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:3.0:1788530049.324535:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:3.0:1788530049.324545:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:3.0:1788530049.324602:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:3.0:1788530049.324617:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:3.0:1788530049.324629:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:3.0:1788530049.324640:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:3.0:1788530049.324655:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:3.0:1788530049.324668:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:3.0:1788530049.324681:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:3.0:1788530049.324695:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:3.0:1788530049.324709:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:3.0:1788530049.324721:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:3.0:1788530049.324732:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:3.0:1788530049.324781:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c4a7a65b pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:7453:1875409555691904:0@lo:502: 00000100:00100000:3.0:1788530049.326976:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530049.327033:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 00000000487cf40b going to sleep for 11 seconds 00000100:00100000:1.0:1788530049.327887:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555691904 00000100:00100000:1.0:1788530049.327899:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555691904 00000100:00100000:1.0:1788530049.327949:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788530049.327957:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f0238c47 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+14:7453:x1875409555691904:12345-0@lo:502: 00000100:00100000:1.0:1788530049.328136:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f0238c47 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+14:7453:x1875409555691904:12345-0@lo:502: Request processed in 179us (1165us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530049.328144:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788530049.328625:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c4a7a65b pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:7453:1875409555691904:0@lo:502: 00000040:00080000:3.0:1788530049.328725:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:3.0:1788530049.328740:0:7453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000100:00100000:0.0:1788530049.329311:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d90cabdf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+13:7453:x1875409555691776:12345-0@lo:502: Request processed in 5715us (10947us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530049.329322:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000020:01000000:2.0:1788530049.329713:0:7465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788530049.329725:0:7465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788530049.329728:0:7465:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1788530049.329732:0:7465:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:2.0:1788530049.329734:0:7465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788530049.329746:0:7465:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (00000000907af8d7) 00000020:00000080:2.0:1788530049.329765:0:7465:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:2.0:1788530049.329770:0:7465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788530049.329883:0:7465:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788530049.329894:0:7465:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb28d70e125750115 00000020:00000080:2.0:1788530049.330291:0:7465:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1788530049.330300:0:7465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788530049.330306:0:7465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788530049.330308:0:7465:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1788530049.330313:0:7465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788530049.330321:0:7465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788530049.330323:0:7465:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:2.0:1788530049.330328:0:7465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788530049.330341:0:7465:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (0000000094e07502) 00000020:00000080:2.0:1788530049.330357:0:7465:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:2.0:1788530049.330364:0:7465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788530049.330367:0:7465:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:2.0:1788530049.330370:0:7465:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:2.0:1788530049.330377:0:7465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788530049.330439:0:7465:0:(tgt_mount.c:167:server_get_mount()) get mount 00000000de32919a from lustre-MDT0001, refs=2 00000020:00000080:2.0:1788530049.330460:0:7465:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (000000000f8c3954) 00000020:00000080:2.0:1788530049.330477:0:7465:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:2.0:1788530049.330551:0:7465:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788530049.330557:0:7465:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb28d70e12575012a 00000020:00000080:2.0:1788530049.330723:0:7465:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:2.0:1788530049.330735:0:7465:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788530049.330743:0:7465:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xb28d70e125750131 00080000:01000000:2.0:1788530049.330754:0:7465:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788530049.330761:0:7465:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb28d70e125750138 00080000:10000000:2.0:1788530049.331323:0:7465:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:2.0:1788530049.331493:0:7465:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:0.0:1788530049.539354:0:7465:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:0.0:1788530049.540732:0:7465:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:0.0:1788530049.547216:0:7465:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:0.0:1788530049.547984:0:7465:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788530049.566922:0:7465:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:2.0:1788530049.566936:0:7465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788530049.566945:0:7465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788530049.566948:0:7465:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:2.0:1788530049.566951:0:7465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788530049.566957:0:7465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788530049.567535:0:7465:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:2.0:1788530049.567542:0:7465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788530049.567547:0:7465:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.141@tcp to nid 0x20000c0a8ca8d (192.168.202.141@tcp) 00000020:00000080:2.0:1788530049.567599:0:7465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788530049.567615:0:7465:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (00000000ecaf6f09) 00000020:00000080:2.0:1788530049.567637:0:7465:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:2.0:1788530049.567641:0:7465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788530049.567727:0:7465:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:2.0:1788530049.567733:0:7465:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788530049.567738:0:7465:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb28d70e125750146 00010000:00080000:2.0:1788530049.567767:0:7465:0:(ldlm_lib.c:102:import_set_conn()) imp 000000000b6f213d@lustre-MDT0000-osp-MDT0001: add connection 192.168.202.141@tcp at head 00010000:00010000:2.0:1788530049.575402:0:7465:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:0.0:1788530049.583008:0:7465:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788530049.583025:0:7465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1788530049.583075:0:7465:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788530049.583119:0:7465:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb28d70e12575014d 00000100:00080000:0.0:1788530049.583144:0:7465:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788530049.583150:0:7465:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 000000000b6f213d using connection 192.168.202.141@tcp/0@lo 00000100:00100000:0.0:1788530049.583194:0:7465:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000001c1635fa x1875409555692032/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788530049.583229:0:7465:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788530049.583326:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a60b3818 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875409555692160:0@lo:400: 00000100:00100000:0.0:1788530049.583414:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:0.0:1788530049.583529:0:7465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788530049.583534:0:7465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788530049.583535:0:7465:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:0.0:1788530049.583538:0:7465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788530049.583542:0:7465:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1788530049.583543:0:7465:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788530049.583545:0:7465:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788530049.583546:0:7465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788530049.583549:0:7465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788530049.583550:0:7465:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788530049.583552:0:7465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788530049.583557:0:7465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788530049.583599:0:7465:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:0.0:1788530049.583604:0:7465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788530049.583636:0:7465:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1788530049.583650:0:7465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788530049.583653:0:7465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788530049.583654:0:7465:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:0.0:1788530049.583657:0:7465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788530049.583660:0:7465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788530049.583661:0:7465:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788530049.583664:0:7465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788530049.583666:0:7465:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788530049.583712:0:7465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788530049.583716:0:7465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788530049.583717:0:7465:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788530049.583720:0:7465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000020:01000000:0.0:1788530049.583792:0:7453:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:0.0:1788530049.583808:0:7453:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1788530049.583823:0:7453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: 0000000072921087/0xb28d70e125750100 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125750107 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530049.583848:0:7453:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: 0000000072921087/0xb28d70e125750100 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125750107 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788530049.583856:0:7453:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-mdtir-ffff9a9f32bea000 from 1 10000000:01000000:0.0:1788530049.583859:0:7453:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788530049.583882:0:7453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: 00000000ee4bff5b/0xb28d70e125750154 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530049.583889:0:7453:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: 00000000ee4bff5b/0xb28d70e125750154 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530049.583900:0:7453:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: 00000000ee4bff5b/0xb28d70e125750154 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530049.583914:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000000f63e7d pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:7453:1875409555692288:0@lo:101: 00000100:00100000:0.0:1788530049.583949:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530049.583969:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f5faa6b5 going to sleep for 11 seconds 00000100:00100000:0.0:1788530049.584098:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555692160 00000100:00100000:0.0:1788530049.584120:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555692160 00000100:00100000:0.0:1788530049.584177:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788530049.584187:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000097d8b442 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875409555692160:12345-0@lo:400: 00000100:00100000:0.0:1788530049.584242:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000097d8b442 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875409555692160:12345-0@lo:400: Request processed in 57us (829us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530049.584249:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788530049.584289:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000a60b3818 x1875409555692160/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530065 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530049.584302:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a60b3818 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875409555692160:0@lo:400: 00000100:00100000:0.0:1788530049.584350:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555692288 00000100:00100000:0.0:1788530049.584354:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555692288 00000100:00100000:0.0:1788530049.584377:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788530049.584384:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000034d0b798 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+13:7453:x1875409555692288:12345-0@lo:101: 00010000:00010000:0.0:1788530049.584393:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530049.584405:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000060ad5f15/0xb28d70e12575015b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e125750154 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530049.584429:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000060ad5f15/0xb28d70e12575015b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e125750154 expref: 14 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530049.584439:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000060ad5f15/0xb28d70e12575015b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125750154 expref: 14 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530049.584448:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000060ad5f15, rc 0) 00000100:00100000:0.0:1788530049.584475:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000034d0b798 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+14:7453:x1875409555692288:12345-0@lo:101: Request processed in 92us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530049.584481:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788530049.584512:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000000f63e7d pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:7453:1875409555692288:0@lo:101: 00010000:00010000:0.0:1788530049.584524:0:7453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: 00000000ee4bff5b/0xb28d70e125750154 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575015b expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530049.584533:0:7453:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: 00000000ee4bff5b/0xb28d70e125750154 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e12575015b expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530049.585083:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000000f63e7d pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:7453:1875409555692416:0@lo:256: 00000100:00100000:0.0:1788530049.585131:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530049.585148:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f5faa6b5 going to sleep for 11 seconds 00000100:00100000:0.0:1788530049.585770:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555692416 00000100:00100000:0.0:1788530049.585775:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555692416 00000100:00100000:0.0:1788530049.585804:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788530049.585811:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f2174038 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+14:7453:x1875409555692416:12345-0@lo:256: 20000000:01000000:0.0:1788530049.585826:0:6517:0:(mgs_nids.c:1159:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788530049.585844:0:6517:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788530049.585847:0:6517:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1788530049.585925:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f2174038 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+14:7453:x1875409555692416:12345-0@lo:256: Request processed in 115us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530049.585932:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788530049.585971:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000000f63e7d pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:7453:1875409555692416:0@lo:256: 00000100:00100000:2.0:1788530049.587197:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001c1635fa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875409555692032:0@lo:38: 00000100:00100000:2.0:1788530049.587269:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530049.587347:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555692032 00000100:00100000:2.0:1788530049.587353:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555692032 00000100:00100000:2.0:1788530049.587380:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788530049.587389:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c3370756 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1875409555692032:12345-0@lo:38: 00010000:00080000:2.0:1788530049.587415:0:6528:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 257 last 0 00000020:00000080:2.0:1788530049.587469:0:6528:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb28d70e125750162 00000004:00100000:2.0:1788530049.587487:0:6528:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1788530049.587494:0:6528:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:2.0:1788530049.594680:0:6528:0:(import.c:65:import_set_state_nolock()) 00000000e9150443 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788530049.594792:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c3370756 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1875409555692032:12345-0@lo:38: Request processed in 7400us (7521us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530049.594871:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788530049.594971:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788530049.594980:0:3646:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1788530049.594988:0:3646:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1788530049.594992:0:3646:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788530049.594995:0:3646:0:(import.c:65:import_set_state_nolock()) 000000000b6f213d lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788530049.595012:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001c1635fa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875409555692032:0@lo:38: 00000100:00100000:3.0:1788530049.595356:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788530049.595378:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000b9050bc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555692544:0@lo:41: 00000100:00100000:3.0:1788530049.595428:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530049.595659:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555692544 00000100:00100000:2.0:1788530049.595666:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555692544 00000100:00100000:2.0:1788530049.595708:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788530049.595724:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c4a7a65b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3647:x1875409555692544:12345-0@lo:41: 00000004:00000024:2.0:1788530049.595750:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:2.0:1788530049.595784:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c4a7a65b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3647:x1875409555692544:12345-0@lo:41: Request processed in 61us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530049.595790:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788530049.595892:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000b9050bc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555692544:0@lo:41: 10000000:01000000:0.0:1788530049.597136:0:7453:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788530049.597161:0:7453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: 00000000ee4bff5b/0xb28d70e125750154 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575015b expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530049.597174:0:7453:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: 00000000ee4bff5b/0xb28d70e125750154 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575015b expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788530049.598950:0:7453:0:(mgc_request.c:2194:mgc_process_log()) Process log params-ffff9a9f32bea000 from 1 10000000:01000000:2.0:1788530049.598960:0:7453:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788530049.599004:0:7453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: 000000001e814926/0xb28d70e125750169 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530049.599015:0:7453:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: 000000001e814926/0xb28d70e125750169 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530049.599025:0:7453:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: 000000001e814926/0xb28d70e125750169 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530049.599050:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000021afeb92 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:7453:1875409555692672:0@lo:101: 00000100:00100000:2.0:1788530049.599137:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530049.599224:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 00000000293bbf0a going to sleep for 11 seconds 00000100:00100000:0.0:1788530049.601636:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555692672 00000100:00100000:0.0:1788530049.601650:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555692672 00000100:00100000:0.0:1788530049.601767:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788530049.601777:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000084cb56d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+14:7453:x1875409555692672:12345-0@lo:101: 00010000:00010000:0.0:1788530049.601794:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530049.601823:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002b27748d/0xb28d70e125750170 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e125750169 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530049.601849:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002b27748d/0xb28d70e125750170 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e125750169 expref: 15 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530049.601877:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002b27748d/0xb28d70e125750170 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125750169 expref: 15 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530049.601887:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002b27748d, rc 0) 00000100:00100000:0.0:1788530049.601971:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000084cb56d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+15:7453:x1875409555692672:12345-0@lo:101: Request processed in 196us (2835us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530049.601978:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788530049.602088:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000021afeb92 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:7453:1875409555692672:0@lo:101: 00010000:00010000:3.0:1788530049.602120:0:7453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: 000000001e814926/0xb28d70e125750169 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125750170 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530049.602129:0:7453:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: 000000001e814926/0xb28d70e125750169 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e125750170 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530049.602219:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001766d097 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:7453:1875409555692800:0@lo:501: 00000100:00100000:3.0:1788530049.602249:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530049.611780:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 00000000487cf40b going to sleep for 11 seconds 00000100:00100000:2.0:1788530049.611932:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555692800 00000100:00100000:2.0:1788530049.611943:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555692800 00000100:00100000:2.0:1788530049.612004:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788530049.612015:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001e9e4066 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+15:7453:x1875409555692800:12345-0@lo:501: 00000100:00100000:2.0:1788530049.612191:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001e9e4066 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+15:7453:x1875409555692800:12345-0@lo:501: Request processed in 178us (9940us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530049.612199:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788530049.613652:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001766d097 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:7453:1875409555692800:0@lo:501: 00000100:00100000:3.0:1788530049.613709:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001766d097 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:7453:1875409555692928:0@lo:503: 00000100:00100000:3.0:1788530049.613782:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530049.613884:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 00000000487cf40b going to sleep for 11 seconds 00000100:00100000:0.0:1788530049.613952:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555692928 00000100:00100000:0.0:1788530049.613960:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555692928 00000100:00100000:0.0:1788530049.614005:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788530049.614012:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001cc18c5d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+15:7453:x1875409555692928:12345-0@lo:503: 00000040:00080000:0.0:1788530049.614056:0:6517:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788530049.614156:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001cc18c5d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+15:7453:x1875409555692928:12345-0@lo:503: Request processed in 144us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530049.614164:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788530049.618985:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001766d097 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:7453:1875409555692928:0@lo:503: 00000040:00080000:3.0:1788530049.621456:0:7453:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788530049.621690:0:7453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:3.0:1788530049.622482:0:7453:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788530049.628951:0:7470:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:3.0:1788530049.631619:0:7453:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1788530049.631644:0:7453:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788530049.631697:0:7453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: 000000001e814926/0xb28d70e125750169 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125750170 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530049.631711:0:7453:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: 000000001e814926/0xb28d70e125750169 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125750170 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788530049.631913:0:7453:0:(mgc_request.c:2342:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788530049.631917:0:7453:0:(mgc_request.c:424:config_log_add()) add config log lustre-client-ffff9a9f32bea000 10000000:01000000:2.0:1788530049.631920:0:7453:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-client-ffff9a9f32bea000 10000000:01000000:2.0:1788530049.631939:0:7453:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788530049.631971:0:7453:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.202.141@tcp: setup lustre-MDT0001-osd 00000040:01000000:2.0:1788530049.632065:0:7453:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.141@tcp ctxt 1 is initialized 00000040:01000000:2.0:1788530049.632073:0:7453:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.141@tcp ctxt 0 is initialized 10000000:01000000:2.0:1788530049.632085:0:7453:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-client-ffff9a9f32bea000 from 1 10000000:01000000:2.0:1788530049.632088:0:7453:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788530049.632136:0:7453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: 00000000cdfff409/0xb28d70e125750177 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530049.632145:0:7453:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: 00000000cdfff409/0xb28d70e125750177 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530049.632156:0:7453:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: 00000000cdfff409/0xb28d70e125750177 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530049.632183:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000868d1008 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:7453:1875409555693056:0@lo:101: 00000100:00100000:2.0:1788530049.632264:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530049.632298:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 0000000084bfef82 going to sleep for 11 seconds 00000100:00100000:0.0:1788530049.632384:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555693056 00000100:00100000:0.0:1788530049.632393:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555693056 00000100:00100000:0.0:1788530049.632439:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788530049.632447:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000c404470 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+15:7453:x1875409555693056:12345-0@lo:101: 00010000:00010000:0.0:1788530049.632460:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530049.632471:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f72ad797/0xb28d70e12575017e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e125750177 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530049.632504:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f72ad797/0xb28d70e12575017e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e125750177 expref: 16 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530049.632513:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f72ad797/0xb28d70e12575017e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125750177 expref: 16 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530049.632530:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f72ad797, rc 0) 00000100:00100000:0.0:1788530049.632598:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000c404470 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+16:7453:x1875409555693056:12345-0@lo:101: Request processed in 151us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530049.632604:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788530049.634852:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000868d1008 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:7453:1875409555693056:0@lo:101: 00010000:00010000:3.0:1788530049.635131:0:7453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: 00000000cdfff409/0xb28d70e125750177 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575017e expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530049.635152:0:7453:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: 00000000cdfff409/0xb28d70e125750177 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e12575017e expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530049.635300:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001766d097 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:7453:1875409555693184:0@lo:501: 00000100:00100000:3.0:1788530049.635406:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530049.635463:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 00000000487cf40b going to sleep for 11 seconds 00000100:00100000:0.0:1788530049.636385:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555693184 00000100:00100000:0.0:1788530049.636397:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555693184 00000100:00100000:0.0:1788530049.636465:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788530049.636473:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f79dc81d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+16:7453:x1875409555693184:12345-0@lo:501: 00000100:00100000:0.0:1788530049.636667:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f79dc81d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+16:7453:x1875409555693184:12345-0@lo:501: Request processed in 194us (1263us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530049.636675:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788530049.637003:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001766d097 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:7453:1875409555693184:0@lo:501: 00000100:00100000:3.0:1788530049.637250:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001766d097 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:7453:1875409555693312:0@lo:503: 00000100:00100000:3.0:1788530049.637310:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530049.637351:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 00000000487cf40b going to sleep for 11 seconds 00000100:00100000:0.0:1788530049.640524:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555693312 00000100:00100000:0.0:1788530049.640541:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555693312 00000100:00100000:0.0:1788530049.640639:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788530049.640649:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d0deb31d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+16:7453:x1875409555693312:12345-0@lo:503: 00000100:00100000:0.0:1788530049.640856:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d0deb31d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+16:7453:x1875409555693312:12345-0@lo:503: Request processed in 208us (3545us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530049.640866:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788530049.641043:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001766d097 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:7453:1875409555693312:0@lo:503: 00000040:00080000:3.0:1788530049.641442:0:7453:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788530049.641557:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001766d097 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:7453:1875409555693440:0@lo:502: 00000100:00100000:3.0:1788530049.641649:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530049.641687:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 00000000487cf40b going to sleep for 11 seconds 00000100:00100000:0.0:1788530049.641811:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555693440 00000100:00100000:0.0:1788530049.641818:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555693440 00000100:00100000:0.0:1788530049.641857:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788530049.641864:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000075abe6b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+16:7453:x1875409555693440:12345-0@lo:502: 00000100:00100000:0.0:1788530049.641948:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000075abe6b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+16:7453:x1875409555693440:12345-0@lo:502: Request processed in 85us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530049.641955:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788530049.642090:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001766d097 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:7453:1875409555693440:0@lo:502: 00000040:00080000:3.0:1788530049.642988:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1788530049.643027:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1788530049.643042:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1788530049.643055:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1788530049.643067:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1788530049.643080:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1788530049.643092:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1788530049.643115:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1788530049.643131:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1788530049.643144:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1788530049.643156:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1788530049.643169:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1788530049.643180:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1788530049.643190:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1788530049.643200:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1788530049.643227:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1788530049.643241:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1788530049.643253:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1788530049.644819:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1788530049.644867:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1788530049.644883:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1788530049.644898:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1788530049.644911:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1788530049.644923:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1788530049.644937:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1788530049.644950:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1788530049.644963:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1788530049.644975:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:3.0:1788530049.645031:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001766d097 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:7453:1875409555693568:0@lo:502: 00000100:00100000:3.0:1788530049.645148:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530049.645206:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 00000000487cf40b going to sleep for 11 seconds 00000100:00100000:0.0:1788530049.645333:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555693568 00000100:00100000:0.0:1788530049.645348:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555693568 00000100:00100000:0.0:1788530049.645411:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788530049.645420:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b6e1408c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+16:7453:x1875409555693568:12345-0@lo:502: 00000100:00100000:0.0:1788530049.647714:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b6e1408c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+16:7453:x1875409555693568:12345-0@lo:502: Request processed in 2287us (2558us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530049.647732:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788530049.649853:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001766d097 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:7453:1875409555693568:0@lo:502: 00000040:00080000:2.0:1788530049.653866:0:7453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:2.0:1788530049.653893:0:7453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1788530049.656871:0:7471:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1788530049.656890:0:7471:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (000000001aff1fcb) 00000020:00000080:3.0:1788530049.656915:0:7471:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1788530049.656998:0:7471:0:(tgt_mount.c:167:server_get_mount()) get mount 00000000de32919a from lustre-MDT0001, refs=3 00000020:01000004:3.0:1788530049.657002:0:7471:0:(tgt_mount.c:201:server_put_mount()) put mount 00000000de32919a from lustre-MDT0001, refs=3 00000020:01000004:3.0:1788530049.657005:0:7471:0:(obd_mount.c:712:lustre_put_lsi()) put 00000000de32919a 3 00010000:00080000:3.0:1788530049.657040:0:7471:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000a053c437@lustre-MDT0000-lwp-MDT0001: add connection 192.168.202.141@tcp at head 00010000:00010000:3.0:1788530049.662173:0:7471:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:3.0:1788530049.662439:0:7471:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1788530049.662493:0:7471:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788530049.662509:0:7471:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xb28d70e12575018c 00000100:00080000:3.0:1788530049.662520:0:7471:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788530049.662526:0:7471:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 00000000a053c437 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:3.0:1788530049.662590:0:7471:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000587ab7b6 x1875409555693696/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788530049.662614:0:7471:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788530049.662816:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000587ab7b6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875409555693696:0@lo:38: 00000100:00100000:1.0:1788530049.662889:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530049.666925:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555693696 00000100:00100000:3.0:1788530049.666939:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555693696 00000100:00100000:3.0:1788530049.666989:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788530049.666996:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003d082350 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1875409555693696:12345-0@lo:38: 00010000:00080000:3.0:1788530049.667025:0:6523:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 257 last 0 00000020:00000080:3.0:1788530049.667087:0:6523:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xb28d70e125750193 00000004:00100000:3.0:1788530049.667119:0:6523:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788530049.667151:0:6523:0:(import.c:65:import_set_state_nolock()) 00000000ea276abb : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788530049.667246:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003d082350 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875409555693696:12345-0@lo:38: Request processed in 249us (4357us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530049.667253:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788530049.667316:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000587ab7b6 x1875409555693696/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788530059 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530049.667327:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788530049.667336:0:3646:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1788530049.667342:0:3646:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788530049.667346:0:3646:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788530049.667349:0:3646:0:(import.c:65:import_set_state_nolock()) 00000000a053c437 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788530049.667353:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000587ab7b6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875409555693696:0@lo:38: 00000040:00080000:3.0:1788530049.667476:0:7471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 40000000:00080000:2.0:1788530049.667961:0:7472:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000020:01000000:2.0:1788530049.670609:0:7453:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1788530049.670633:0:7453:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788530049.670659:0:7453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: 00000000cdfff409/0xb28d70e125750177 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575017e expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530049.670672:0:7453:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: 00000000cdfff409/0xb28d70e125750177 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575017e expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788530049.670749:0:7453:0:(tgt_mount.c:1239:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788530049.670755:0:7453:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788530049.670756:0:7453:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788530049.670757:0:7453:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:2.0:1788530049.670758:0:7453:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:2.0:1788530049.670760:0:7453:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:2.0:1788530049.670761:0:7453:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788530049.670762:0:7453:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788530049.670763:0:7453:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788530049.670765:0:7453:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788530049.670766:0:7453:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788530049.670770:0:7453:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:2.0:1788530049.670773:0:7453:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788530049.670774:0:7453:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788530049.670774:0:7453:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788530049.670775:0:7453:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:2.0:1788530049.670776:0:7453:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:2.0:1788530049.670777:0:7453:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:2.0:1788530049.670777:0:7453:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788530049.670778:0:7453:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788530049.670779:0:7453:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788530049.670780:0:7453:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788530049.670780:0:7453:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788530049.670810:0:7453:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1788530049.670831:0:7453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bc11a2d2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:7453:1875409555693824:0@lo:253: 00000100:00100000:2.0:1788530049.670906:0:7453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530049.670949:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555693824 00000100:00100000:2.0:1788530049.670957:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555693824 00000100:00100000:2.0:1788530049.671001:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788530049.671009:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004408f8ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+16:7453:x1875409555693824:12345-0@lo:253: 20000000:01000000:2.0:1788530049.671039:0:6517:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788530049.671052:0:6517:0:(mgs_nids.c:468:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1788530049.671199:0:7453:0:(client.c:2716:ptlrpc_set_wait()) set 000000002d7a74df going to sleep for 11 seconds 00000001:00100000:3.0:1788530049.673999:0:6502:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:2.0:1788530049.674097:0:6517:0:(mgs_nids.c:833:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788530049.674117:0:6517:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:0.0:1788530049.674254:0:6539:0:(mgs_nids.c:730:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788530049.674260:0:6539:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788530049.674288:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000000c623771/0xb28d70e12575019a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530049.674318:0:6539:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000007056ff89/0xb28d70e1257500ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e1257500b3 expref: 16 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530049.674325:0:6539:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000060ad5f15/0xb28d70e12575015b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125750154 expref: 16 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530049.674331:0:6539:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000000c623771/0xb28d70e12575019a lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530049.674374:0:6539:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000060ad5f15/0xb28d70e12575015b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb28d70e125750154 expref: 16 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530049.674388:0:6539:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000060ad5f15/0xb28d70e12575015b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb28d70e125750154 expref: 16 pid: 6518 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530049.674401:0:6539:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000000f63e7d pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6539:1875409555693952:0@lo:104: 00000100:00100000:0.0:1788530049.674468:0:6539:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788530049.674532:0:6539:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000007056ff89/0xb28d70e1257500ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb28d70e1257500b3 expref: 16 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530049.674550:0:6539:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000007056ff89/0xb28d70e1257500ba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb28d70e1257500b3 expref: 16 pid: 6518 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530049.674582:0:6539:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000094d301de pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6539:1875409555694080:0@lo:104: 00000100:00100000:0.0:1788530049.674605:0:6539:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530049.674623:0:6539:0:(client.c:2716:ptlrpc_set_wait()) set 000000003492e50f going to sleep for 11 seconds 00000100:00100000:3.0:1788530049.674747:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555693952 00000100:00100000:3.0:1788530049.674754:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555693952 00000100:00100000:3.0:1788530049.674785:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555694080 00000100:00100000:3.0:1788530049.674787:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555694080 00000100:00100000:3.0:1788530049.674799:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788530049.674806:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a60b3818 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+4:6539:x1875409555693952:12345-0@lo:104: 00010000:00010000:3.0:1788530049.674818:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: 00000000ee4bff5b/0xb28d70e125750154 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e12575015b expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530049.674876:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788530049.674880:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a60b3818 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+4:6539:x1875409555693952:12345-0@lo:104: Request processed in 76us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530049.674887:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788530049.674903:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788530049.674909:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c0b51d0e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+3:6539:x1875409555694080:12345-0@lo:104: 00010000:00010000:3.0:1788530049.674915:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: 0000000088441a49/0xb28d70e1257500b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e1257500ba expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530049.674956:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788530049.674960:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c0b51d0e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+3:6539:x1875409555694080:12345-0@lo:104: Request processed in 52us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530049.674966:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1788530049.674983:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788530049.674988:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: 00000000ee4bff5b/0xb28d70e125750154 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e12575015b expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530049.674994:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ee4bff5b already unused, calling callback (00000000f0300a12) 10000000:00010000:3.0:1788530049.674997:0:6512:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: 00000000ee4bff5b/0xb28d70e125750154 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb28d70e12575015b expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530049.675004:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: 00000000ee4bff5b/0xb28d70e125750154 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb28d70e12575015b expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788530049.675010:0:6512:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: 00000000ee4bff5b/0xb28d70e125750154 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb28d70e12575015b expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788530049.675015:0:6512:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788530049.675041:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: 00000000ee4bff5b/0xb28d70e125750154 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e12575015b expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530049.675048:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788530049.675066:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: 00000000ee4bff5b/0xb28d70e125750154 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e12575015b expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530049.675072:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: 00000000ee4bff5b/0xb28d70e125750154 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e12575015b expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530049.675095:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788530049.675098:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: 0000000088441a49/0xb28d70e1257500b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e1257500ba expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530049.675114:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000088441a49 already unused, calling callback (00000000f0300a12) 10000000:00010000:3.0:1788530049.675116:0:6512:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: 0000000088441a49/0xb28d70e1257500b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb28d70e1257500ba expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530049.675121:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: 0000000088441a49/0xb28d70e1257500b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb28d70e1257500ba expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788530049.675126:0:6512:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: 0000000088441a49/0xb28d70e1257500b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb28d70e1257500ba expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788530049.675131:0:6512:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788530049.675145:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: 0000000088441a49/0xb28d70e1257500b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e1257500ba expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530049.675151:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788530049.675156:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: 0000000088441a49/0xb28d70e1257500b3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e1257500ba expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530049.675161:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: 0000000088441a49/0xb28d70e1257500b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e1257500ba expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530049.675174:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530049.675175:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530049.675177:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530049.675183:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788530049.675200:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000587ab7b6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3649:1875409555694208:0@lo:103: 00000100:00100000:3.0:1788530049.675227:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530049.675247:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788530049.675252:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000afb23b73 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3649:1875409555694336:0@lo:103: 00000100:00100000:3.0:1788530049.675269:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530049.675299:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555694208 00000100:00100000:3.0:1788530049.675303:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555694208 00010000:00010000:3.0:1788530049.675318:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000060ad5f15/0xb28d70e12575015b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e125750154 expref: 17 pid: 6518 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530049.675338:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555694336 00000100:00100000:3.0:1788530049.675341:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555694336 00010000:00010000:3.0:1788530049.675350:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000007056ff89/0xb28d70e1257500ba lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e1257500b3 expref: 18 pid: 6518 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530049.675362:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788530049.675367:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000042a67f95 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+18:3649:x1875409555694208:12345-0@lo:103: 00010000:00010000:3.0:1788530049.675375:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788530049.675378:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000060ad5f15/0xb28d70e12575015b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e125750154 expref: 18 pid: 6518 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530049.675386:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000060ad5f15/0xb28d70e12575015b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb28d70e125750154 expref: 18 pid: 6518 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530049.675401:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788530049.675425:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000042a67f95 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+18:3649:x1875409555694208:12345-0@lo:103: Request processed in 58us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530049.675430:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788530049.675442:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788530049.675448:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000068e68ac6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+17:3649:x1875409555694336:12345-0@lo:103: 00010000:00010000:3.0:1788530049.675459:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788530049.675463:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000007056ff89/0xb28d70e1257500ba lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e1257500b3 expref: 17 pid: 6518 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530049.675470:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000007056ff89/0xb28d70e1257500ba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb28d70e1257500b3 expref: 17 pid: 6518 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530049.675479:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000000c623771/0xb28d70e12575019a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530049.675486:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000c623771/0xb28d70e12575019a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530049.676074:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004408f8ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+17:7453:x1875409555693824:12345-0@lo:253: Request processed in 5064us (5167us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530049.676092:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788530049.676157:0:7453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bc11a2d2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:7453:1875409555693824:0@lo:253: 10000000:01000000:2.0:1788530049.676168:0:7453:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1788530049.676171:0:7453:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788530049.676172:0:7453:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788530049.676173:0:7453:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788530049.676174:0:7453:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:2.0:1788530049.676176:0:7453:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:2.0:1788530049.676177:0:7453:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:2.0:1788530049.676178:0:7453:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788530049.676180:0:7453:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788530049.676181:0:7453:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788530049.676182:0:7453:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788530049.676183:0:7453:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788530049.676195:0:7453:0:(tgt_mount.c:2823:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1788530049.676614:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000060ad5f15/0xb28d70e12575015b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb28d70e125750154 expref: 16 pid: 6518 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530049.676627:0:6539:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000000f63e7d pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6539:1875409555693952:0@lo:104: 00010000:00010000:0.0:1788530049.676638:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000007056ff89/0xb28d70e1257500ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb28d70e1257500b3 expref: 15 pid: 6518 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530049.676645:0:6539:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000094d301de pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6539:1875409555694080:0@lo:104: 00010000:00010000:0.0:1788530049.684440:0:6539:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000000c623771/0xb28d70e12575019a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:2.0:1788530049.686750:0:7453:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:2.0:1788530049.686925:0:7453:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1788530049.687137:0:7453:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1788530049.687309:0:7453:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 20000000:01000000:3.0:1788530049.692509:0:6510:0:(mgs_nids.c:706:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.018248997s 00010000:00010000:3.0:1788530049.692525:0:6510:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000000c623771/0xb28d70e12575019a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530049.692537:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000000c623771/0xb28d70e12575019a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530049.692544:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000000c623771/0xb28d70e12575019a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530049.692552:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000000c623771/0xb28d70e12575019a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530049.692579:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000c623771 already unused, calling callback (0000000096f15eee) 00010000:00010000:3.0:1788530049.692584:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000000c623771/0xb28d70e12575019a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530049.692593:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000000c623771/0xb28d70e12575019a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530049.692643:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000000c623771/0xb28d70e12575019a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530049.692660:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788530049.692768:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000068e68ac6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+14:3649:x1875409555694336:12345-0@lo:103: Request processed in 17316us (17493us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530049.692778:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788530049.692862:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000afb23b73 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3649:1875409555694336:0@lo:103: 00000100:00100000:3.0:1788530049.692875:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000587ab7b6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3649:1875409555694208:0@lo:103: 00010000:00010000:1.0:1788530049.692983:0:6539:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000000c623771/0xb28d70e12575019a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530049.692994:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000000c623771/0xb28d70e12575019a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530049.693008:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000c623771/0xb28d70e12575019a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:2.0:1788530049.693833:0:7453:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1788530049.694139:0:7453:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:2.0:1788530049.694957:0:7453:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1788530049.695199:0:7453:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:2.0:1788530049.695676:0:7453:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:2.0:1788530049.695854:0:7453:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:2.0:1788530049.696045:0:7453:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:2.0:1788530049.696252:0:7453:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:2.0:1788530049.703721:0:7453:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:2.0:1788530049.705970:0:7477:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:2.0:1788530049.706036:0:7477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bc11a2d2 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7477:1875409555694464:0@lo:700: 00000100:00100000:2.0:1788530049.706134:0:7477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530049.706209:0:7477:0:(client.c:2716:ptlrpc_set_wait()) set 000000002007efb5 going to sleep for 11 seconds 00000100:00100000:1.0:1788530049.706261:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555694464 00000100:00100000:1.0:1788530049.706269:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555694464 00000100:00100000:1.0:1788530049.706324:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788530049.706332:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000af16e017 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7477:x1875409555694464:12345-0@lo:700: 00000040:01000000:0.0:1788530049.706650:0:7453:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:0.0:1788530049.707001:0:7478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000094d301de pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7478:1875409555694592:0@lo:1000: 00000100:00100000:0.0:1788530049.707040:0:7478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530049.707066:0:7478:0:(client.c:2716:ptlrpc_set_wait()) set 0000000082d766ca going to sleep for 11 seconds 00000040:01000000:1.0:1788530049.707454:0:7453:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:1.0:1788530049.707670:0:7453:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788530049.708096:0:7453:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788530049.708116:0:7453:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:1.0:1788530049.708226:0:7453:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788530049.709648:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555694592 00000100:00100000:2.0:1788530049.709661:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555694592 00000100:00100000:2.0:1788530049.709715:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788530049.709723:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000000f63e7d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7478:x1875409555694592:12345-0@lo:1000: 00000100:00100000:2.0:1788530049.709845:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000000f63e7d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7478:x1875409555694592:12345-0@lo:1000: Request processed in 123us (2805us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530049.709853:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788530049.710590:0:7478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000094d301de pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7478:1875409555694592:0@lo:1000: 00000040:01000000:0.0:1788530049.710630:0:7478:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:0.0:1788530049.710670:0:7478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000094d301de pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7478:1875409555694720:0@lo:700: 00000100:00100000:0.0:1788530049.710718:0:7478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530049.710754:0:7478:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ba3b6b27 going to sleep for 11 seconds 00000020:00080000:3.0:1788530049.710901:0:7476:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:3.0:1788530049.710906:0:7476:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000100:00100000:3.0:1788530049.710924:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555694720 00000100:00100000:3.0:1788530049.710928:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555694720 00000100:00100000:3.0:1788530049.710968:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788530049.710975:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000039e05434 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7478:x1875409555694720:12345-0@lo:700: 00000100:00100000:3.0:1788530049.711023:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000039e05434 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7478:x1875409555694720:12345-0@lo:700: Request processed in 49us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530049.711029:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:00080000:1.0:1788530049.713425:0:7453:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:0.0:1788530049.713677:0:7478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000094d301de pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7478:1875409555694720:0@lo:700: 00000100:00100000:0.0:1788530049.713756:0:7478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000094d301de pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7478:1875409555694848:0@lo:900: 00000100:00100000:0.0:1788530049.713812:0:7478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530049.713844:0:7478:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ba3b6b27 going to sleep for 11 seconds 00000100:00100000:3.0:1788530049.714022:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555694848 00000100:00100000:3.0:1788530049.714029:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555694848 00000100:00100000:3.0:1788530049.714076:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788530049.714085:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000061c3688e pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7478:x1875409555694848:12345-0@lo:900: 00000100:00100000:3.0:1788530049.714144:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000061c3688e pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7478:x1875409555694848:12345-0@lo:900: Request processed in 60us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530049.714152:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788530049.714395:0:7478:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000094d301de x1875409555694848/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788530065 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530049.714407:0:7478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000094d301de pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7478:1875409555694848:0@lo:900: 00000100:00100000:0.0:1788530049.714480:0:7478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000094d301de pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7478:1875409555694976:0@lo:1000: 00000100:00100000:0.0:1788530049.714522:0:7478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530049.714551:0:7478:0:(client.c:2716:ptlrpc_set_wait()) set 000000005a21921e going to sleep for 11 seconds 00000040:00080000:1.0:1788530049.715151:0:7453:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788530049.715193:0:7453:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:1.0:1788530049.715401:0:7453:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1788530049.715657:0:7453:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000100:00100000:2.0:1788530049.719355:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555694976 00000100:00100000:2.0:1788530049.719375:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555694976 00000100:00100000:2.0:1788530049.719446:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788530049.719456:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001c1635fa pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7478:x1875409555694976:12345-0@lo:1000: 00000100:00100000:2.0:1788530049.719655:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001c1635fa pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7478:x1875409555694976:12345-0@lo:1000: Request processed in 200us (5132us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530049.719664:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788530049.720001:0:7478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000094d301de pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7478:1875409555694976:0@lo:1000: 00000004:00080000:0.0:1788530049.720078:0:7478:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000ba3b6b27 with version 0 00000020:00100000:0.0:1788530049.720114:0:7478:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788530049.720122:0:7478:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000094d301de x1875409555695232/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788530049.720143:0:7478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000094d301de pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7478:1875409555695232:0@lo:1000: 00000100:00100000:0.0:1788530049.720185:0:7478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530049.720228:0:7478:0:(client.c:2716:ptlrpc_set_wait()) set 0000000086ca533b going to sleep for 11 seconds 00000100:00100000:2.0:1788530049.720282:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555695232 00000100:00100000:2.0:1788530049.720287:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555695232 00000100:00100000:2.0:1788530049.720309:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788530049.720315:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001e31744e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7478:x1875409555695232:12345-0@lo:1000: 00100000:10000000:1.0:1788530049.721092:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1788530049.721251:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1788530049.721454:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1788530049.721700:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1788530049.721851:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1788530049.722054:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1788530049.722198:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1788530049.722342:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1788530049.722909:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1788530049.723058:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1788530049.723214:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1788530049.723343:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1788530049.723689:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1788530049.723814:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1788530049.723949:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1788530049.724081:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1788530049.728787:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1788530049.729062:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1788530049.729216:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1788530049.729347:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1788530049.729625:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1788530049.729778:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1788530049.729912:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1788530049.730065:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1788530049.730221:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1788530049.730356:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1788530049.730795:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1788530049.730943:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1788530049.731079:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1788530049.731237:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 40000000:02000000:2.0:1788530049.739580:0:6530:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00000001:00080000:3.0:1788530049.746076:0:6502:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000100:00100000:3.0:1788530049.746256:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001e31744e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7478:x1875409555695232:12345-0@lo:1000: Request processed in 25937us (26067us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788530049.746276:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788530049.748253:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000af16e017 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7477:x1875409555694464:12345-0@lo:700: Request processed in 41913us (42111us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530049.748273:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00100000:10000000:1.0:1788530049.748601:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1788530049.749151:0:7453:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1788530049.749342:0:7453:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000004:00080000:1.0:1788530049.750638:0:7478:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:1.0:1788530049.750647:0:7478:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1788530049.750681:0:7478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000094d301de pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7478:1875409555695232:0@lo:1000: 00000100:00100000:1.0:1788530049.750775:0:7478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005f9a9d6e pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7478:1875409555695360:0@lo:1000: 00000100:00100000:1.0:1788530049.750837:0:7478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530049.750879:0:7478:0:(client.c:2716:ptlrpc_set_wait()) set 00000000487ccda8 going to sleep for 11 seconds 00010000:00080000:3.0:1788530049.750999:0:7477:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000bc11a2d2 x1875409555694464/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788530065 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530049.751013:0:7477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bc11a2d2 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7477:1875409555694464:0@lo:700: 40000000:02000000:3.0:1788530049.751021:0:7477:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00000100:00100000:1.0:1788530049.755576:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555695360 00000100:00100000:1.0:1788530049.755597:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555695360 00000100:00100000:1.0:1788530049.755680:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788530049.755689:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ad2b24f2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7478:x1875409555695360:12345-0@lo:1000: 00000100:00100000:1.0:1788530049.755879:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ad2b24f2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7478:x1875409555695360:12345-0@lo:1000: Request processed in 191us (5042us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530049.755887:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788530049.755940:0:7478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005f9a9d6e pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7478:1875409555695360:0@lo:1000: 00000040:00080000:1.0:1788530049.755975:0:7478:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:1.0:1788530049.756021:0:7478:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 0000000092b3787c with version 1 00000004:00080000:1.0:1788530049.756041:0:7468:0:(osp_trans.c:1336:osp_get_next_request()) ou 000000006a91b8d4 version 1 rpc_version 1 00000020:00100000:1.0:1788530049.756073:0:7468:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1788530049.756084:0:7468:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000005f9a9d6e x1875409555695616/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788530049.756123:0:7468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005f9a9d6e pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7468:1875409555695616:0@lo:1000: 00000100:00100000:1.0:1788530049.756163:0:7468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530049.756195:0:7468:0:(client.c:2716:ptlrpc_set_wait()) set 000000009507c0d4 going to sleep for 11 seconds 00000100:00100000:1.0:1788530049.756206:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555695616 00000100:00100000:1.0:1788530049.756210:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555695616 00000100:00100000:1.0:1788530049.756228:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788530049.756233:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a5884748 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7468:x1875409555695616:12345-0@lo:1000: 00000001:00080000:0.0:1788530049.767939:0:7453:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788530049.767978:0:7453:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb37801dc39b8 00100000:10000000:0.0:1788530049.767986:0:7453:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000001:00080000:2.0:1788530049.769962:0:6502:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:0.0:1788530049.770204:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a5884748 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7468:x1875409555695616:12345-0@lo:1000: Request processed in 13967us (14037us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788530049.770223:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:0.0:1788530049.770715:0:7468:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:0.0:1788530049.770734:0:7468:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1788530049.770752:0:7468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005f9a9d6e pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7468:1875409555695616:0@lo:1000: 00000040:00080000:1.0:1788530049.771461:0:7478:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788530049.771606:0:7478:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000020:01000004:0.0:1788530049.771779:0:7453:0:(tgt_mount.c:2543:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1788530049.771801:0:7453:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:0.0:1788530049.775958:0:7453:0:(tgt_mount.c:2429:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788530049.776168:0:7453:0:(tgt_mount.c:2444:is_cmd_supported()) ioctl cmd=41009432 00000040:00080000:3.0:1788530049.868077:0:7477:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788530049.880059:0:7477:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788530049.880199:0:7477:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788530049.880211:0:7477:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:3.0:1788530050.242778:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530051.265427:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530052.289019:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530053.326770:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530054.338681:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788530054.720802:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dc5bbc02 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875409555695872:0@lo:400: 00000100:00100000:1.0:1788530054.720874:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530054.720938:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788530054.720944:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008615410d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3648:1875409555695744:0@lo:400: 00000100:00100000:1.0:1788530054.720971:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530054.721002:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002a973a82 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555696000:0@lo:400: 00000100:00100000:1.0:1788530054.721027:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530054.721044:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788530054.721048:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d697453b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875409555696128:0@lo:400: 00000100:00100000:1.0:1788530054.721080:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530054.721119:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555695872 00000100:00100000:1.0:1788530054.721126:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555695872 00000100:00100000:1.0:1788530054.721165:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555696128 00000100:00100000:1.0:1788530054.721169:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555696128 00000100:00100000:1.0:1788530054.721184:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788530054.721191:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002035a924 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875409555695872:12345-0@lo:400: 00000100:00100000:1.0:1788530054.721235:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002035a924 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875409555695872:12345-0@lo:400: Request processed in 45us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530054.721242:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788530054.721269:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788530054.721275:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009e2ba420 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875409555696128:12345-0@lo:400: 00000100:00100000:1.0:1788530054.721306:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009e2ba420 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875409555696128:12345-0@lo:400: Request processed in 32us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530054.721311:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788530054.721372:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555695744 00000100:00100000:1.0:1788530054.721378:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555695744 00000100:00100000:1.0:1788530054.721415:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788530054.721427:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000096d7c13e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+14:3648:x1875409555695744:12345-0@lo:400: 00000100:00100000:1.0:1788530054.721468:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000096d7c13e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+14:3648:x1875409555695744:12345-0@lo:400: Request processed in 46us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530054.721474:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:1.0:1788530054.721528:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000d697453b x1875409555696128/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530070 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530054.721542:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d697453b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875409555696128:0@lo:400: 00000100:00100000:1.0:1788530054.721586:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008615410d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3648:1875409555695744:0@lo:400: 00010000:00080000:1.0:1788530054.721594:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000dc5bbc02 x1875409555695872/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530070 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530054.721602:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dc5bbc02 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875409555695872:0@lo:400: 00000100:00100000:2.0:1788530054.721788:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555696000 00000100:00100000:2.0:1788530054.721795:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555696000 00000100:00100000:2.0:1788530054.721873:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788530054.721883:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003c9c4645 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555696000:12345-0@lo:400: 00000100:00100000:2.0:1788530054.721931:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003c9c4645 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555696000:12345-0@lo:400: Request processed in 52us (904us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530054.721937:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788530054.721963:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002a973a82 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555696000:0@lo:400: 00000100:00100000:2.0:1788530054.735177:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788530054.735213:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000accc0b27 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555696256:0@lo:41: 00000100:00100000:2.0:1788530054.735335:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530054.735428:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555696256 00000100:00100000:2.0:1788530054.735438:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555696256 00000100:00100000:2.0:1788530054.735634:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788530054.735643:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006024613b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555696256:12345-0@lo:41: 00000004:00000024:2.0:1788530054.735676:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:2.0:1788530054.735750:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006024613b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555696256:12345-0@lo:41: Request processed in 106us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530054.735761:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788530054.735828:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000accc0b27 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555696256:0@lo:41: 00010000:00010000:2.0:1788530055.365765:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788530056.163420:0:7723:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg241-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 10000000:01000000:1.0:1788530056.263802:0:6521:0:(mgc_request.c:715:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788530056.263816:0:6521:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-mdtir-ffff9a9f32bea000 from 4 10000000:01000000:1.0:1788530056.263825:0:6521:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788530056.265218:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: 000000007056ff89/0xb28d70e1257501a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530056.265242:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: 000000007056ff89/0xb28d70e1257501a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530056.265257:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: 000000007056ff89/0xb28d70e1257501a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530056.265307:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dc5bbc02 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555696384:0@lo:101: 00000100:00100000:1.0:1788530056.265390:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530056.265468:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set 000000002007efb5 going to sleep for 11 seconds 00000100:00100000:2.0:1788530056.266122:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555696384 00000100:00100000:2.0:1788530056.266130:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555696384 00000100:00100000:2.0:1788530056.266184:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788530056.266194:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000054f093d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+14:6521:x1875409555696384:12345-0@lo:101: 00010000:00010000:2.0:1788530056.266208:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530056.266225:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000026527966/0xb28d70e1257501a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e1257501a1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530056.266259:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000026527966/0xb28d70e1257501a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e1257501a1 expref: 15 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530056.266268:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000026527966/0xb28d70e1257501a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e1257501a1 expref: 15 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530056.266277:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000026527966, rc 0) 00000100:00100000:2.0:1788530056.266321:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000054f093d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+15:6521:x1875409555696384:12345-0@lo:101: Request processed in 129us (932us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530056.266330:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788530056.266407:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dc5bbc02 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555696384:0@lo:101: 00010000:00010000:2.0:1788530056.266429:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: 000000007056ff89/0xb28d70e1257501a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257501a8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530056.266440:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: 000000007056ff89/0xb28d70e1257501a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e1257501a8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530056.266499:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000accc0b27 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555696512:0@lo:256: 00000100:00100000:2.0:1788530056.266542:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530056.266589:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set 000000001c94df85 going to sleep for 11 seconds 00000100:00100000:2.0:1788530056.266602:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555696512 00000100:00100000:2.0:1788530056.266606:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555696512 00000100:00100000:2.0:1788530056.266628:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788530056.266634:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fb61a35f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+15:6521:x1875409555696512:12345-0@lo:256: 20000000:01000000:2.0:1788530056.266647:0:6516:0:(mgs_nids.c:1159:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788530056.266665:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788530056.266667:0:6516:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1788530056.266757:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fb61a35f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+15:6521:x1875409555696512:12345-0@lo:256: Request processed in 123us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530056.266764:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788530056.266808:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000accc0b27 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555696512:0@lo:256: 10000000:01000000:2.0:1788530056.270343:0:6521:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788530056.270366:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: 000000007056ff89/0xb28d70e1257501a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257501a8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530056.270382:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: 000000007056ff89/0xb28d70e1257501a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257501a8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788530056.270405:0:6521:0:(mgc_request.c:715:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788530056.270408:0:6521:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-client-ffff9a9f0aaed800 from 21 10000000:01000000:2.0:1788530056.270412:0:6521:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788530056.270491:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: 0000000096a6e85c/0xb28d70e1257501af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530056.270504:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: 0000000096a6e85c/0xb28d70e1257501af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530056.270521:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: 0000000096a6e85c/0xb28d70e1257501af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530056.270599:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000accc0b27 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555696640:0@lo:101: 00000100:00100000:2.0:1788530056.270718:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530056.270794:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set 000000001c94df85 going to sleep for 11 seconds 00000100:00100000:3.0:1788530056.273802:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555696640 00000100:00100000:3.0:1788530056.273829:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555696640 00000100:00100000:3.0:1788530056.273944:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788530056.273962:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000027cea221 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+15:6521:x1875409555696640:12345-0@lo:101: 00010000:00010000:3.0:1788530056.274000:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788530056.274033:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000253a95a9/0xb28d70e1257501b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e1257501af expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530056.274099:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000253a95a9/0xb28d70e1257501b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e1257501af expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530056.274135:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000253a95a9/0xb28d70e1257501b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e1257501af expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530056.274151:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000253a95a9, rc 0) 00000100:00100000:3.0:1788530056.274294:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000027cea221 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+16:6521:x1875409555696640:12345-0@lo:101: Request processed in 339us (3577us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530056.274301:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788530056.274862:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000accc0b27 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555696640:0@lo:101: 00010000:00010000:2.0:1788530056.274900:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: 0000000096a6e85c/0xb28d70e1257501af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257501b6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530056.274930:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: 0000000096a6e85c/0xb28d70e1257501af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e1257501b6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530056.275013:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000accc0b27 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555696768:0@lo:501: 00000100:00100000:2.0:1788530056.275102:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530056.275213:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set 000000001c94df85 going to sleep for 11 seconds 00000100:00100000:1.0:1788530056.276925:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555696768 00000100:00100000:1.0:1788530056.276949:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555696768 00000100:00100000:1.0:1788530056.277056:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788530056.277066:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008a0cd931 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+16:6521:x1875409555696768:12345-0@lo:501: 00000100:00100000:1.0:1788530056.277250:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008a0cd931 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+16:6521:x1875409555696768:12345-0@lo:501: Request processed in 185us (2151us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530056.277258:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788530056.277314:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000accc0b27 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555696768:0@lo:501: 00000100:00100000:1.0:1788530056.277369:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008615410d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555696896:0@lo:503: 00000100:00100000:1.0:1788530056.277427:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530056.277458:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set 000000005c5ef7fc going to sleep for 11 seconds 00000100:00100000:1.0:1788530056.277470:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555696896 00000100:00100000:1.0:1788530056.277474:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555696896 00000100:00100000:1.0:1788530056.277489:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788530056.277494:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000079a2e920 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+16:6521:x1875409555696896:12345-0@lo:503: 00000100:00100000:1.0:1788530056.277608:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000079a2e920 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+16:6521:x1875409555696896:12345-0@lo:503: Request processed in 113us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530056.277614:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788530056.277652:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008615410d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555696896:0@lo:503: 00000100:00100000:1.0:1788530056.277887:0:7727:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008615410d pname:cluuid:pid:xid:nid:opc:job llog_process_th:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:7727:1875409555697024:0@lo:502: 00000100:00100000:1.0:1788530056.277919:0:7727:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530056.277942:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555697024 00000100:00100000:1.0:1788530056.277946:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555697024 00000100:00100000:1.0:1788530056.277962:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788530056.277967:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000007adb2ce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+16:7727:x1875409555697024:12345-0@lo:502: 00000100:00100000:1.0:1788530056.278031:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000007adb2ce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+16:7727:x1875409555697024:12345-0@lo:502: Request processed in 64us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530056.278038:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788530056.278079:0:7727:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d8dff25a going to sleep for 11 seconds 00000100:00100000:1.0:1788530056.278089:0:7727:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008615410d pname:cluuid:pid:xid:nid:opc:job llog_process_th:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:7727:1875409555697024:0@lo:502: 00000100:00100000:1.0:1788530056.278123:0:7727:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008615410d pname:cluuid:pid:xid:nid:opc:job llog_process_th:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:7727:1875409555697152:0@lo:502: 00000100:00100000:1.0:1788530056.278151:0:7727:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530056.278166:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555697152 00000100:00100000:1.0:1788530056.278170:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555697152 00000100:00100000:1.0:1788530056.278185:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788530056.278190:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000956c5019 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+16:7727:x1875409555697152:12345-0@lo:502: 00000100:00100000:1.0:1788530056.278238:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000956c5019 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+16:7727:x1875409555697152:12345-0@lo:502: Request processed in 48us (87us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530056.278245:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788530056.278269:0:7727:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f95f207c going to sleep for 11 seconds 00000100:00100000:1.0:1788530056.278280:0:7727:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008615410d pname:cluuid:pid:xid:nid:opc:job llog_process_th:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:7727:1875409555697152:0@lo:502: 00000040:00080000:1.0:1788530056.278295:0:7727:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1788530056.278340:0:6521:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1788530056.278347:0:6521:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788530056.278354:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: 0000000096a6e85c/0xb28d70e1257501af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257501b6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530056.278363:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: 0000000096a6e85c/0xb28d70e1257501af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257501b6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788530056.278377:0:6521:0:(mgc_request.c:715:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788530056.278379:0:6521:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-mdtir-ffff9a9f0aaed800 from 4 10000000:01000000:1.0:1788530056.278382:0:6521:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788530056.279667:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: 00000000d0f22af1/0xb28d70e1257501bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530056.279820:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: 00000000d0f22af1/0xb28d70e1257501bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530056.279830:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: 00000000d0f22af1/0xb28d70e1257501bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530056.279848:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008615410d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555697280:0@lo:101: 00000100:00100000:1.0:1788530056.279970:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530056.279999:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set 0000000077b4b221 going to sleep for 11 seconds 00000100:00100000:2.0:1788530056.280152:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555697280 00000100:00100000:2.0:1788530056.280158:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555697280 00000100:00100000:2.0:1788530056.280206:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788530056.280213:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000721f59bf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+16:6521:x1875409555697280:12345-0@lo:101: 00010000:00010000:2.0:1788530056.280224:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530056.280235:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002fd4d28b/0xb28d70e1257501c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e1257501bd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530056.280254:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002fd4d28b/0xb28d70e1257501c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e1257501bd expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530056.280263:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002fd4d28b/0xb28d70e1257501c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e1257501bd expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530056.280270:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002fd4d28b, rc 0) 00000100:00100000:2.0:1788530056.280309:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000721f59bf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+17:6521:x1875409555697280:12345-0@lo:101: Request processed in 97us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530056.280316:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788530056.280410:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008615410d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555697280:0@lo:101: 00010000:00010000:1.0:1788530056.280426:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: 00000000d0f22af1/0xb28d70e1257501bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257501c4 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530056.280434:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: 00000000d0f22af1/0xb28d70e1257501bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e1257501c4 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530056.281059:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008615410d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555697408:0@lo:256: 00000100:00100000:1.0:1788530056.281093:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530056.281151:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set 0000000077b4b221 going to sleep for 11 seconds 00000100:00100000:3.0:1788530056.282976:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555697408 00000100:00100000:3.0:1788530056.282988:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555697408 00000100:00100000:3.0:1788530056.283061:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788530056.283074:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003075bcd0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+17:6521:x1875409555697408:12345-0@lo:256: 20000000:01000000:3.0:1788530056.283107:0:6518:0:(mgs_nids.c:1159:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788530056.283134:0:6518:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788530056.283138:0:6518:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1788530056.283461:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003075bcd0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+17:6521:x1875409555697408:12345-0@lo:256: Request processed in 391us (2367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530056.283477:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788530056.287841:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008615410d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555697408:0@lo:256: 10000000:01000000:1.0:1788530056.287950:0:6521:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788530056.287971:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: 00000000d0f22af1/0xb28d70e1257501bd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257501c4 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530056.287982:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: 00000000d0f22af1/0xb28d70e1257501bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257501c4 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788530056.287995:0:6521:0:(mgc_request.c:715:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788530056.287998:0:6521:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1788530056.288001:0:6521:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788530056.288052:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: 0000000007fbb78e/0xb28d70e1257501cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530056.288060:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: 0000000007fbb78e/0xb28d70e1257501cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530056.288067:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: 0000000007fbb78e/0xb28d70e1257501cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530056.288086:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008615410d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555697536:0@lo:101: 00000100:00100000:1.0:1788530056.288168:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530056.288240:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set 0000000077b4b221 going to sleep for 11 seconds 00000100:00100000:3.0:1788530056.288557:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555697536 00000100:00100000:3.0:1788530056.288591:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555697536 00000100:00100000:3.0:1788530056.288654:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788530056.288663:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003b705599 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+17:6521:x1875409555697536:12345-0@lo:101: 00010000:00010000:3.0:1788530056.288689:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788530056.288703:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000dc8a4a1b/0xb28d70e1257501d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e1257501cb expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530056.288730:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000dc8a4a1b/0xb28d70e1257501d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e1257501cb expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530056.288740:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000dc8a4a1b/0xb28d70e1257501d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e1257501cb expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530056.288748:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000dc8a4a1b, rc 0) 00000100:00100000:3.0:1788530056.288794:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003b705599 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+18:6521:x1875409555697536:12345-0@lo:101: Request processed in 132us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530056.288809:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788530056.288883:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008615410d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555697536:0@lo:101: 00010000:00010000:3.0:1788530056.288897:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: 0000000007fbb78e/0xb28d70e1257501cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257501d2 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530056.288905:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: 0000000007fbb78e/0xb28d70e1257501cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e1257501d2 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530056.288941:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000587ab7b6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555697664:0@lo:501: 00000100:00100000:3.0:1788530056.288981:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530056.289014:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set 000000003c0aee36 going to sleep for 11 seconds 00000100:00100000:3.0:1788530056.289037:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555697664 00000100:00100000:3.0:1788530056.289053:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555697664 00000100:00100000:3.0:1788530056.289095:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788530056.289104:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fc4a6b4a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+18:6521:x1875409555697664:12345-0@lo:501: 00000100:00100000:3.0:1788530056.289257:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fc4a6b4a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+18:6521:x1875409555697664:12345-0@lo:501: Request processed in 154us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530056.289263:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788530056.289288:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000587ab7b6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555697664:0@lo:501: 00000100:00100000:3.0:1788530056.289311:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000587ab7b6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555697792:0@lo:503: 00000100:00100000:3.0:1788530056.289871:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530056.289896:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set 000000003c0aee36 going to sleep for 11 seconds 00000100:00100000:3.0:1788530056.289911:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555697792 00000100:00100000:3.0:1788530056.289916:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555697792 00000100:00100000:3.0:1788530056.289998:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788530056.290006:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e46194d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+18:6521:x1875409555697792:12345-0@lo:503: 00000100:00100000:3.0:1788530056.290101:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e46194d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+18:6521:x1875409555697792:12345-0@lo:503: Request processed in 97us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530056.290107:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788530056.292972:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000587ab7b6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555697792:0@lo:503: 00000100:00100000:0.0:1788530056.299028:0:7728:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f230cb1e pname:cluuid:pid:xid:nid:opc:job llog_process_th:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:7728:1875409555697920:0@lo:502: 00000100:00100000:0.0:1788530056.299132:0:7728:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530056.299218:0:7728:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bf308307 going to sleep for 11 seconds 00000100:00100000:3.0:1788530056.299281:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555697920 00000100:00100000:3.0:1788530056.299288:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555697920 00000100:00100000:3.0:1788530056.299334:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788530056.299342:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000027b574d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+18:7728:x1875409555697920:12345-0@lo:502: 00000100:00100000:3.0:1788530056.299449:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000027b574d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+18:7728:x1875409555697920:12345-0@lo:502: Request processed in 107us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530056.299456:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788530056.299926:0:7728:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f230cb1e pname:cluuid:pid:xid:nid:opc:job llog_process_th:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:7728:1875409555697920:0@lo:502: 00000020:01000000:0.0:1788530056.299960:0:7728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788530056.299973:0:7728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788530056.299976:0:7728:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1788530056.299981:0:7728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788530056.299984:0:7728:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.141@tcp to nid 0x20000c0a8ca8d (192.168.202.141@tcp) 00000020:00000080:0.0:1788530056.300012:0:7728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788530056.300039:0:7728:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (00000000a789a198) 00000020:00000080:0.0:1788530056.300071:0:7728:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:0.0:1788530056.300078:0:7728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788530056.300206:0:7728:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1788530056.300212:0:7728:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788530056.300218:0:7728:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb28d70e1257501e0 00010000:00080000:0.0:1788530056.300246:0:7728:0:(ldlm_lib.c:102:import_set_conn()) imp 000000005325feab@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.141@tcp at head 00010000:00010000:1.0:1788530056.303191:0:7728:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:2.0:1788530056.307160:0:7728:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788530056.307177:0:7728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1788530056.307225:0:7728:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788530056.307248:0:7728:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb28d70e1257501e7 00000100:00080000:2.0:1788530056.307261:0:7728:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788530056.307266:0:7728:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 000000005325feab using connection 192.168.202.141@tcp/0@lo 00000100:00100000:2.0:1788530056.307303:0:7728:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000c9e8e6f9 x1875409555698048/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788530056.307347:0:7728:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000040:01000000:2.0:1788530056.307438:0:7728:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:1.0:1788530056.307844:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c9e8e6f9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875409555698048:0@lo:38: 00000100:00100000:1.0:1788530056.307915:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530056.308003:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555698048 00000100:00100000:2.0:1788530056.308010:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555698048 00000100:00100000:0.0:1788530056.308234:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f230cb1e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875409555698176:0@lo:400: 00000100:00100000:0.0:1788530056.308267:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530056.308295:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fa37a8ca pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555698304:0@lo:400: 00000100:00100000:0.0:1788530056.308320:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530056.309317:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788530056.309338:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000049cbb968 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875409555698432:0@lo:400: 00000100:00100000:0.0:1788530056.309391:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530056.309486:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555698176 00000100:00100000:3.0:1788530056.309493:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555698176 00000100:00100000:3.0:1788530056.309538:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555698432 00000100:00100000:3.0:1788530056.309541:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555698432 00000100:00100000:3.0:1788530056.309656:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788530056.309664:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000df1b706c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875409555698176:12345-0@lo:400: 00000100:00100000:3.0:1788530056.309980:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000df1b706c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875409555698176:12345-0@lo:400: Request processed in 314us (1710us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530056.309993:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788530056.310023:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788530056.310030:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e867573a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875409555698432:12345-0@lo:400: 00000100:00100000:3.0:1788530056.310105:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e867573a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875409555698432:12345-0@lo:400: Request processed in 74us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530056.310117:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1788530056.311995:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000f230cb1e x1875409555698176/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530072 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530056.312027:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f230cb1e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875409555698176:0@lo:400: 00010000:00080000:3.0:1788530056.312125:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000049cbb968 x1875409555698432/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530072 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530056.312135:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000049cbb968 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875409555698432:0@lo:400: 00000100:00100000:2.0:1788530056.316577:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555698304 00000100:00100000:2.0:1788530056.316596:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555698304 00000100:00100000:2.0:1788530056.317181:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788530056.317197:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d697453b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1875409555698048:12345-0@lo:38: 00010000:00080000:2.0:1788530056.317248:0:6528:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 264 last 0 00000020:00000080:2.0:1788530056.317301:0:6528:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb28d70e1257501ee 00000004:00100000:2.0:1788530056.317614:0:6528:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1788530056.317625:0:6528:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:0.0:1788530056.320344:0:7731:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@0000000019b59c49 x1875409555698560/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530056.320359:0:7731:0:(client.c:2716:ptlrpc_set_wait()) set 0000000082d766ca going to sleep for 0 seconds 00000020:01000000:2.0:1788530056.324830:0:7728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788530056.324843:0:7728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788530056.324845:0:7728:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1788530056.324848:0:7728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788530056.324853:0:7728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788530056.324854:0:7728:0:(obd_config.c:1563:class_process_config()) marker 19 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788530056.324857:0:7728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788530056.324858:0:7728:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788530056.324905:0:7728:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000de546939 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:7728:1875409555698688:0@lo:502: 00000100:00100000:2.0:1788530056.324981:0:7728:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530056.327594:0:7728:0:(client.c:2716:ptlrpc_set_wait()) set 000000001b8349ee going to sleep for 11 seconds 00000100:00100000:3.0:1788530056.332351:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555698688 00000100:00100000:3.0:1788530056.332367:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555698688 00000100:00100000:3.0:1788530056.332453:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788530056.332462:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002aab9476 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+18:7728:x1875409555698688:12345-0@lo:502: 00000100:00100000:3.0:1788530056.332665:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002aab9476 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+18:7728:x1875409555698688:12345-0@lo:502: Request processed in 203us (7683us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530056.332686:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788530056.332757:0:7728:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000de546939 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:7728:1875409555698688:0@lo:502: 00000020:01000000:3.0:1788530056.332792:0:7728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788530056.332799:0:7728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788530056.332801:0:7728:0:(obd_config.c:1563:class_process_config()) marker 19 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788530056.332806:0:7728:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:3.0:1788530056.332890:0:6521:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:3.0:1788530056.332899:0:6521:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788530056.332908:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: 0000000007fbb78e/0xb28d70e1257501cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257501d2 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530056.332918:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: 0000000007fbb78e/0xb28d70e1257501cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257501d2 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788530056.332928:0:6521:0:(mgc_request.c:715:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788530056.332930:0:6521:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-sptlrpc-ffff9a9f0aaed800 from 1 10000000:01000000:3.0:1788530056.332933:0:6521:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788530056.332963:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: 000000009b58ab75/0xb28d70e1257501f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530056.332975:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: 000000009b58ab75/0xb28d70e1257501f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530056.332983:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: 000000009b58ab75/0xb28d70e1257501f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530056.333000:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000afb23b73 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555698816:0@lo:101: 00000100:00100000:3.0:1788530056.333038:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530056.333079:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f173fc4d going to sleep for 11 seconds 00000100:00100000:3.0:1788530056.333091:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555698816 00000100:00100000:3.0:1788530056.333095:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555698816 00000100:00100000:3.0:1788530056.333116:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788530056.333121:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007c83d835 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+18:6521:x1875409555698816:12345-0@lo:101: 00010000:00010000:3.0:1788530056.333130:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788530056.333142:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004faa34d6/0xb28d70e1257501fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e1257501f5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530056.333162:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004faa34d6/0xb28d70e1257501fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e1257501f5 expref: 19 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530056.333171:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004faa34d6/0xb28d70e1257501fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e1257501f5 expref: 19 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530056.333179:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004faa34d6, rc 0) 00000100:00100000:3.0:1788530056.333206:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007c83d835 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+19:6521:x1875409555698816:12345-0@lo:101: Request processed in 84us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530056.333211:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788530056.333237:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000afb23b73 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555698816:0@lo:101: 00010000:00010000:3.0:1788530056.333254:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: 000000009b58ab75/0xb28d70e1257501f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257501fc expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530056.333261:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: 000000009b58ab75/0xb28d70e1257501f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e1257501fc expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530056.333288:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000afb23b73 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555698944:0@lo:501: 00000100:00100000:3.0:1788530056.333311:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530056.333324:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f173fc4d going to sleep for 11 seconds 00000100:00100000:3.0:1788530056.333334:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555698944 00000100:00100000:3.0:1788530056.333337:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555698944 00000100:00100000:3.0:1788530056.333356:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788530056.333360:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bb9b869f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+19:6521:x1875409555698944:12345-0@lo:501: 00000100:00100000:3.0:1788530056.333418:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bb9b869f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+19:6521:x1875409555698944:12345-0@lo:501: Request processed in 57us (106us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788530056.333427:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788530056.333465:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000afb23b73 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555698944:0@lo:501: 10000000:01000000:3.0:1788530056.333480:0:6521:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788530056.333486:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: 000000009b58ab75/0xb28d70e1257501f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257501fc expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530056.333495:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: 000000009b58ab75/0xb28d70e1257501f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257501fc expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788530056.337369:0:6528:0:(import.c:65:import_set_state_nolock()) 00000000dbf6f3ad : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788530056.338440:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d697453b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1875409555698048:12345-0@lo:38: Request processed in 21241us (30520us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530056.338458:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788530056.338509:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788530056.338522:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000094d301de pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555698304:12345-0@lo:400: 00000100:00100000:1.0:1788530056.338607:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000094d301de pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555698304:12345-0@lo:400: Request processed in 90us (30285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530056.338614:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788530056.338663:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788530056.338823:0:3646:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788530056.338836:0:3646:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1788530056.338842:0:3646:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788530056.338845:0:3646:0:(import.c:65:import_set_state_nolock()) 000000005325feab lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1788530056.338866:0:3646:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000082d766ca): req@0000000019b59c49 x1875409555698560/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530056.338892:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c9e8e6f9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875409555698048:0@lo:38: 00000100:00100000:0.0:1788530056.343238:0:7731:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530056.343286:0:7731:0:(client.c:2716:ptlrpc_set_wait()) set 0000000082d766ca going to sleep for 11 seconds 00000100:00100000:3.0:1788530056.343458:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c626d22e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555699072:0@lo:41: 00000100:00100000:3.0:1788530056.346161:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530056.346257:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555698560 00000100:00100000:3.0:1788530056.346271:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555698560 00000100:00100000:3.0:1788530056.346324:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555699072 00000100:00100000:3.0:1788530056.346330:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555699072 00000100:00100000:3.0:1788530056.346358:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788530056.346368:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000987e2919 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:7731:x1875409555698560:12345-0@lo:1000: 00000100:00100000:3.0:1788530056.346486:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000987e2919 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:7731:x1875409555698560:12345-0@lo:1000: Request processed in 121us (3255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530056.346494:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788530056.346511:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788530056.346517:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000afb23b73 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1875409555699072:12345-0@lo:41: 00000004:00000024:3.0:1788530056.346537:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1788530056.346586:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000afb23b73 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1875409555699072:12345-0@lo:41: Request processed in 70us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530056.346593:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788530056.346630:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c626d22e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555699072:0@lo:41: 00000100:00100000:3.0:1788530056.346663:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fa37a8ca pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555698304:0@lo:400: 00000100:00100000:0.0:1788530056.346840:0:7731:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000019b59c49 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7731:1875409555698560:0@lo:1000: 00000040:01000000:0.0:1788530056.346871:0:7731:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1788530056.346908:0:7731:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000019b59c49 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7731:1875409555699200:0@lo:1000: 00000100:00100000:0.0:1788530056.346940:0:7731:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530056.346964:0:7731:0:(client.c:2716:ptlrpc_set_wait()) set 0000000082d766ca going to sleep for 11 seconds 00000100:00100000:0.0:1788530056.346976:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555699200 00000100:00100000:0.0:1788530056.346979:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555699200 00000100:00100000:0.0:1788530056.346998:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788530056.347003:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a597eb86 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7731:x1875409555699200:12345-0@lo:1000: 00000100:00100000:0.0:1788530056.347118:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a597eb86 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7731:x1875409555699200:12345-0@lo:1000: Request processed in 114us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530056.347126:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788530056.347150:0:7731:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000019b59c49 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7731:1875409555699200:0@lo:1000: 00000100:00100000:0.0:1788530056.347237:0:7731:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000019b59c49 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7731:1875409555699328:0@lo:700: 00000100:00100000:0.0:1788530056.347276:0:7731:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530056.347325:0:7731:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ba3b6b27 going to sleep for 11 seconds 00000100:00100000:2.0:1788530056.348169:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555699328 00000100:00100000:2.0:1788530056.348181:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555699328 00000100:00100000:2.0:1788530056.348326:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788530056.348342:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008c901729 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7731:x1875409555699328:12345-0@lo:700: 00000100:00100000:2.0:1788530056.348466:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008c901729 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7731:x1875409555699328:12345-0@lo:700: Request processed in 129us (1189us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530056.348703:0:7731:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000019b59c49 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7731:1875409555699328:0@lo:700: 00000100:00100000:0.0:1788530056.348818:0:7731:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000019b59c49 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7731:1875409555699456:0@lo:1000: 00000100:00100000:0.0:1788530056.348862:0:7731:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530056.348901:0:7731:0:(client.c:2716:ptlrpc_set_wait()) set 000000005eaf4cee going to sleep for 11 seconds 00000100:00100000:0.0:1788530056.349109:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555699456 00000100:00100000:0.0:1788530056.349117:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555699456 00000100:00100000:0.0:1788530056.349163:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788530056.349175:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000021668325 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:7731:x1875409555699456:12345-0@lo:1000: 00000100:00100000:0.0:1788530056.349257:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000021668325 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:7731:x1875409555699456:12345-0@lo:1000: Request processed in 86us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530056.349264:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788530056.349289:0:7731:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000019b59c49 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7731:1875409555699456:0@lo:1000: 00000004:00080000:0.0:1788530056.349383:0:7731:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000ba3b6b27 with version 0 00000020:00100000:0.0:1788530056.349408:0:7731:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788530056.349419:0:7731:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000019b59c49 x1875409555699712/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788530056.349440:0:7731:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000019b59c49 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7731:1875409555699712:0@lo:1000: 00000100:00100000:0.0:1788530056.349466:0:7731:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530056.349487:0:7731:0:(client.c:2716:ptlrpc_set_wait()) set 000000006988db5a going to sleep for 11 seconds 00000100:00100000:0.0:1788530056.349499:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555699712 00000100:00100000:0.0:1788530056.349502:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555699712 00000100:00100000:0.0:1788530056.349518:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788530056.349523:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000047cac9fc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:7731:x1875409555699712:12345-0@lo:1000: 00000100:00100000:2.0:1788530056.351141:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000001:00080000:0.0:1788530056.354972:0:7454:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:0.0:1788530056.354988:0:7454:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1788530056.355134:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000047cac9fc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7731:x1875409555699712:12345-0@lo:1000: Request processed in 5606us (5662us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788530056.355148:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:0.0:1788530056.355199:0:7731:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:0.0:1788530056.355204:0:7731:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1788530056.355236:0:7731:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000019b59c49 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7731:1875409555699712:0@lo:1000: 00000100:00100000:0.0:1788530056.355403:0:7731:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000019b59c49 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7731:1875409555699840:0@lo:1000: 00000100:00100000:0.0:1788530056.355538:0:7731:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530056.355556:0:7731:0:(client.c:2716:ptlrpc_set_wait()) set 0000000082d766ca going to sleep for 11 seconds 00000100:00100000:0.0:1788530056.355741:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555699840 00000100:00100000:0.0:1788530056.355749:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555699840 00000100:00100000:0.0:1788530056.355783:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788530056.355790:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000074b921ab pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7731:x1875409555699840:12345-0@lo:1000: 00000100:00100000:0.0:1788530056.355854:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000074b921ab pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7731:x1875409555699840:12345-0@lo:1000: Request processed in 65us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530056.355860:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788530056.355883:0:7731:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000019b59c49 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7731:1875409555699840:0@lo:1000: 00000040:00080000:0.0:1788530056.355899:0:7731:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:0.0:1788530056.355925:0:7731:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000ba3b6b27 with version 1 00000004:00080000:1.0:1788530056.357884:0:7729:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000feab09c1 version 1 rpc_version 1 00000020:00100000:1.0:1788530056.357933:0:7729:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1788530056.357945:0:7729:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000005ed4f355 x1875409555700096/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788530056.357970:0:7729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005ed4f355 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7729:1875409555700096:0@lo:1000: 00000100:00100000:1.0:1788530056.358056:0:7729:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530056.358092:0:7729:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ebacf499 going to sleep for 11 seconds 00000100:00100000:3.0:1788530056.358779:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555700096 00000100:00100000:3.0:1788530056.358797:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555700096 00000100:00100000:3.0:1788530056.358885:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788530056.358894:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000020d1f353 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7729:x1875409555700096:12345-0@lo:1000: 00000040:00080000:0.0:1788530056.364119:0:7731:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788530056.364213:0:7731:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788530056.364218:0:7731:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:00080000:2.0:1788530056.380054:0:7454:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:1.0:1788530056.380239:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000020d1f353 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7729:x1875409555700096:12345-0@lo:1000: Request processed in 21343us (22180us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788530056.380254:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000004:00080000:2.0:1788530056.380357:0:7729:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:2.0:1788530056.380365:0:7729:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1788530056.380392:0:7729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005ed4f355 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7729:1875409555700096:0@lo:1000: 00010000:00010000:0.0:1788530056.385894:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530057.409010:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788530057.566233:0:7780:0:(tgt_mount.c:2429:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788530057.567424:0:7780:0:(tgt_mount.c:2444:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788530058.436416:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530059.457135:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788530059.842526:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000019b59c49 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555700224:0@lo:41: 00000100:00100000:3.0:1788530059.842643:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530059.845505:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555700224 00000100:00100000:0.0:1788530059.845528:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555700224 00000100:00100000:0.0:1788530059.845612:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788530059.845622:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000587ab7b6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555700224:12345-0@lo:41: 00000004:00000024:0.0:1788530059.845673:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:0.0:1788530059.845772:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000587ab7b6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555700224:12345-0@lo:41: Request processed in 151us (3129us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530059.845788:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788530059.845865:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000019b59c49 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555700224:0@lo:41: 00010000:00010000:1.0:1788530060.491680:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788530060.888092:0:7882:0:(tgt_mount.c:2429:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788530060.888349:0:7882:0:(tgt_mount.c:2444:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788530061.383473:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008615410d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875409555700480:0@lo:400: 00000100:00100000:1.0:1788530061.383600:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530061.383928:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005ed4f355 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3649:1875409555700352:0@lo:400: 00000100:00100000:0.0:1788530061.383972:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530061.384006:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005f9a9d6e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555700864:0@lo:400: 00000100:00100000:0.0:1788530061.384048:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530061.384094:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555700864 00000100:00100000:0.0:1788530061.384104:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555700864 00000100:00100000:0.0:1788530061.384160:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788530061.384170:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000019b59c49 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555700864:12345-0@lo:400: 00000100:00100000:0.0:1788530061.384237:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000019b59c49 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555700864:12345-0@lo:400: Request processed in 69us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530061.384246:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788530061.384420:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005f9a9d6e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555700864:0@lo:400: 00000100:00100000:1.0:1788530061.384500:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dc5bbc02 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555700608:0@lo:400: 00000100:00100000:1.0:1788530061.384534:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530061.384558:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788530061.384582:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002a973a82 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875409555700736:0@lo:400: 00000100:00100000:1.0:1788530061.384606:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530061.384639:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555700480 00000100:00100000:1.0:1788530061.384643:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555700480 00000100:00100000:1.0:1788530061.384671:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555700736 00000100:00100000:1.0:1788530061.384675:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555700736 00000100:00100000:0.0:1788530061.384832:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555700608 00000100:00100000:0.0:1788530061.384836:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555700608 00000100:00100000:0.0:1788530061.384855:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788530061.384861:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ce2e39d7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555700608:12345-0@lo:400: 00000100:00100000:0.0:1788530061.384895:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ce2e39d7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555700608:12345-0@lo:400: Request processed in 35us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530061.384901:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788530061.385013:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788530061.385021:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006e3f04d9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875409555700480:12345-0@lo:400: 00000100:00100000:1.0:1788530061.385069:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006e3f04d9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875409555700480:12345-0@lo:400: Request processed in 51us (1470us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530061.385075:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788530061.385090:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788530061.385095:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a4f6b3ff pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875409555700736:12345-0@lo:400: 00000100:00100000:1.0:1788530061.385118:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a4f6b3ff pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875409555700736:12345-0@lo:400: Request processed in 24us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530061.385124:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1788530061.385154:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000002a973a82 x1875409555700736/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530077 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530061.385165:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002a973a82 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875409555700736:0@lo:400: 00000100:00100000:1.0:1788530061.385175:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dc5bbc02 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555700608:0@lo:400: 00000100:00100000:3.0:1788530061.385573:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555700352 00000100:00100000:3.0:1788530061.385580:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555700352 00000100:00100000:3.0:1788530061.385617:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788530061.385623:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cda4ce8b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+19:3649:x1875409555700352:12345-0@lo:400: 00000100:00100000:3.0:1788530061.385675:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cda4ce8b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+19:3649:x1875409555700352:12345-0@lo:400: Request processed in 52us (1702us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530061.385681:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:0.0:1788530061.385857:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000008615410d x1875409555700480/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530077 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530061.385870:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008615410d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875409555700480:0@lo:400: 00000100:00100000:3.0:1788530061.386044:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005ed4f355 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3649:1875409555700352:0@lo:400: 00000100:00100000:0.0:1788530061.386412:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d0ebf6e8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555700992:0@lo:41: 00000100:00100000:0.0:1788530061.386460:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530061.386525:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555700992 00000100:00100000:1.0:1788530061.386531:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555700992 00000100:00100000:1.0:1788530061.386584:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788530061.386591:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d751e4a3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555700992:12345-0@lo:41: 00000004:00000024:1.0:1788530061.386627:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1788530061.390602:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d751e4a3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555700992:12345-0@lo:41: Request processed in 3998us (4129us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530061.390626:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788530061.394989:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d0ebf6e8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555700992:0@lo:41: 00010000:00010000:1.0:1788530061.504826:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788530061.932777:0:7930:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe5aaa6ad0 20000000:00000080:0.0:1788530061.932801:0:7930:0:(mgs_handler.c:1172:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a9f3d25e000 uarg=0000000000000000 20000000:01000000:0.0:1788530061.932846:0:7930:0:(mgs_llog.c:6198:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1788530061.932857:0:7930:0:(mgs_llog.c:4653:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1788530061.932865:0:7930:0:(mgs_llog.c:1385:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1788530061.932969:0:7930:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:0.0:1788530061.932983:0:7930:0:(mgs_llog.c:4126:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:1.0:1788530061.937214:0:7930:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788530061.939147:0:7930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788530061.939211:0:7930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:1.0:1788530061.939232:0:7930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:1.0:1788530061.939737:0:7930:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788530061.939763:0:7930:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000065c398ef/0xb28d70e125750203 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530061.939788:0:7930:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000247abbd4/0xb28d70e125750082 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e12575007b expref: 18 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530061.939797:0:7930:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000002b27748d/0xb28d70e125750170 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125750169 expref: 18 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530061.939804:0:7930:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000065c398ef/0xb28d70e125750203 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530061.939857:0:7930:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000002b27748d/0xb28d70e125750170 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb28d70e125750169 expref: 18 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530061.939873:0:7930:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000002b27748d/0xb28d70e125750170 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb28d70e125750169 expref: 18 pid: 6517 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530061.939889:0:7930:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dc5bbc02 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7930:1875409555701120:0@lo:104: 00000100:00100000:1.0:1788530061.940784:0:7930:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788530061.940881:0:7930:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000247abbd4/0xb28d70e125750082 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb28d70e12575007b expref: 18 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530061.940895:0:7930:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000247abbd4/0xb28d70e125750082 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb28d70e12575007b expref: 18 pid: 6518 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530061.940907:0:7930:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002a973a82 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7930:1875409555701248:0@lo:104: 00000100:00100000:1.0:1788530061.940941:0:7930:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ddb47a5a going to sleep for 11 seconds 00000100:00100000:2.0:1788530061.941708:0:6507:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788530061.941740:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530061.941778:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555701120 00000100:00100000:2.0:1788530061.941786:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555701120 00000100:00100000:2.0:1788530061.941833:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555701248 00000100:00100000:2.0:1788530061.941836:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555701248 00000100:00100000:2.0:1788530061.941853:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788530061.941861:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b7e97b02 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+4:7930:x1875409555701120:12345-0@lo:104: 00010000:00010000:2.0:1788530061.941876:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: 000000001e814926/0xb28d70e125750169 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e125750170 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530061.941945:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788530061.941950:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b7e97b02 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+4:7930:x1875409555701120:12345-0@lo:104: Request processed in 91us (1978us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530061.941971:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788530061.942090:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788530061.942096:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d0ebf6e8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+3:7930:x1875409555701248:12345-0@lo:104: 00010000:00010000:2.0:1788530061.942103:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: 00000000d2cba6a1/0xb28d70e12575007b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e125750082 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530061.942142:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788530061.942146:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d0ebf6e8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+3:7930:x1875409555701248:12345-0@lo:104: Request processed in 51us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530061.942151:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:2.0:1788530061.942168:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788530061.942173:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: 000000001e814926/0xb28d70e125750169 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e125750170 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530061.942181:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001e814926 already unused, calling callback (00000000f0300a12) 10000000:00010000:2.0:1788530061.942184:0:6512:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: 000000001e814926/0xb28d70e125750169 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb28d70e125750170 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530061.942193:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: 000000001e814926/0xb28d70e125750169 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb28d70e125750170 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788530061.942199:0:6512:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: 000000001e814926/0xb28d70e125750169 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb28d70e125750170 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788530061.942203:0:6512:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788530061.942237:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: 000000001e814926/0xb28d70e125750169 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125750170 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530061.942242:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788530061.942330:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: 000000001e814926/0xb28d70e125750169 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125750170 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530061.942337:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: 000000001e814926/0xb28d70e125750169 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125750170 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530061.942350:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788530061.942352:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: 00000000d2cba6a1/0xb28d70e12575007b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e125750082 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530061.942358:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d2cba6a1 already unused, calling callback (00000000f0300a12) 10000000:00010000:2.0:1788530061.942360:0:6512:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: 00000000d2cba6a1/0xb28d70e12575007b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb28d70e125750082 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530061.942365:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: 00000000d2cba6a1/0xb28d70e12575007b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb28d70e125750082 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788530061.942371:0:6512:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: 00000000d2cba6a1/0xb28d70e12575007b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb28d70e125750082 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788530061.942376:0:6512:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788530061.942389:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: 00000000d2cba6a1/0xb28d70e12575007b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125750082 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530061.942395:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788530061.942399:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: 00000000d2cba6a1/0xb28d70e12575007b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125750082 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530061.942405:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: 00000000d2cba6a1/0xb28d70e12575007b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125750082 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530061.942418:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530061.942426:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530061.942428:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530061.942434:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788530061.942454:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000f15459d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3647:1875409555701376:0@lo:103: 00000100:00100000:2.0:1788530061.942485:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530061.942515:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788530061.942521:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007c69670d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3647:1875409555701504:0@lo:103: 00000100:00100000:2.0:1788530061.942543:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530061.942601:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555701376 00000100:00100000:2.0:1788530061.942605:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555701376 00010000:00010000:2.0:1788530061.942623:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000002b27748d/0xb28d70e125750170 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e125750169 expref: 19 pid: 6517 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530061.942643:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555701504 00000100:00100000:2.0:1788530061.942647:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555701504 00010000:00010000:2.0:1788530061.942657:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000247abbd4/0xb28d70e125750082 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e12575007b expref: 20 pid: 6518 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530061.942670:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788530061.942675:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006d14b325 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+20:3647:x1875409555701376:12345-0@lo:103: 00010000:00010000:2.0:1788530061.942685:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788530061.942689:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000002b27748d/0xb28d70e125750170 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e125750169 expref: 20 pid: 6517 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530061.942699:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000002b27748d/0xb28d70e125750170 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb28d70e125750169 expref: 20 pid: 6517 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530061.942716:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788530061.942744:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006d14b325 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+20:3647:x1875409555701376:12345-0@lo:103: Request processed in 69us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530061.942759:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788530061.942794:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788530061.942799:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c626d22e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+19:3647:x1875409555701504:12345-0@lo:103: 00010000:00010000:2.0:1788530061.942806:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788530061.942810:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000247abbd4/0xb28d70e125750082 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e12575007b expref: 19 pid: 6518 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530061.942817:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000247abbd4/0xb28d70e125750082 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb28d70e12575007b expref: 19 pid: 6518 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530061.942828:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000065c398ef/0xb28d70e125750203 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530061.942835:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000065c398ef/0xb28d70e125750203 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530061.942847:0:6508:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000065c398ef/0xb28d70e125750203 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530061.942852:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000065c398ef/0xb28d70e125750203 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530061.942857:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000065c398ef/0xb28d70e125750203 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530061.942862:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000065c398ef/0xb28d70e125750203 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530061.942866:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000065c398ef already unused, calling callback (0000000096f15eee) 00010000:00010000:2.0:1788530061.942870:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000065c398ef/0xb28d70e125750203 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530061.942881:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000065c398ef/0xb28d70e125750203 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530061.942887:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000065c398ef/0xb28d70e125750203 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530061.942896:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788530061.942917:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c626d22e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+19:3647:x1875409555701504:12345-0@lo:103: Request processed in 118us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530061.942922:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788530061.942959:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007c69670d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3647:1875409555701504:0@lo:103: 00000100:00100000:2.0:1788530061.942966:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000f15459d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3647:1875409555701376:0@lo:103: 00010000:00010000:1.0:1788530061.943157:0:7930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002b27748d/0xb28d70e125750170 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb28d70e125750169 expref: 18 pid: 6517 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530061.943169:0:7930:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dc5bbc02 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7930:1875409555701120:0@lo:104: 00010000:00010000:1.0:1788530061.943177:0:7930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000247abbd4/0xb28d70e125750082 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb28d70e12575007b expref: 17 pid: 6518 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530061.943183:0:7930:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002a973a82 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7930:1875409555701248:0@lo:104: 00010000:00010000:1.0:1788530061.943199:0:7930:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000065c398ef/0xb28d70e125750203 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530061.943206:0:7930:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000065c398ef/0xb28d70e125750203 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530061.943211:0:7930:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000065c398ef/0xb28d70e125750203 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530061.943215:0:7930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000065c398ef/0xb28d70e125750203 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530062.534608:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530063.558153:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530064.577810:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788530064.987714:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788530064.987742:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001766d097 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555701632:0@lo:41: 00000100:00100000:3.0:1788530064.987821:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530064.987899:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555701632 00000100:00100000:3.0:1788530064.987908:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555701632 00000100:00100000:3.0:1788530064.987970:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788530064.987982:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000db76e783 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555701632:12345-0@lo:41: 00000004:00000024:3.0:1788530064.988019:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:3.0:1788530064.988063:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000db76e783 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555701632:12345-0@lo:41: Request processed in 84us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530064.988070:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788530064.988120:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001766d097 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555701632:0@lo:41: 00010000:00010000:2.0:1788530065.600929:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788530066.498057:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000f15459d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555701760:0@lo:41: 00000100:00100000:0.0:1788530066.498129:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530066.498287:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555701760 00000100:00100000:1.0:1788530066.498296:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555701760 00000100:00100000:1.0:1788530066.498357:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788530066.498367:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000011772b94 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555701760:12345-0@lo:41: 00000004:00000024:1.0:1788530066.498400:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1788530066.498485:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000011772b94 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555701760:12345-0@lo:41: Request processed in 120us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530066.498493:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788530066.498602:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dc5bbc02 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875409555702016:0@lo:400: 00000100:00100000:1.0:1788530066.498631:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530066.498652:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788530066.498658:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002a973a82 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3648:1875409555701888:0@lo:400: 00000100:00100000:1.0:1788530066.498685:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530066.498713:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005ed4f355 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555702144:0@lo:400: 00000100:00100000:1.0:1788530066.498752:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530066.498773:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788530066.498778:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008615410d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875409555702272:0@lo:400: 00000100:00100000:1.0:1788530066.498802:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530066.498822:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000f15459d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555701760:0@lo:41: 00000100:00100000:1.0:1788530066.498825:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555702016 00000100:00100000:1.0:1788530066.498828:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555702016 00000100:00100000:1.0:1788530066.498852:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555702272 00000100:00100000:1.0:1788530066.498855:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555702272 00000100:00100000:1.0:1788530066.498867:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788530066.498873:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005f9a9d6e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875409555702016:12345-0@lo:400: 00000100:00100000:1.0:1788530066.498914:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005f9a9d6e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875409555702016:12345-0@lo:400: Request processed in 41us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530066.498920:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788530066.498932:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788530066.498936:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000055fe7ea4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875409555702272:12345-0@lo:400: 00000100:00100000:1.0:1788530066.498988:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000055fe7ea4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875409555702272:12345-0@lo:400: Request processed in 51us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530066.498994:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788530066.499011:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555701888 00000100:00100000:1.0:1788530066.499014:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555701888 00000100:00100000:1.0:1788530066.499036:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788530066.499041:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000628b3f28 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+17:3648:x1875409555701888:12345-0@lo:400: 00000100:00100000:1.0:1788530066.499068:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000628b3f28 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+17:3648:x1875409555701888:12345-0@lo:400: Request processed in 27us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530066.499074:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788530066.499099:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555702144 00000100:00100000:1.0:1788530066.499103:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555702144 00000100:00100000:1.0:1788530066.499126:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788530066.499131:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007cea4bae pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555702144:12345-0@lo:400: 00000100:00100000:1.0:1788530066.499156:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007cea4bae pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555702144:12345-0@lo:400: Request processed in 25us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530066.499161:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:1.0:1788530066.499191:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000008615410d x1875409555702272/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530082 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530066.499202:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008615410d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875409555702272:0@lo:400: 00000100:00100000:1.0:1788530066.499211:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005ed4f355 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555702144:0@lo:400: 00000100:00100000:0.0:1788530066.499436:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002a973a82 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3648:1875409555701888:0@lo:400: 00010000:00080000:0.0:1788530066.499447:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000dc5bbc02 x1875409555702016/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530082 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530066.499455:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dc5bbc02 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875409555702016:0@lo:400: 00010000:00010000:1.0:1788530066.626594:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530067.649350:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530068.676302:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530069.697447:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788530070.095403:0:6521:0:(mgc_request.c:715:do_requeue()) updating log params 10000000:01000000:0.0:1788530070.095416:0:6521:0:(mgc_request.c:2194:mgc_process_log()) Process log params-ffff9a9f32bea000 from 1 10000000:01000000:0.0:1788530070.095424:0:6521:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788530070.095475:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: 000000000c623771/0xb28d70e12575020a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530070.095488:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: 000000000c623771/0xb28d70e12575020a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530070.095500:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: 000000000c623771/0xb28d70e12575020a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530070.095523:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006d5b89a5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555702400:0@lo:101: 00000100:00100000:0.0:1788530070.098797:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530070.098860:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b8257897 going to sleep for 11 seconds 00000100:00100000:0.0:1788530070.098892:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555702400 00000100:00100000:0.0:1788530070.098902:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555702400 00000100:00100000:0.0:1788530070.098996:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788530070.099006:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008629a1b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+17:6521:x1875409555702400:12345-0@lo:101: 00010000:00010000:0.0:1788530070.099027:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530070.099058:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d8c35e1e/0xb28d70e125750211 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e12575020a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530070.099096:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d8c35e1e/0xb28d70e125750211 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e12575020a expref: 18 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530070.099107:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d8c35e1e/0xb28d70e125750211 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e12575020a expref: 18 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530070.099119:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d8c35e1e, rc 0) 00000100:00100000:0.0:1788530070.099175:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008629a1b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+18:6521:x1875409555702400:12345-0@lo:101: Request processed in 169us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530070.099743:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788530070.099806:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006d5b89a5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555702400:0@lo:101: 00010000:00010000:0.0:1788530070.099823:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: 000000000c623771/0xb28d70e12575020a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125750211 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530070.099832:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: 000000000c623771/0xb28d70e12575020a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e125750211 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788530070.099932:0:6521:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788530070.099967:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006d5b89a5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555702528:0@lo:501: 00000100:00100000:0.0:1788530070.100022:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530070.100059:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b8257897 going to sleep for 11 seconds 00000100:00100000:1.0:1788530070.100265:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555702528 00000100:00100000:1.0:1788530070.100272:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555702528 00000100:00100000:1.0:1788530070.100323:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788530070.100331:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007c719b37 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+18:6521:x1875409555702528:12345-0@lo:501: 00000100:00100000:1.0:1788530070.100463:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007c719b37 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+18:6521:x1875409555702528:12345-0@lo:501: Request processed in 133us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530070.100469:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788530070.101785:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006d5b89a5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555702528:0@lo:501: 00000100:00100000:0.0:1788530070.101854:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006d5b89a5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555702656:0@lo:503: 00000100:00100000:0.0:1788530070.101933:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530070.101988:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b8257897 going to sleep for 11 seconds 00000100:00100000:0.0:1788530070.102010:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555702656 00000100:00100000:0.0:1788530070.102015:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555702656 00000100:00100000:0.0:1788530070.102061:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788530070.102070:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cfedee14 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+18:6521:x1875409555702656:12345-0@lo:503: 00000100:00100000:0.0:1788530070.104131:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cfedee14 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+18:6521:x1875409555702656:12345-0@lo:503: Request processed in 2056us (2192us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530070.104146:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788530070.104355:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006d5b89a5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555702656:0@lo:503: 00000040:00080000:1.0:1788530070.107535:0:6521:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788530070.107683:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d132b7df pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555702784:0@lo:502: 00000100:00100000:1.0:1788530070.107776:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530070.107838:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f7fb75b7 going to sleep for 11 seconds 00000100:00100000:1.0:1788530070.107875:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555702784 00000100:00100000:1.0:1788530070.107883:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555702784 00000100:00100000:2.0:1788530070.108331:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007c69670d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555702912:0@lo:41: 00000100:00100000:2.0:1788530070.108371:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530070.110685:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788530070.110704:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c0d5e0d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+18:6521:x1875409555702784:12345-0@lo:502: 00000100:00100000:1.0:1788530070.110902:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c0d5e0d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+18:6521:x1875409555702784:12345-0@lo:502: Request processed in 204us (3126us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530070.110922:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788530070.110986:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555702912 00000100:00100000:1.0:1788530070.110995:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555702912 00000100:00100000:1.0:1788530070.111037:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788530070.111044:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c9e8e6f9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555702912:12345-0@lo:41: 00000004:00000024:1.0:1788530070.111073:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:1.0:1788530070.111129:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c9e8e6f9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555702912:12345-0@lo:41: Request processed in 86us (2757us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530070.111135:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788530070.112191:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007c69670d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555702912:0@lo:41: 00000100:00100000:1.0:1788530070.112267:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d132b7df pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555702784:0@lo:502: 00000040:00080000:1.0:1788530070.112547:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1788530070.112597:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000100:00100000:1.0:1788530070.112654:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d132b7df pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555703040:0@lo:502: 00000100:00100000:1.0:1788530070.112724:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530070.112764:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f7fb75b7 going to sleep for 11 seconds 00000100:00100000:1.0:1788530070.112782:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555703040 00000100:00100000:1.0:1788530070.112788:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555703040 00000100:00100000:1.0:1788530070.112831:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788530070.112840:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008d495ed0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+18:6521:x1875409555703040:12345-0@lo:502: 00000100:00100000:1.0:1788530070.112946:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008d495ed0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+18:6521:x1875409555703040:12345-0@lo:502: Request processed in 107us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530070.112954:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788530070.113011:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d132b7df pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555703040:0@lo:502: 00000040:00080000:1.0:1788530070.113053:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1788530070.113060:0:6521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1788530070.113396:0:8293:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788530070.113409:0:8293:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788530070.113412:0:8293:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788530070.113421:0:8293:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a9f32bea000 00000020:00000080:1.0:1788530070.113424:0:8293:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788530070.113466:0:8293:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788530070.113471:0:8293:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788530070.113472:0:8293:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788530070.113475:0:8293:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 4 count 4 00000020:01000000:1.0:1788530070.113508:0:6521:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1788530070.113516:0:6521:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788530070.113529:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d100800/0xb28d70e12575020a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125750211 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530070.113546:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f3d100800/0xb28d70e12575020a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125750211 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788530070.113584:0:6521:0:(mgc_request.c:715:do_requeue()) updating log params 10000000:01000000:1.0:1788530070.113588:0:6521:0:(mgc_request.c:2194:mgc_process_log()) Process log params-ffff9a9f0aaed800 from 1 10000000:01000000:1.0:1788530070.113592:0:6521:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788530070.113626:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f42167c00/0xb28d70e125750218 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530070.113634:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f42167c00/0xb28d70e125750218 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530070.113645:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f42167c00/0xb28d70e125750218 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530070.113661:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555703168:0@lo:101: 00000100:00100000:1.0:1788530070.113700:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530070.113718:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f3d103cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788530070.113733:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555703168 00000100:00100000:1.0:1788530070.113737:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555703168 00000100:00100000:1.0:1788530070.113761:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788530070.113767:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+18:6521:x1875409555703168:12345-0@lo:101: 00010000:00010000:1.0:1788530070.113775:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530070.113786:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f42167800/0xb28d70e12575021f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e125750218 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530070.113806:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f42167800/0xb28d70e12575021f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e125750218 expref: 19 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530070.113826:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f42167800/0xb28d70e12575021f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125750218 expref: 19 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530070.113835:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f42167800, rc 0) 00000100:00100000:1.0:1788530070.113862:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+19:6521:x1875409555703168:12345-0@lo:101: Request processed in 95us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530070.113868:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788530070.113898:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555703168:0@lo:101: 00010000:00010000:1.0:1788530070.113921:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f42167c00/0xb28d70e125750218 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575021f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530070.113931:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f42167c00/0xb28d70e125750218 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e12575021f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530070.113957:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555703296:0@lo:501: 00000100:00100000:1.0:1788530070.113977:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530070.113988:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f3d103cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788530070.113997:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555703296 00000100:00100000:1.0:1788530070.114000:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555703296 00000100:00100000:1.0:1788530070.114018:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788530070.114023:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+19:6521:x1875409555703296:12345-0@lo:501: 00000100:00100000:1.0:1788530070.114093:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+19:6521:x1875409555703296:12345-0@lo:501: Request processed in 69us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530070.114100:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788530070.114127:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555703296:0@lo:501: 00000100:00100000:1.0:1788530070.114148:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555703424:0@lo:503: 00000100:00100000:1.0:1788530070.114184:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530070.114197:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f3d103cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788530070.114208:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555703424 00000100:00100000:1.0:1788530070.114211:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555703424 00000100:00100000:1.0:1788530070.114230:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788530070.114235:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+19:6521:x1875409555703424:12345-0@lo:503: 00000100:00100000:1.0:1788530070.114300:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+19:6521:x1875409555703424:12345-0@lo:503: Request processed in 65us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530070.114307:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788530070.114343:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555703424:0@lo:503: 00000100:00100000:2.0:1788530070.121723:0:8294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f2b92fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:8294:1875409555703552:0@lo:502: 00000100:00100000:2.0:1788530070.121840:0:8294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530070.121894:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555703552 00000100:00100000:2.0:1788530070.121901:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555703552 00000100:00100000:2.0:1788530070.121972:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788530070.121985:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+19:8294:x1875409555703552:12345-0@lo:502: 00000100:00100000:2.0:1788530070.123416:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+19:8294:x1875409555703552:12345-0@lo:502: Request processed in 1418us (1563us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530070.123433:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788530070.123539:0:8294:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f08cdc900 going to sleep for 11 seconds 00000100:00100000:2.0:1788530070.123581:0:8294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f2b92fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:8294:1875409555703552:0@lo:502: 00000020:01000000:2.0:1788530070.123621:0:8294:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788530070.123631:0:8294:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788530070.125603:0:8294:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788530070.125703:0:8294:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a9f0aaed800 00000020:00000080:2.0:1788530070.125711:0:8294:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788530070.125795:0:8294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f2b92fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:8294:1875409555703680:0@lo:502: 00000100:00100000:2.0:1788530070.127289:0:8294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530070.127354:0:8294:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f08cdc900 going to sleep for 11 seconds 00000100:00100000:1.0:1788530070.127498:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555703680 00000100:00100000:1.0:1788530070.127511:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555703680 00000100:00100000:1.0:1788530070.127580:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788530070.127591:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+19:8294:x1875409555703680:12345-0@lo:502: 00000100:00100000:1.0:1788530070.127888:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+19:8294:x1875409555703680:12345-0@lo:502: Request processed in 298us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530070.127896:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788530070.128129:0:8294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f2b92fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:8294:1875409555703680:0@lo:502: 00000020:01000000:2.0:1788530070.128166:0:8294:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788530070.128279:0:8294:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788530070.128283:0:8294:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788530070.128288:0:8294:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1788530070.129777:0:6521:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1788530070.129796:0:6521:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788530070.129810:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f42167c00/0xb28d70e125750218 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575021f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530070.129824:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f42167c00/0xb28d70e125750218 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575021f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530070.721334:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788530071.616915:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555704064:0@lo:400: 00000100:00100000:0.0:1788530071.617095:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875409555703936:0@lo:400: 00000100:00100000:2.0:1788530071.617269:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3648:1875409555703808:0@lo:400: 00000100:00100000:2.0:1788530071.617315:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530071.617363:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555704320:0@lo:400: 00000100:00100000:2.0:1788530071.617393:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530071.617425:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788530071.617432:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875409555704192:0@lo:400: 00000100:00100000:2.0:1788530071.617470:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555703808 00000100:00100000:2.0:1788530071.617480:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555703808 00000100:00100000:2.0:1788530071.617546:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788530071.617581:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+19:3648:x1875409555703808:12345-0@lo:400: 00000100:00100000:0.0:1788530071.617757:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530071.617910:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555703936 00000100:00100000:3.0:1788530071.617916:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555703936 00000100:00100000:3.0:1788530071.617950:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788530071.617957:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d25b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875409555703936:12345-0@lo:400: 00000100:00100000:1.0:1788530071.618098:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530071.618151:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555704320 00000100:00100000:1.0:1788530071.618155:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555704320 00000100:00100000:1.0:1788530071.618185:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555704064 00000100:00100000:1.0:1788530071.618188:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555704064 00000100:00100000:1.0:1788530071.618201:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788530071.618207:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f2b92fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555704320:12345-0@lo:400: 00000100:00100000:1.0:1788530071.618243:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f2b92fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555704320:12345-0@lo:400: Request processed in 35us (849us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530071.618250:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788530071.618266:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788530071.618272:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32bd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555704064:12345-0@lo:400: 00000100:00100000:1.0:1788530071.618302:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32bd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555704064:12345-0@lo:400: Request processed in 30us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530071.618308:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788530071.618346:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555704064:0@lo:400: 00000100:00100000:1.0:1788530071.618552:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d25bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555704448:0@lo:41: 00000100:00100000:1.0:1788530071.618600:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530071.618731:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530071.618758:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555704320:0@lo:400: 00000100:00100000:2.0:1788530071.618875:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+19:3648:x1875409555703808:12345-0@lo:400: Request processed in 1319us (1558us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530071.618894:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788530071.619133:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3648:1875409555703808:0@lo:400: 00000100:00100000:3.0:1788530071.619324:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d25b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875409555703936:12345-0@lo:400: Request processed in 1366us (1565us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530071.619333:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788530071.619350:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555704192 00000100:00100000:3.0:1788530071.619361:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555704192 00000100:00100000:3.0:1788530071.619389:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788530071.619396:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d259180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875409555704192:12345-0@lo:400: 00000100:00100000:3.0:1788530071.619445:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d259180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875409555704192:12345-0@lo:400: Request processed in 49us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530071.619451:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1788530071.619526:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a9f32bd0700 x1875409555704192/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530087 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530071.619538:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875409555704192:0@lo:400: 00000100:00100000:0.0:1788530071.619770:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555704448 00000100:00100000:0.0:1788530071.619774:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555704448 00000100:00100000:0.0:1788530071.619916:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788530071.619924:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32bd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555704448:12345-0@lo:41: 00000004:00000024:0.0:1788530071.619955:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446547456 avail 1300307968 00000100:00100000:0.0:1788530071.620006:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32bd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555704448:12345-0@lo:41: Request processed in 83us (1405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530071.620013:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:1.0:1788530071.620058:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a9f32bd2d80 x1875409555703936/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530087 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530071.620069:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875409555703936:0@lo:400: 00000100:00100000:1.0:1788530071.620091:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d25bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555704448:0@lo:41: 00010000:00010000:1.0:1788530071.747926:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530072.769032:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788530073.324834:0:8430:0:(obd_mount.c:925:lmd_print()) mount data: 00000020:01000004:3.0:1788530073.324839:0:8430:0:(obd_mount.c:928:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1788530073.324840:0:8430:0:(obd_mount.c:931:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1788530073.324998:0:8430:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9a9f33b6f800 00000020:01000004:3.0:1788530073.325021:0:8430:0:(tgt_mount.c:2585:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1788530073.325036:0:8430:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788530073.325056:0:8430:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9a9f2c101988) 00000020:00000080:3.0:1788530073.325077:0:8430:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788530073.378025:0:8430:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1788530073.378092:0:8430:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:3.0:1788530073.431776:0:8430:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788530073.434581:0:8430:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788530073.434597:0:8430:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788530073.434612:0:8430:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xb28d70e12575022d 00000020:01000004:2.0:1788530073.434620:0:8430:0:(tgt_mount.c:2670:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1788530073.434645:0:8430:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.141@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788530073.434649:0:8430:0:(mgc_request.c:1372:mgc_set_info_async()) InitRecov MGC192.168.202.141@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788530073.434654:0:8430:0:(tgt_mount.c:1882:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788530073.434658:0:8430:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788530073.434691:0:8430:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9a9f33d93310) 00000020:00000080:2.0:1788530073.434705:0:8430:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:2.0:1788530073.440672:0:8430:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788530073.440872:0:8430:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788530073.440891:0:8430:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1788530073.443751:0:8430:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1788530073.443764:0:8430:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1788530073.458446:0:8430:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1788530073.458462:0:8430:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1788530073.460393:0:8430:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788530073.460660:0:8430:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1788530073.460666:0:8430:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1788530073.469789:0:8430:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1788530073.469814:0:8430:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1788530073.534250:0:8430:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788530073.534511:0:8430:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788530073.534519:0:8430:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1788530073.535863:0:8430:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788530073.535887:0:8430:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1788530073.537436:0:8430:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788530073.537450:0:8430:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1788530073.539772:0:8430:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788530073.539992:0:8430:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1788530073.539997:0:8430:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1788530073.540911:0:8430:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1788530073.540920:0:8430:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788530073.616781:0:8430:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788530073.617740:0:8430:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788530073.617749:0:8430:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788530073.622338:0:8430:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788530073.622356:0:8430:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1788530073.624123:0:8430:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1788530073.624238:0:8430:0:(tgt_mount.c:1482:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.141@tcp, index=0000, flags=0x20062 00000020:01000004:0.0:1788530073.624244:0:8430:0:(tgt_mount.c:1239:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788530073.624247:0:8430:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788530073.624248:0:8430:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788530073.624249:0:8430:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:0.0:1788530073.624250:0:8430:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:0.0:1788530073.624252:0:8430:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:0.0:1788530073.624253:0:8430:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788530073.624255:0:8430:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788530073.624257:0:8430:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788530073.624259:0:8430:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788530073.624261:0:8430:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788530073.624265:0:8430:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:0.0:1788530073.624267:0:8430:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788530073.624269:0:8430:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788530073.624270:0:8430:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788530073.624271:0:8430:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:0.0:1788530073.624272:0:8430:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:0.0:1788530073.624274:0:8430:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:0.0:1788530073.624275:0:8430:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788530073.624276:0:8430:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788530073.624277:0:8430:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788530073.624277:0:8430:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788530073.624278:0:8430:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788530073.624929:0:8430:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788530073.624952:0:8430:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d25a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:8430:1875409555704576:0@lo:253: 00000100:00100000:0.0:1788530073.625039:0:8430:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530073.625429:0:8430:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f02d85840 going to sleep for 11 seconds 00000100:00100000:1.0:1788530073.629636:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555704576 00000100:00100000:1.0:1788530073.629654:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555704576 00000100:00100000:1.0:1788530073.629763:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788530073.629775:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+19:8430:x1875409555704576:12345-0@lo:253: 20000000:01000000:1.0:1788530073.629850:0:6517:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788530073.629855:0:6517:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1788530073.629861:0:6517:0:(mgs_llog.c:875:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1788530073.629864:0:6517:0:(mgs_llog.c:3868:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1788530073.631481:0:6517:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788530073.631703:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:1.0:1788530073.631720:0:6517:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1788530073.631738:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:1.0:1788530073.631747:0:6517:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1788530073.631761:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:1.0:1788530073.631776:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:1.0:1788530073.633077:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1788530073.633106:0:6517:0:(mgs_llog.c:3821:mgs_write_log_osc_to_lov()) add nid 192.168.202.141@tcp 20000000:01000000:1.0:1788530073.633108:0:6517:0:(mgs_llog.c:1545:record_base_raw()) lcfg (null) 0xcf005 192.168.202.141@tcp (null) (null) (null) 00000040:00080000:1.0:1788530073.633853:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1788530073.633871:0:6517:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788530073.633980:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1788530073.633989:0:6517:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.202.141@tcp (null) (null) 00000040:00080000:1.0:1788530073.634003:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1788530073.634011:0:6517:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1788530073.634041:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:1.0:1788530073.634114:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1788530073.634286:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:1.0:1788530073.634460:0:6517:0:(mgs_llog.c:3821:mgs_write_log_osc_to_lov()) add nid 192.168.202.141@tcp 20000000:01000000:1.0:1788530073.634463:0:6517:0:(mgs_llog.c:1545:record_base_raw()) lcfg (null) 0xcf005 192.168.202.141@tcp (null) (null) (null) 00000040:00080000:1.0:1788530073.634484:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:1.0:1788530073.634492:0:6517:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788530073.634507:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:1.0:1788530073.634513:0:6517:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.202.141@tcp (null) (null) 00000040:00080000:1.0:1788530073.634525:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:1.0:1788530073.634531:0:6517:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1788530073.634545:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:1.0:1788530073.634980:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:1.0:1788530073.637008:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:1.0:1788530073.637041:0:6517:0:(mgs_llog.c:3821:mgs_write_log_osc_to_lov()) add nid 192.168.202.141@tcp 20000000:01000000:1.0:1788530073.637045:0:6517:0:(mgs_llog.c:1545:record_base_raw()) lcfg (null) 0xcf005 192.168.202.141@tcp (null) (null) (null) 00000040:00080000:1.0:1788530073.637231:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:1.0:1788530073.637240:0:6517:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1788530073.637253:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:1.0:1788530073.637260:0:6517:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.202.141@tcp (null) (null) 00000040:00080000:1.0:1788530073.637275:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:1.0:1788530073.637282:0:6517:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1788530073.637296:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:1.0:1788530073.637726:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:1.0:1788530073.637744:0:6517:0:(mgs_llog.c:5258:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788530073.637748:0:6517:0:(mgs_llog.c:4754:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788530073.637751:0:6517:0:(mgs_llog.c:4187:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788530073.638215:0:6517:0:(mgs_llog.c:2556:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788530073.638218:0:6517:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788530073.640431:0:8449:0:(mgs_llog.c:1082:mgs_modify_handler()) Changing rec 27 marker 18 1->4: lustre sys.timeout 20000000:01000000:3.0:1788530073.640476:0:8449:0:(mgs_llog.c:1082:mgs_modify_handler()) Changing rec 29 marker 18 2->4: lustre sys.timeout 00000040:00080000:3.0:1788530073.640506:0:8449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1788530073.640794:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:1.0:1788530073.640910:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:1.0:1788530073.640939:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:1.0:1788530073.640950:0:6517:0:(mgs_llog.c:2556:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1788530073.640952:0:6517:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788530073.641669:0:8450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1788530073.641827:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1788530073.641845:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:1.0:1788530073.641860:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:1.0:1788530073.641870:0:6517:0:(mgs_llog.c:2556:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788530073.641873:0:6517:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788530073.642432:0:8451:0:(mgs_llog.c:1082:mgs_modify_handler()) Changing rec 22 marker 19 1->4: lustre sys.timeout 20000000:01000000:3.0:1788530073.642463:0:8451:0:(mgs_llog.c:1082:mgs_modify_handler()) Changing rec 24 marker 19 2->4: lustre sys.timeout 00000040:00080000:3.0:1788530073.642479:0:8451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1788530073.642621:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1788530073.642641:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1788530073.642656:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:1.0:1788530073.642665:0:6517:0:(mgs_llog.c:2556:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1788530073.642667:0:6517:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788530073.643170:0:8452:0:(mgs_llog.c:1082:mgs_modify_handler()) Changing rec 22 marker 20 1->4: lustre sys.timeout 20000000:01000000:3.0:1788530073.643196:0:8452:0:(mgs_llog.c:1082:mgs_modify_handler()) Changing rec 24 marker 20 2->4: lustre sys.timeout 00000040:00080000:3.0:1788530073.643211:0:8452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:1.0:1788530073.643488:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:1.0:1788530073.643510:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:1.0:1788530073.643524:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 10000000:01000000:1.0:1788530073.643540:0:6517:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788530073.643591:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a9f42166400/0xb28d70e12575023b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530073.643613:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a9f00031800/0xb28d70e1257500dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e1257500d6 expref: 19 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530073.643622:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a9f42167e00/0xb28d70e125750107 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125750100 expref: 19 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530073.643628:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a9f00031e00/0xb28d70e12575017e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125750177 expref: 19 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530073.643635:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a9f0c91cc00/0xb28d70e1257501b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e1257501af expref: 19 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530073.643642:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a9f0c91d200/0xb28d70e1257501d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e1257501cb expref: 19 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530073.643658:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a9f0c91d000/0xb28d70e1257501fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e1257501f5 expref: 19 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530073.643667:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a9f42166400/0xb28d70e12575023b lrc: 9/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530073.643715:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a9f0c91d000/0xb28d70e1257501fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb28d70e1257501f5 expref: 19 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530073.643734:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a9f0c91d000/0xb28d70e1257501fc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb28d70e1257501f5 expref: 19 pid: 6518 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530073.643751:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd2d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6517:1875409555704704:0@lo:104: 00000100:00100000:1.0:1788530073.643924:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788530073.643976:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a9f0c91d200/0xb28d70e1257501d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb28d70e1257501cb expref: 19 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530073.643985:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a9f0c91d200/0xb28d70e1257501d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb28d70e1257501cb expref: 19 pid: 6516 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530073.643994:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd2a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6517:1875409555704832:0@lo:104: 00000100:00100000:1.0:1788530073.644016:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788530073.644598:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a9f0c91cc00/0xb28d70e1257501b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb28d70e1257501af expref: 19 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530073.644609:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a9f0c91cc00/0xb28d70e1257501b6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb28d70e1257501af expref: 19 pid: 6516 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530073.644620:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd3800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6517:1875409555704960:0@lo:104: 00000100:00100000:1.0:1788530073.644651:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788530073.645069:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a9f00031e00/0xb28d70e12575017e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb28d70e125750177 expref: 19 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530073.645078:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a9f00031e00/0xb28d70e12575017e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb28d70e125750177 expref: 19 pid: 6517 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530073.645087:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d25ad80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6517:1875409555705088:0@lo:104: 00000100:00100000:0.0:1788530073.645110:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530073.645133:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555704704 00000100:00100000:2.0:1788530073.645141:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555704704 00000100:00100000:3.0:1788530073.645434:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555704832 00000100:00100000:3.0:1788530073.645439:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555704832 00000100:00100000:3.0:1788530073.645472:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555704960 00000100:00100000:3.0:1788530073.645480:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555704960 00000100:00100000:3.0:1788530073.645493:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788530073.645501:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32bd1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+5:6517:x1875409555704832:12345-0@lo:104: 00010000:00010000:3.0:1788530073.645514:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff9a9f42166800/0xb28d70e1257501cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e1257501d2 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530073.645588:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788530073.645595:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32bd1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+5:6517:x1875409555704832:12345-0@lo:104: Request processed in 94us (1578us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530073.645602:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788530073.645618:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788530073.645624:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32bd1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+4:6517:x1875409555704960:12345-0@lo:104: 00010000:00010000:3.0:1788530073.645631:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff9a9f18140400/0xb28d70e1257501af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e1257501b6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530073.645659:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788530073.645663:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32bd1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+4:6517:x1875409555704960:12345-0@lo:104: Request processed in 40us (1012us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530073.645669:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:2.0:1788530073.645721:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788530073.645729:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f42166800/0xb28d70e1257501cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e1257501d2 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530073.645738:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f42166800 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:2.0:1788530073.645743:0:6512:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f42166800/0xb28d70e1257501cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xb28d70e1257501d2 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530073.645763:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f42166800/0xb28d70e1257501cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xb28d70e1257501d2 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788530073.645771:0:6512:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f42166800/0xb28d70e1257501cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xb28d70e1257501d2 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788530073.645777:0:6512:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788530073.645821:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9f42166800/0xb28d70e1257501cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e1257501d2 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530073.645828:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788530073.645846:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f42166800/0xb28d70e1257501cb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e1257501d2 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530073.645854:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f42166800/0xb28d70e1257501cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e1257501d2 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530073.645869:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788530073.645872:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f18140400/0xb28d70e1257501af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e1257501b6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530073.645887:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f18140400 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:2.0:1788530073.645890:0:6512:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f18140400/0xb28d70e1257501af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xb28d70e1257501b6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530073.645896:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f18140400/0xb28d70e1257501af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xb28d70e1257501b6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788530073.645901:0:6512:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f18140400/0xb28d70e1257501af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xb28d70e1257501b6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788530073.645910:0:6512:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788530073.645923:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9f18140400/0xb28d70e1257501af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e1257501b6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530073.645929:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788530073.645941:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f18140400/0xb28d70e1257501af lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e1257501b6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530073.645947:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f18140400/0xb28d70e1257501af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e1257501b6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530073.645957:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530073.645958:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530073.645959:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788530073.646070:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f2b92ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3647:1875409555705344:0@lo:103: 00000100:00100000:3.0:1788530073.646098:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530073.646262:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555705344 00000100:00100000:2.0:1788530073.646266:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555705344 00010000:00010000:2.0:1788530073.646288:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a9f0c91cc00/0xb28d70e1257501b6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e1257501af expref: 20 pid: 6516 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530073.646361:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788530073.646368:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788530073.646376:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f2b92c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3649:1875409555705216:0@lo:103: 00000100:00100000:1.0:1788530073.646400:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788530073.646816:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a9f42167e00/0xb28d70e125750107 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb28d70e125750100 expref: 20 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530073.646829:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a9f42167e00/0xb28d70e125750107 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb28d70e125750100 expref: 20 pid: 6517 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530073.646839:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d258700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6517:1875409555705472:0@lo:104: 00000100:00100000:0.0:1788530073.646862:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788530073.646876:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a9f00031800/0xb28d70e1257500dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb28d70e1257500d6 expref: 20 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530073.646894:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a9f00031800/0xb28d70e1257500dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb28d70e1257500d6 expref: 20 pid: 6517 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530073.646903:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d258e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6517:1875409555705600:0@lo:104: 00000100:00100000:0.0:1788530073.646924:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530073.646931:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f32ae9240 going to sleep for 11 seconds 00000100:00100000:0.0:1788530073.646949:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd2a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6517:1875409555704832:0@lo:104: 00000100:00100000:0.0:1788530073.646966:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd3800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6517:1875409555704960:0@lo:104: 00000100:00100000:0.0:1788530073.647020:0:6507:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788530073.647030:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555705088 00000100:00100000:0.0:1788530073.647033:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555705088 00000100:00100000:0.0:1788530073.647045:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555705472 00000100:00100000:0.0:1788530073.647058:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555705472 00000100:00100000:0.0:1788530073.647066:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555705600 00000100:00100000:0.0:1788530073.647068:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555705600 00000100:00100000:0.0:1788530073.647078:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788530073.647085:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32bd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+6:6517:x1875409555704704:12345-0@lo:104: 00010000:00010000:0.0:1788530073.647095:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d600/0xb28d70e1257501f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e1257501fc expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530073.647130:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788530073.647136:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32bd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+6:6517:x1875409555704704:12345-0@lo:104: Request processed in 51us (3214us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530073.647151:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788530073.647166:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788530073.647171:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d259f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+5:6517:x1875409555705088:12345-0@lo:104: 00010000:00010000:0.0:1788530073.647178:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff9a9f18140e00/0xb28d70e125750177 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e12575017e expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530073.647203:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788530073.647208:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d259f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+5:6517:x1875409555705088:12345-0@lo:104: Request processed in 37us (2098us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530073.647213:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788530073.647222:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788530073.647227:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d25bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+4:6517:x1875409555705472:12345-0@lo:104: 00010000:00010000:0.0:1788530073.647241:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d400/0xb28d70e125750100 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e125750107 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530073.647262:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788530073.647266:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d25bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+4:6517:x1875409555705472:12345-0@lo:104: Request processed in 39us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530073.647272:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788530073.647283:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788530073.647288:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d108450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+3:6517:x1875409555705600:12345-0@lo:104: 00010000:00010000:0.0:1788530073.647294:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91c800/0xb28d70e1257500d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e1257500dd expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530073.647535:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1788530073.647540:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d108450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+3:6517:x1875409555705600:12345-0@lo:104: Request processed in 252us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530073.647546:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:0.0:1788530073.647595:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788530073.647601:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d600/0xb28d70e1257501f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e1257501fc expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530073.647609:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f0c91d600 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:0.0:1788530073.647613:0:6511:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d600/0xb28d70e1257501f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xb28d70e1257501fc expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530073.647621:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d600/0xb28d70e1257501f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xb28d70e1257501fc expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788530073.647628:0:6511:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d600/0xb28d70e1257501f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xb28d70e1257501fc expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788530073.647639:0:6511:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788530073.647666:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d600/0xb28d70e1257501f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e1257501fc expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530073.647673:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788530073.647685:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d600/0xb28d70e1257501f5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e1257501fc expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530073.647692:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d600/0xb28d70e1257501f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e1257501fc expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530073.647704:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788530073.647707:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f18140e00/0xb28d70e125750177 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e12575017e expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530073.647712:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f18140e00 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:0.0:1788530073.647715:0:6511:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f18140e00/0xb28d70e125750177 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb28d70e12575017e expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530073.647722:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f18140e00/0xb28d70e125750177 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb28d70e12575017e expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788530073.647729:0:6511:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f18140e00/0xb28d70e125750177 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb28d70e12575017e expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788530073.647733:0:6511:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788530073.647742:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9f18140e00/0xb28d70e125750177 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e12575017e expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530073.647747:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788530073.647760:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f18140e00/0xb28d70e125750177 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e12575017e expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530073.647766:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f18140e00/0xb28d70e125750177 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e12575017e expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530073.647774:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788530073.647777:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d400/0xb28d70e125750100 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e125750107 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530073.647782:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f0c91d400 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:0.0:1788530073.647785:0:6511:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d400/0xb28d70e125750100 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb28d70e125750107 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530073.647791:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d400/0xb28d70e125750100 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb28d70e125750107 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788530073.647857:0:6511:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d400/0xb28d70e125750100 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb28d70e125750107 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788530073.647862:0:6511:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788530073.647894:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d400/0xb28d70e125750100 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125750107 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530073.647900:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788530073.647907:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d400/0xb28d70e125750100 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125750107 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530073.647912:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d400/0xb28d70e125750100 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125750107 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530073.647921:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788530073.647928:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91c800/0xb28d70e1257500d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e1257500dd expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530073.647933:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f0c91c800 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:0.0:1788530073.647936:0:6511:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91c800/0xb28d70e1257500d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb28d70e1257500dd expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530073.647942:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91c800/0xb28d70e1257500d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb28d70e1257500dd expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788530073.647947:0:6511:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91c800/0xb28d70e1257500d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb28d70e1257500dd expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788530073.647952:0:6511:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788530073.647965:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91c800/0xb28d70e1257500d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e1257500dd expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530073.647971:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788530073.647976:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91c800/0xb28d70e1257500d6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e1257500dd expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530073.647984:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91c800/0xb28d70e1257500d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e1257500dd expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530073.647999:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530073.648001:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530073.648002:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788530073.648019:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d259f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3648:1875409555705728:0@lo:103: 00000100:00100000:0.0:1788530073.648116:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3735ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3650:1875409555705984:0@lo:103: 00010000:00010000:0.0:1788530073.648231:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788530073.648268:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd2d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6517:1875409555704704:0@lo:104: 00000100:00100000:0.0:1788530073.648279:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d25ad80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6517:1875409555705088:0@lo:104: 00000100:00100000:0.0:1788530073.648288:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d258700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6517:1875409555705472:0@lo:104: 00000100:00100000:0.0:1788530073.648295:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d258e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6517:1875409555705600:0@lo:104: 00010000:00010000:0.0:1788530073.648540:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a9f42166400/0xb28d70e12575023b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530073.650032:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530073.650110:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555705216 00000100:00100000:2.0:1788530073.650124:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555705216 00010000:00010000:2.0:1788530073.650203:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a9f0c91d200/0xb28d70e1257501d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e1257501cb expref: 21 pid: 6516 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530073.650238:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788530073.650251:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f328e6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+21:3647:x1875409555705344:12345-0@lo:103: 00010000:00010000:2.0:1788530073.650271:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788530073.650280:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a9f0c91cc00/0xb28d70e1257501b6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e1257501af expref: 21 pid: 6516 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530073.650315:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a9f0c91cc00/0xb28d70e1257501b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb28d70e1257501af expref: 21 pid: 6516 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530073.650335:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f0c91cc00/0xb28d70e1257501b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb28d70e1257501af expref: 21 pid: 6516 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530073.650357:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788530073.650438:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f328e6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+20:3647:x1875409555705344:12345-0@lo:103: Request processed in 189us (4338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530073.650446:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788530073.650469:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788530073.650476:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32bd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+19:3649:x1875409555705216:12345-0@lo:103: 00010000:00010000:2.0:1788530073.650483:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788530073.650487:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a9f0c91d200/0xb28d70e1257501d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e1257501cb expref: 19 pid: 6516 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530073.650495:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a9f0c91d200/0xb28d70e1257501d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb28d70e1257501cb expref: 19 pid: 6516 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530073.650506:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f0c91d200/0xb28d70e1257501d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb28d70e1257501cb expref: 19 pid: 6516 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530073.650514:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788530073.650537:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32bd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+18:3649:x1875409555705216:12345-0@lo:103: Request processed in 63us (4137us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530073.650543:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788530073.650838:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3735df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3647:1875409555706112:0@lo:103: 00000100:00100000:2.0:1788530073.651213:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555705984 00000100:00100000:2.0:1788530073.651219:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555705984 00010000:00010000:2.0:1788530073.651245:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a9f42167e00/0xb28d70e125750107 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e125750100 expref: 18 pid: 6517 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530073.651265:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788530073.651272:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32bd2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+18:3650:x1875409555705984:12345-0@lo:103: 00010000:00010000:2.0:1788530073.651281:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788530073.651285:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a9f42167e00/0xb28d70e125750107 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e125750100 expref: 18 pid: 6517 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530073.651294:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a9f42167e00/0xb28d70e125750107 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb28d70e125750100 expref: 18 pid: 6517 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530073.651317:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f42167e00/0xb28d70e125750107 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb28d70e125750100 expref: 18 pid: 6517 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530073.651328:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788530073.651358:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32bd2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+17:3650:x1875409555705984:12345-0@lo:103: Request processed in 87us (1333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530073.651365:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788530073.651464:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530073.651516:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530073.651546:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f2b92ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3647:1875409555705344:0@lo:103: 00000100:00100000:3.0:1788530073.651595:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555705728 00000100:00100000:3.0:1788530073.651599:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555705728 00010000:00010000:3.0:1788530073.651623:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a9f0c91d000/0xb28d70e1257501fc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e1257501f5 expref: 17 pid: 6518 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530073.651637:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555706112 00000100:00100000:3.0:1788530073.651640:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555706112 00010000:00010000:3.0:1788530073.651651:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a9f00031800/0xb28d70e1257500dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e1257500d6 expref: 18 pid: 6517 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530073.651664:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788530073.651671:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f328e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+18:3648:x1875409555705728:12345-0@lo:103: 00010000:00010000:3.0:1788530073.651679:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788530073.651684:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a9f0c91d000/0xb28d70e1257501fc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e1257501f5 expref: 18 pid: 6518 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530073.651693:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a9f0c91d000/0xb28d70e1257501fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb28d70e1257501f5 expref: 18 pid: 6518 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530073.651704:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f0c91d000/0xb28d70e1257501fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb28d70e1257501f5 expref: 18 pid: 6518 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530073.651713:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788530073.651742:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f328e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+17:3648:x1875409555705728:12345-0@lo:103: Request processed in 72us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530073.651749:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788530073.651762:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788530073.651768:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f328e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+16:3647:x1875409555706112:12345-0@lo:103: 00010000:00010000:3.0:1788530073.651776:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788530073.651780:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a9f00031800/0xb28d70e1257500dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e1257500d6 expref: 16 pid: 6517 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530073.651868:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a9f00031800/0xb28d70e1257500dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb28d70e1257500d6 expref: 16 pid: 6517 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530073.651888:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f00031800/0xb28d70e1257500dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb28d70e1257500d6 expref: 16 pid: 6517 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530073.651897:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788530073.651926:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f328e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+15:3647:x1875409555706112:12345-0@lo:103: Request processed in 158us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530073.651933:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788530073.651959:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d259f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3648:1875409555705728:0@lo:103: 00000100:00100000:3.0:1788530073.651981:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3735df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3647:1875409555706112:0@lo:103: 00000100:00100000:1.0:1788530073.652068:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3735ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3650:1875409555705984:0@lo:103: 00000100:00100000:1.0:1788530073.652081:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788530073.652089:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d25bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3650:1875409555705856:0@lo:103: 00000100:00100000:1.0:1788530073.652118:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530073.652277:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555705856 00000100:00100000:3.0:1788530073.652281:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555705856 00010000:00010000:3.0:1788530073.652313:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a9f00031e00/0xb28d70e12575017e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e125750177 expref: 15 pid: 6517 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530073.652333:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788530073.652340:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f396c1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+15:3650:x1875409555705856:12345-0@lo:103: 00010000:00010000:3.0:1788530073.652348:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788530073.652352:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a9f00031e00/0xb28d70e12575017e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e125750177 expref: 15 pid: 6517 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530073.652362:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a9f00031e00/0xb28d70e12575017e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb28d70e125750177 expref: 15 pid: 6517 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530073.652373:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f00031e00/0xb28d70e12575017e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb28d70e125750177 expref: 15 pid: 6517 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530073.652392:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a9f42166400/0xb28d70e12575023b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530073.652403:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f42166400/0xb28d70e12575023b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530073.652420:0:6510:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a9f42166400/0xb28d70e12575023b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530073.652428:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a9f42166400/0xb28d70e12575023b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530073.652435:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a9f42166400/0xb28d70e12575023b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530073.652442:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a9f42166400/0xb28d70e12575023b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530073.652448:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f42166400 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:3.0:1788530073.652454:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a9f42166400/0xb28d70e12575023b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530073.652463:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a9f42166400/0xb28d70e12575023b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530073.652480:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a9f42166400/0xb28d70e12575023b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530073.652493:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788530073.652518:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f396c1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+14:3650:x1875409555705856:12345-0@lo:103: Request processed in 179us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530073.652533:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:3.0:1788530073.652604:0:6517:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a9f42166400/0xb28d70e12575023b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530073.652614:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a9f42166400/0xb28d70e12575023b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530073.652620:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f42166400/0xb28d70e12575023b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788530073.652639:0:6517:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1788530073.653945:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d25bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3650:1875409555705856:0@lo:103: 00000100:00100000:1.0:1788530073.654010:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f2b92c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3649:1875409555705216:0@lo:103: 00000100:00100000:0.0:1788530073.656075:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+13:8430:x1875409555704576:12345-0@lo:253: Request processed in 26295us (31029us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530073.656089:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788530073.656380:0:8430:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d25a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:8430:1875409555704576:0@lo:253: 10000000:01000000:2.0:1788530073.656398:0:8430:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788530073.656401:0:8430:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788530073.656403:0:8430:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788530073.656405:0:8430:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788530073.656406:0:8430:0:(tgt_mount.c:1242:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1788530073.656408:0:8430:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:2.0:1788530073.656409:0:8430:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:2.0:1788530073.656411:0:8430:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788530073.656413:0:8430:0:(tgt_mount.c:1260:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788530073.656416:0:8430:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788530073.656417:0:8430:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788530073.656442:0:8430:0:(tgt_mount.c:115:server_register_mount()) register mount ffff9a9f33b6f800 from lustre-OST0000 10000000:01000000:2.0:1788530073.656492:0:8430:0:(mgc_request.c:2342:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1788530073.656496:0:8430:0:(mgc_request.c:424:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788530073.656504:0:8430:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9a9f33b6f800 10000000:01000000:2.0:1788530073.656511:0:8430:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788530073.656545:0:8430:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.202.141@tcp: setup lustre-OST0000-osd 00000040:01000000:2.0:1788530073.668125:0:8430:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.141@tcp ctxt 1 is initialized 00000040:01000000:1.0:1788530073.679482:0:8430:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.141@tcp ctxt 0 is initialized 10000000:01000000:1.0:1788530073.679501:0:8430:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-sptlrpc-ffff9a9f33b6f800 from 1 10000000:01000000:1.0:1788530073.679505:0:8430:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788530073.679544:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f42166800/0xb28d70e125750242 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530073.679558:0:8430:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f42166800/0xb28d70e125750242 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530073.679597:0:8430:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f42166800/0xb28d70e125750242 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530073.679624:0:8430:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:8430:1875409555706240:0@lo:101: 00000100:00100000:1.0:1788530073.679695:0:8430:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530073.679738:0:8430:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f32ae9240 going to sleep for 11 seconds 00000100:00100000:2.0:1788530073.680293:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555706240 00000100:00100000:2.0:1788530073.680471:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555706240 00000100:00100000:2.0:1788530073.680550:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788530073.680585:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+13:8430:x1875409555706240:12345-0@lo:101: 00010000:00010000:2.0:1788530073.680602:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530073.680621:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f18140400/0xb28d70e125750249 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e125750242 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530073.680646:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f18140400/0xb28d70e125750249 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e125750242 expref: 14 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530073.680658:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f18140400/0xb28d70e125750249 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125750242 expref: 14 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530073.680668:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f18140400, rc 0) 00000100:00100000:2.0:1788530073.680734:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+14:8430:x1875409555706240:12345-0@lo:101: Request processed in 175us (1039us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530073.680741:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788530073.681289:0:8430:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:8430:1875409555706240:0@lo:101: 00010000:00010000:3.0:1788530073.681381:0:8430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f42166800/0xb28d70e125750242 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125750249 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530073.681393:0:8430:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f42166800/0xb28d70e125750242 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e125750249 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530073.681492:0:8430:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:8430:1875409555706368:0@lo:501: 00000100:00100000:3.0:1788530073.681530:0:8430:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530073.681594:0:8430:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f32b9f240 going to sleep for 11 seconds 00000100:00100000:1.0:1788530073.681665:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555706368 00000100:00100000:1.0:1788530073.681682:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555706368 00000100:00100000:1.0:1788530073.681719:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788530073.681727:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+14:8430:x1875409555706368:12345-0@lo:501: 00000100:00100000:1.0:1788530073.681791:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+14:8430:x1875409555706368:12345-0@lo:501: Request processed in 65us (261us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788530073.681871:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788530073.682244:0:8430:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:8430:1875409555706368:0@lo:501: 10000000:01000000:3.0:1788530073.682259:0:8430:0:(mgc_request_server.c:748:mgc_llog_local_copy()) MGC192.168.202.141@tcp: no remote llog for lustre-sptlrpc, check MGS config 00000100:00100000:3.0:1788530073.682295:0:8430:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:8430:1875409555706496:0@lo:501: 00000100:00100000:3.0:1788530073.682491:0:8430:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530073.682516:0:8430:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f32b9f240 going to sleep for 11 seconds 00000100:00100000:1.0:1788530073.682654:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555706496 00000100:00100000:1.0:1788530073.682660:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555706496 00000100:00100000:1.0:1788530073.682726:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788530073.682734:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+14:8430:x1875409555706496:12345-0@lo:501: 00000100:00100000:1.0:1788530073.682790:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+14:8430:x1875409555706496:12345-0@lo:501: Request processed in 57us (298us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788530073.682809:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788530073.682921:0:8430:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:8430:1875409555706496:0@lo:501: 10000000:01000000:3.0:1788530073.685016:0:8430:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788530073.685040:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f42166800/0xb28d70e125750242 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125750249 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530073.685062:0:8430:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f42166800/0xb28d70e125750242 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125750249 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788530073.685074:0:8430:0:(mgc_request.c:206:do_config_log_add()) do adding config log params-ffff9a9f33b6f800 10000000:01000000:3.0:1788530073.685081:0:8430:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788530073.685107:0:8430:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.202.141@tcp: setup lustre-OST0000-osd 00000040:01000000:3.0:1788530073.685216:0:8430:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.141@tcp ctxt 1 is initialized 00000040:01000000:3.0:1788530073.685225:0:8430:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.141@tcp ctxt 0 is initialized 10000000:01000000:3.0:1788530073.685233:0:8430:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788530073.685237:0:8430:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788530073.685253:0:8430:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.202.141@tcp: setup lustre-OST0000-osd 00000040:01000000:3.0:1788530073.685380:0:8430:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.141@tcp ctxt 1 is initialized 00000040:01000000:3.0:1788530073.685385:0:8430:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.141@tcp ctxt 0 is initialized 10000000:01000000:3.0:1788530073.685392:0:8430:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-mdtir-ffff9a9f33b6f800 10000000:01000000:3.0:1788530073.685396:0:8430:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788530073.685426:0:8430:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788530073.685431:0:8430:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788530073.685473:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d000/0xb28d70e125750250 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530073.685483:0:8430:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d000/0xb28d70e125750250 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530073.685498:0:8430:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d000/0xb28d70e125750250 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530073.685524:0:8430:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:8430:1875409555706624:0@lo:101: 00000100:00100000:3.0:1788530073.685629:0:8430:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530073.693080:0:8430:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f32b9fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788530073.693940:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555706624 00000100:00100000:2.0:1788530073.693951:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555706624 00000100:00100000:1.0:1788530073.694667:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788530073.694683:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+14:8430:x1875409555706624:12345-0@lo:101: 00010000:00010000:1.0:1788530073.694700:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530073.694720:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f42167600/0xb28d70e125750257 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e125750250 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530073.694752:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f42167600/0xb28d70e125750257 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e125750250 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530073.694765:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f42167600/0xb28d70e125750257 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125750250 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530073.694776:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f42167600, rc 0) 00000100:00100000:1.0:1788530073.694889:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+15:8430:x1875409555706624:12345-0@lo:101: Request processed in 202us (9250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530073.694916:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788530073.695038:0:8430:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:8430:1875409555706624:0@lo:101: 00010000:00010000:3.0:1788530073.695066:0:8430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d000/0xb28d70e125750250 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125750257 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530073.695077:0:8430:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d000/0xb28d70e125750250 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e125750257 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530073.695182:0:8430:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:8430:1875409555706752:0@lo:501: 00000100:00100000:3.0:1788530073.695219:0:8430:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530073.695725:0:8430:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f32b9fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788530073.695793:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555706752 00000100:00100000:0.0:1788530073.695808:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555706752 00000100:00100000:0.0:1788530073.695842:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788530073.695850:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+15:8430:x1875409555706752:12345-0@lo:501: 00000100:00100000:0.0:1788530073.695988:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+15:8430:x1875409555706752:12345-0@lo:501: Request processed in 138us (768us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530073.695996:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788530073.696175:0:8430:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:8430:1875409555706752:0@lo:501: 00000100:00100000:3.0:1788530073.696211:0:8430:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:8430:1875409555706880:0@lo:503: 00000100:00100000:3.0:1788530073.696255:0:8430:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530073.696278:0:8430:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f32b9fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788530073.696433:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555706880 00000100:00100000:0.0:1788530073.696438:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555706880 00000100:00100000:0.0:1788530073.696456:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788530073.696462:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+15:8430:x1875409555706880:12345-0@lo:503: 00000100:00100000:0.0:1788530073.696550:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+15:8430:x1875409555706880:12345-0@lo:503: Request processed in 87us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530073.696557:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788530073.696653:0:8430:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:8430:1875409555706880:0@lo:503: 00000040:00080000:3.0:1788530073.697444:0:8430:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788530073.697532:0:8430:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:8430:1875409555707008:0@lo:502: 00000100:00100000:3.0:1788530073.697623:0:8430:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530073.697658:0:8430:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f32b9fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788530073.697750:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555707008 00000100:00100000:0.0:1788530073.697756:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555707008 00000100:00100000:0.0:1788530073.697781:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788530073.697817:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+15:8430:x1875409555707008:12345-0@lo:502: 00000100:00100000:0.0:1788530073.697926:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+15:8430:x1875409555707008:12345-0@lo:502: Request processed in 110us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530073.697934:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788530073.698242:0:8430:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:8430:1875409555707008:0@lo:502: 00000040:00080000:3.0:1788530073.698630:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788530073.698662:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1788530073.698675:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1788530073.698685:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1788530073.698706:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1788530073.698719:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1788530073.698746:0:8430:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:8430:1875409555707136:0@lo:502: 00000100:00100000:3.0:1788530073.698791:0:8430:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530073.698986:0:8430:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f32b9fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788530073.699072:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555707136 00000100:00100000:2.0:1788530073.699078:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555707136 00000100:00100000:0.0:1788530073.699487:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788530073.699497:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+15:8430:x1875409555707136:12345-0@lo:502: 00000100:00100000:0.0:1788530073.699634:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+15:8430:x1875409555707136:12345-0@lo:502: Request processed in 138us (842us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530073.699642:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788530073.699899:0:8430:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:8430:1875409555707136:0@lo:502: 00000040:00080000:2.0:1788530073.699968:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1788530073.699983:0:8430:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1788530073.700656:0:8453:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788530073.700664:0:8453:0:(obd_mount.c:963:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:1.0:1788530073.700672:0:8453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788530073.700675:0:8453:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1788530073.700682:0:8453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788530073.700697:0:8453:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9a9f2c149988) 00000020:00000080:1.0:1788530073.700719:0:8453:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788530073.700727:0:8453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788530073.700891:0:8453:0:(tgt_mount.c:167:server_get_mount()) get mount ffff9a9f33b6f800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1788530073.700902:0:8453:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788530073.700910:0:8453:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xb28d70e125750265 00010000:00010000:1.0:1788530073.715792:0:8453:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:1.0:1788530073.718607:0:8453:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:0.0:1788530073.724421:0:8453:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1788530073.727458:0:8453:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:0.0:1788530073.734170:0:8453:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:0.0:1788530073.734735:0:8453:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:1.0:1788530073.751102:0:8453:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:1.0:1788530073.755273:0:8453:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1788530073.755294:0:8453:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788530073.755374:0:8453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788530073.755376:0:8453:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1788530073.755382:0:8453:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788530073.755388:0:8453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788530073.755389:0:8453:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788530073.755393:0:8453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788530073.755396:0:8453:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788530073.755429:0:8453:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788530073.755432:0:8453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788530073.755433:0:8453:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788530073.755437:0:8453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1788530073.755739:0:8430:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:2.0:1788530073.755757:0:8430:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788530073.755781:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d000/0xb28d70e125750250 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125750257 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530073.755795:0:8430:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d000/0xb28d70e125750250 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125750257 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788530073.755803:0:8430:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-mdtir-ffff9a9f33b6f800 from 1 10000000:01000000:2.0:1788530073.755806:0:8430:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788530073.755844:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f18140a00/0xb28d70e12575026c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530073.755851:0:8430:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f18140a00/0xb28d70e12575026c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530073.755863:0:8430:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f18140a00/0xb28d70e12575026c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530073.755898:0:8430:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f2b92d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:8430:1875409555707264:0@lo:101: 00000100:00100000:2.0:1788530073.755964:0:8430:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530073.756012:0:8430:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f3d311180 going to sleep for 11 seconds 00000100:00100000:0.0:1788530073.756921:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555707264 00000100:00100000:0.0:1788530073.756932:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555707264 00000100:00100000:0.0:1788530073.756992:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788530073.757002:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+15:8430:x1875409555707264:12345-0@lo:101: 00010000:00010000:0.0:1788530073.757018:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530073.757034:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f3d101000/0xb28d70e125750273 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e12575026c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530073.758787:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f3d101000/0xb28d70e125750273 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e12575026c expref: 16 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530073.758809:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f3d101000/0xb28d70e125750273 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e12575026c expref: 16 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530073.758821:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d101000, rc 0) 00000100:00100000:0.0:1788530073.758919:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+16:8430:x1875409555707264:12345-0@lo:101: Request processed in 1917us (2954us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530073.758928:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788530073.759261:0:8430:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f2b92d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:8430:1875409555707264:0@lo:101: 00010000:00010000:3.0:1788530073.759282:0:8430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f18140a00/0xb28d70e12575026c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125750273 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530073.759291:0:8430:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f18140a00/0xb28d70e12575026c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e125750273 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530073.760813:0:8430:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:8430:1875409555707392:0@lo:256: 00000100:00100000:3.0:1788530073.761775:0:8430:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530073.761855:0:8430:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f32b9f900 going to sleep for 11 seconds 00000100:00100000:0.0:1788530073.762062:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555707392 00000100:00100000:0.0:1788530073.762077:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555707392 00000100:00100000:0.0:1788530073.762222:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788530073.762236:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+16:8430:x1875409555707392:12345-0@lo:256: 20000000:01000000:0.0:1788530073.762273:0:6518:0:(mgs_nids.c:1159:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788530073.762422:0:6518:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788530073.762429:0:6518:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788530073.762431:0:6518:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 88, version 4 00000100:00100000:0.0:1788530073.762614:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+16:8430:x1875409555707392:12345-0@lo:256: Request processed in 379us (845us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530073.762622:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788530073.764274:0:8430:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:8430:1875409555707392:0@lo:256: 10000000:01000000:3.0:1788530073.768032:0:8430:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788530073.768075:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f18140a00/0xb28d70e12575026c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125750273 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530073.768089:0:8430:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f18140a00/0xb28d70e12575026c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125750273 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788530073.768098:0:8430:0:(mgc_request.c:2194:mgc_process_log()) Process log params-ffff9a9f33b6f800 from 1 10000000:01000000:3.0:1788530073.768101:0:8430:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788530073.768487:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91ce00/0xb28d70e12575027a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530073.768497:0:8430:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91ce00/0xb28d70e12575027a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530073.768519:0:8430:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91ce00/0xb28d70e12575027a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530073.768544:0:8430:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:8430:1875409555707520:0@lo:101: 00000100:00100000:3.0:1788530073.769521:0:8430:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530073.769837:0:8430:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f32b9f900 going to sleep for 11 seconds 00000100:00100000:0.0:1788530073.779442:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555707520 00000100:00100000:0.0:1788530073.779458:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555707520 00000100:00100000:0.0:1788530073.779612:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788530073.779623:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+16:8430:x1875409555707520:12345-0@lo:101: 00010000:00010000:0.0:1788530073.779640:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530073.779659:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f3d100200/0xb28d70e125750281 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e12575027a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530073.779688:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f3d100200/0xb28d70e125750281 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e12575027a expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530073.779700:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f3d100200/0xb28d70e125750281 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e12575027a expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530073.779709:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d100200, rc 0) 00000100:00100000:0.0:1788530073.779802:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+17:8430:x1875409555707520:12345-0@lo:101: Request processed in 181us (10290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530073.779809:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788530073.779931:0:8430:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:8430:1875409555707520:0@lo:101: 00010000:00010000:2.0:1788530073.779953:0:8430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91ce00/0xb28d70e12575027a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125750281 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530073.779963:0:8430:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91ce00/0xb28d70e12575027a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e125750281 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530073.780084:0:8430:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f2b92f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:8430:1875409555707648:0@lo:501: 00000100:00100000:2.0:1788530073.780121:0:8430:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530073.788037:0:8430:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f3d3119c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788530073.791486:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555707648 00000100:00100000:3.0:1788530073.791506:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555707648 00000100:00100000:3.0:1788530073.791593:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788530073.791605:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+17:8430:x1875409555707648:12345-0@lo:501: 00000100:00100000:3.0:1788530073.791835:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+17:8430:x1875409555707648:12345-0@lo:501: Request processed in 232us (11713us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530073.791843:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788530073.792133:0:8430:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f2b92f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:8430:1875409555707648:0@lo:501: 00000100:00100000:2.0:1788530073.792284:0:8430:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f2b92f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:8430:1875409555707776:0@lo:503: 00000100:00100000:2.0:1788530073.793228:0:8430:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530073.793279:0:8430:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f3d3119c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788530073.793482:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555707776 00000100:00100000:3.0:1788530073.793489:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555707776 00000100:00100000:3.0:1788530073.793524:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788530073.793531:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+17:8430:x1875409555707776:12345-0@lo:503: 00000100:00100000:3.0:1788530073.793644:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+17:8430:x1875409555707776:12345-0@lo:503: Request processed in 113us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530073.793652:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788530073.793782:0:8430:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f2b92f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:8430:1875409555707776:0@lo:503: 00000040:00080000:2.0:1788530073.794050:0:8430:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00010000:00010000:0.0:1788530073.794266:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788530073.794509:0:8430:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f2b92f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:8430:1875409555707904:0@lo:502: 00000100:00100000:2.0:1788530073.794556:0:8430:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530073.794688:0:8430:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f3d3119c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788530073.794723:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555707904 00000100:00100000:3.0:1788530073.794729:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555707904 00000100:00100000:3.0:1788530073.794801:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788530073.794809:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+17:8430:x1875409555707904:12345-0@lo:502: 00000100:00100000:3.0:1788530073.794908:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+17:8430:x1875409555707904:12345-0@lo:502: Request processed in 99us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530073.794925:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788530073.794994:0:8430:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f2b92f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:8430:1875409555707904:0@lo:502: 00000040:00080000:2.0:1788530073.795242:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1788530073.795272:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1788530073.795294:0:8430:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f2b92f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:8430:1875409555708032:0@lo:502: 00000100:00100000:2.0:1788530073.795347:0:8430:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530073.795794:0:8430:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f3d3119c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788530073.795860:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555708032 00000100:00100000:0.0:1788530073.795866:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555708032 00000100:00100000:0.0:1788530073.795904:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788530073.795913:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+17:8430:x1875409555708032:12345-0@lo:502: 00000100:00100000:0.0:1788530073.796516:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+17:8430:x1875409555708032:12345-0@lo:502: Request processed in 603us (1167us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530073.796524:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788530073.796937:0:8430:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f2b92f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:8430:1875409555708032:0@lo:502: 00000040:00080000:2.0:1788530073.797012:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1788530073.797025:0:8430:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1788530073.797836:0:8457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788530073.797845:0:8457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788530073.797848:0:8457:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788530073.797864:0:8457:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a9f33b6f800 00000020:00000080:0.0:1788530073.797867:0:8457:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788530073.797888:0:8457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788530073.797891:0:8457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788530073.797892:0:8457:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788530073.797895:0:8457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1788530073.798230:0:8430:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788530073.798241:0:8430:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788530073.798357:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91ce00/0xb28d70e12575027a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125750281 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530073.798378:0:8430:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91ce00/0xb28d70e12575027a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125750281 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788530073.798427:0:8430:0:(mgc_request.c:2342:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788530073.798430:0:8430:0:(mgc_request.c:424:config_log_add()) add config log lustre-client-ffff9a9f33b6f800 10000000:01000000:2.0:1788530073.798433:0:8430:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-client-ffff9a9f33b6f800 10000000:01000000:2.0:1788530073.798438:0:8430:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788530073.798456:0:8430:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.202.141@tcp: setup lustre-OST0000-osd 00000040:01000000:2.0:1788530073.798510:0:8430:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.141@tcp ctxt 1 is initialized 00000040:01000000:2.0:1788530073.798517:0:8430:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.141@tcp ctxt 0 is initialized 10000000:01000000:2.0:1788530073.798534:0:8430:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-client-ffff9a9f33b6f800 from 1 10000000:01000000:2.0:1788530073.798537:0:8430:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788530073.798601:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f18141a00/0xb28d70e125750288 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530073.798610:0:8430:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f18141a00/0xb28d70e125750288 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530073.798621:0:8430:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f18141a00/0xb28d70e125750288 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530073.798639:0:8430:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f2b92f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:8430:1875409555708160:0@lo:101: 00000100:00100000:2.0:1788530073.798697:0:8430:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530073.798735:0:8430:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f3d311600 going to sleep for 11 seconds 00000100:00100000:1.0:1788530073.798808:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555708160 00000100:00100000:1.0:1788530073.798814:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555708160 00000100:00100000:1.0:1788530073.798847:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788530073.798855:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+17:8430:x1875409555708160:12345-0@lo:101: 00010000:00010000:1.0:1788530073.798873:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530073.798895:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f42166000/0xb28d70e12575028f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e125750288 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530073.798918:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f42166000/0xb28d70e12575028f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e125750288 expref: 18 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530073.798930:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f42166000/0xb28d70e12575028f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125750288 expref: 18 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530073.798939:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f42166000, rc 0) 00000100:00100000:1.0:1788530073.798977:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+18:8430:x1875409555708160:12345-0@lo:101: Request processed in 122us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530073.798984:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788530073.799052:0:8430:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f2b92f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:8430:1875409555708160:0@lo:101: 00010000:00010000:2.0:1788530073.799127:0:8430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f18141a00/0xb28d70e125750288 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575028f expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530073.799137:0:8430:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f18141a00/0xb28d70e125750288 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e12575028f expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530073.799262:0:8430:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f2b92f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:8430:1875409555708288:0@lo:501: 00000100:00100000:2.0:1788530073.799288:0:8430:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530073.799456:0:8430:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f3d311600 going to sleep for 11 seconds 00000100:00100000:1.0:1788530073.799546:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555708288 00000100:00100000:1.0:1788530073.799552:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555708288 00000100:00100000:1.0:1788530073.799701:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788530073.799708:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+18:8430:x1875409555708288:12345-0@lo:501: 00000100:00100000:1.0:1788530073.799795:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+18:8430:x1875409555708288:12345-0@lo:501: Request processed in 88us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530073.799802:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788530073.799856:0:8430:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f2b92f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:8430:1875409555708288:0@lo:501: 00000100:00100000:2.0:1788530073.799890:0:8430:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f2b92f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:8430:1875409555708416:0@lo:503: 00000100:00100000:2.0:1788530073.799925:0:8430:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530073.799949:0:8430:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f3d311600 going to sleep for 11 seconds 00000100:00100000:3.0:1788530073.800004:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555708416 00000100:00100000:3.0:1788530073.800008:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555708416 00000100:00100000:2.0:1788530073.800080:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788530073.800088:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+18:8430:x1875409555708416:12345-0@lo:503: 00000100:00100000:2.0:1788530073.800188:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+18:8430:x1875409555708416:12345-0@lo:503: Request processed in 101us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530073.800194:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788530073.800491:0:8430:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f2b92f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:8430:1875409555708416:0@lo:503: 00000040:00080000:3.0:1788530073.800832:0:8430:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788530073.800936:0:8430:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:8430:1875409555708544:0@lo:502: 00000100:00100000:3.0:1788530073.800982:0:8430:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530073.801002:0:8430:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f32b9f540 going to sleep for 11 seconds 00000100:00100000:2.0:1788530073.801420:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555708544 00000100:00100000:2.0:1788530073.801429:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555708544 00000100:00100000:2.0:1788530073.801474:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788530073.801488:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+18:8430:x1875409555708544:12345-0@lo:502: 00000100:00100000:2.0:1788530073.801662:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+18:8430:x1875409555708544:12345-0@lo:502: Request processed in 175us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530073.801670:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788530073.802526:0:8430:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:8430:1875409555708544:0@lo:502: 00000040:00080000:3.0:1788530073.802852:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1788530073.802899:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1788530073.802915:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1788530073.802929:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1788530073.802942:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1788530073.802954:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1788530073.802967:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1788530073.802980:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1788530073.802991:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1788530073.803003:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1788530073.803016:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1788530073.803028:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1788530073.803041:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1788530073.803204:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1788530073.803228:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1788530073.803242:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1788530073.803255:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1788530073.803268:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1788530073.803281:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1788530073.803293:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1788530073.803717:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1788530073.803735:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1788530073.803748:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1788530073.803761:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1788530073.803774:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:1.0:1788530073.803786:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:1.0:1788530073.803798:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:1.0:1788530073.803813:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:1.0:1788530073.803837:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:1.0:1788530073.803849:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:1.0:1788530073.803860:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:1.0:1788530073.803874:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:1.0:1788530073.803905:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:1.0:1788530073.803917:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:1.0:1788530073.803929:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:1.0:1788530073.803943:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:1.0:1788530073.803957:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:1.0:1788530073.803997:0:8430:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:8430:1875409555708672:0@lo:502: 00000100:00100000:1.0:1788530073.804132:0:8430:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530073.804265:0:8430:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f09214480 going to sleep for 11 seconds 00000100:00100000:2.0:1788530073.804365:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555708672 00000100:00100000:2.0:1788530073.804372:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555708672 00000100:00100000:2.0:1788530073.804456:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788530073.804466:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+18:8430:x1875409555708672:12345-0@lo:502: 00000100:00100000:2.0:1788530073.804617:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+18:8430:x1875409555708672:12345-0@lo:502: Request processed in 152us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530073.804632:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788530073.804728:0:8430:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:8430:1875409555708672:0@lo:502: 00000040:00080000:3.0:1788530073.804784:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:3.0:1788530073.804795:0:8430:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1788530073.805543:0:8458:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788530073.805588:0:8458:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9a9f2c103310) 00000020:00000080:3.0:1788530073.805613:0:8458:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1788530073.805709:0:8458:0:(tgt_mount.c:167:server_get_mount()) get mount ffff9a9f33b6f800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788530073.805714:0:8458:0:(tgt_mount.c:201:server_put_mount()) put mount ffff9a9f33b6f800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788530073.805716:0:8458:0:(obd_mount.c:712:lustre_put_lsi()) put ffff9a9f33b6f800 3 00010000:00080000:3.0:1788530073.805758:0:8458:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a9e02239000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.141@tcp at head 00010000:00010000:3.0:1788530073.808718:0:8458:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:2.0:1788530073.809138:0:8458:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1788530073.809224:0:8458:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788530073.809239:0:8458:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xb28d70e12575029d 00000100:00080000:2.0:1788530073.809252:0:8458:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788530073.809258:0:8458:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9a9e02239000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:2.0:1788530073.809488:0:8458:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9f2b92d500 x1875409555708800/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788530073.809523:0:8458:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788530073.809639:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f2b92d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1875409555708800:0@lo:38: 00000100:00100000:3.0:1788530073.809728:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530073.810250:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555708800 00000100:00100000:2.0:1788530073.810258:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555708800 00000100:00100000:2.0:1788530073.810365:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788530073.810375:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f328e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1875409555708800:12345-0@lo:38: 00010000:00080000:2.0:1788530073.810407:0:6524:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 281 last 0 00000020:00000080:2.0:1788530073.810459:0:6524:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xb28d70e1257502a4 00000004:00100000:2.0:1788530073.810480:0:6524:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788530073.810521:0:6524:0:(import.c:65:import_set_state_nolock()) ffff9a9e010c3800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788530073.810628:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f328e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875409555708800:12345-0@lo:38: Request processed in 253us (900us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530073.810636:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788530073.810722:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3735c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875409555708928:0@lo:400: 00000100:00100000:3.0:1788530073.810753:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530073.810792:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788530073.810799:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3735dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555709312:0@lo:400: 00000100:00100000:3.0:1788530073.810829:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530073.810872:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555709312 00000100:00100000:3.0:1788530073.810885:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555709312 00000100:00100000:3.0:1788530073.810921:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788530073.810929:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f328e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555709312:12345-0@lo:400: 00000100:00100000:3.0:1788530073.810976:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f328e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555709312:12345-0@lo:400: Request processed in 48us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530073.810983:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788530073.811031:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3735dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555709312:0@lo:400: 00010000:00080000:3.0:1788530073.811149:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9f2b92d500 x1875409555708800/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788530083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530073.811170:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788530073.811177:0:3646:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1788530073.811184:0:3646:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788530073.811189:0:3646:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788530073.811192:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9e02239000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788530073.811197:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f2b92d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1875409555708800:0@lo:38: 00000100:00100000:2.0:1788530073.811403:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555708928 00000100:00100000:2.0:1788530073.811407:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555708928 00000100:00100000:2.0:1788530073.811444:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788530073.811452:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f328e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875409555708928:12345-0@lo:400: 00000100:00100000:2.0:1788530073.811494:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f328e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875409555708928:12345-0@lo:400: Request processed in 43us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530073.811509:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000020:01000004:2.0:1788530073.811637:0:8458:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788530073.811655:0:8458:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9a9f33d94c98) 00000020:00000080:2.0:1788530073.811678:0:8458:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:2.0:1788530073.811764:0:8458:0:(tgt_mount.c:167:server_get_mount()) get mount ffff9a9f33b6f800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788530073.811769:0:8458:0:(tgt_mount.c:201:server_put_mount()) put mount ffff9a9f33b6f800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788530073.811772:0:8458:0:(obd_mount.c:712:lustre_put_lsi()) put ffff9a9f33b6f800 3 00010000:00080000:2.0:1788530073.811802:0:8458:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a9e010c7000@lustre-MDT0001-lwp-OST0000: add connection 192.168.202.141@tcp at head 00010000:00080000:3.0:1788530073.812666:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9f3735c700 x1875409555708928/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530089 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530073.812680:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3735c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875409555708928:0@lo:400: 00000100:00100000:3.0:1788530073.814466:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3735c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555709056:0@lo:400: 00000100:00100000:3.0:1788530073.814592:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530073.814647:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788530073.814655:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3735f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875409555709184:0@lo:400: 00000100:00100000:3.0:1788530073.814683:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530073.814724:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555709184 00000100:00100000:3.0:1788530073.814734:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555709184 00000100:00100000:3.0:1788530073.814785:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788530073.814795:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f328e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875409555709184:12345-0@lo:400: 00000100:00100000:3.0:1788530073.814852:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f328e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875409555709184:12345-0@lo:400: Request processed in 58us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530073.814859:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1788530073.814915:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9f3735f480 x1875409555709184/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530089 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530073.814931:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3735f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875409555709184:0@lo:400: 00000100:00100000:0.0:1788530073.815011:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555709056 00000100:00100000:0.0:1788530073.815016:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555709056 00000100:00100000:0.0:1788530073.815055:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788530073.815071:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f328e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555709056:12345-0@lo:400: 00000100:00100000:0.0:1788530073.815109:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f328e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555709056:12345-0@lo:400: Request processed in 39us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530073.815116:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788530073.816228:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3735c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555709056:0@lo:400: 00010000:00010000:2.0:1788530073.818720:0:8458:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:2.0:1788530073.818975:0:8458:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1788530073.819031:0:8458:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788530073.819048:0:8458:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xb28d70e1257502b2 00000100:00080000:2.0:1788530073.819959:0:8458:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788530073.819970:0:8458:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9a9e010c7000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:2.0:1788530073.820024:0:8458:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9f2b92c000 x1875409555709440/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788530073.820156:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f2b92c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3646:1875409555709440:0@lo:38: 00000100:00100000:3.0:1788530073.820240:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788530073.822170:0:8458:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1788530073.825238:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555709440 00000100:00100000:0.0:1788530073.825257:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555709440 00000100:00100000:0.0:1788530073.825659:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788530073.825679:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f328e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1875409555709440:12345-0@lo:38: 00010000:00080000:0.0:1788530073.825723:0:6524:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 281 last 0 00000020:00000080:0.0:1788530073.825767:0:6524:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xb28d70e1257502b9 00000004:00100000:0.0:1788530073.825789:0:6524:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788530073.825839:0:6524:0:(import.c:65:import_set_state_nolock()) ffff9a9f3d27e000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788530073.829437:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f328e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875409555709440:12345-0@lo:38: Request processed in 3747us (9184us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530073.829453:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788530073.830037:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9f2b92c000 x1875409555709440/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788530083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530073.830052:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788530073.830204:0:3646:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1788530073.830215:0:3646:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788530073.830220:0:3646:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788530073.830224:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9e010c7000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788530073.830231:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f2b92c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3646:1875409555709440:0@lo:38: 00000040:00080000:1.0:1788530073.830551:0:8458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:0.0:1788530073.831047:0:8430:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:0.0:1788530073.831132:0:8430:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788530073.831374:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f18141a00/0xb28d70e125750288 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575028f expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530073.831389:0:8430:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f18141a00/0xb28d70e125750288 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575028f expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788530073.831447:0:8430:0:(tgt_mount.c:1239:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788530073.831450:0:8430:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788530073.831451:0:8430:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788530073.831457:0:8430:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:0.0:1788530073.831458:0:8430:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:0.0:1788530073.831459:0:8430:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:0.0:1788530073.831460:0:8430:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788530073.831462:0:8430:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788530073.831463:0:8430:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788530073.831464:0:8430:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788530073.831465:0:8430:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788530073.831469:0:8430:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:0.0:1788530073.831471:0:8430:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788530073.831472:0:8430:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788530073.831473:0:8430:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788530073.831474:0:8430:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:0.0:1788530073.831475:0:8430:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:0.0:1788530073.831476:0:8430:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:0.0:1788530073.831477:0:8430:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788530073.831477:0:8430:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788530073.831478:0:8430:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788530073.831479:0:8430:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788530073.831480:0:8430:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788530073.831507:0:8430:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788530073.831523:0:8430:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3735ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:8430:1875409555709568:0@lo:253: 00000100:00100000:0.0:1788530073.831621:0:8430:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530073.831660:0:8430:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f086dbcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788530073.831686:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555709568 00000100:00100000:0.0:1788530073.831693:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555709568 00000100:00100000:0.0:1788530073.831735:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788530073.831744:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+18:8430:x1875409555709568:12345-0@lo:253: 20000000:01000000:0.0:1788530073.831782:0:6517:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788530073.831798:0:6517:0:(mgs_nids.c:468:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788530073.844264:0:6517:0:(mgs_nids.c:833:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788530073.844286:0:6517:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1788530073.844631:0:6539:0:(mgs_nids.c:730:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788530073.844637:0:6539:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788530073.844659:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a9f3d100a00/0xb28d70e1257502c0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530073.844679:0:6539:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a9f18141800/0xb28d70e1257501a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e1257501a1 expref: 18 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530073.844696:0:6539:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a9f18140000/0xb28d70e1257501c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e1257501bd expref: 18 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530073.844703:0:6539:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a9f3d101000/0xb28d70e125750273 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e12575026c expref: 18 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530073.844710:0:6539:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a9f3d100a00/0xb28d70e1257502c0 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530073.844748:0:6539:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a9f3d101000/0xb28d70e125750273 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb28d70e12575026c expref: 18 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530073.844762:0:6539:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a9f3d101000/0xb28d70e125750273 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb28d70e12575026c expref: 18 pid: 6517 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530073.844776:0:6539:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3735d500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6539:1875409555709696:0@lo:104: 00000100:00100000:0.0:1788530073.844838:0:6539:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788530073.846080:0:6539:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a9f18140000/0xb28d70e1257501c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb28d70e1257501bd expref: 18 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530073.846097:0:6539:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a9f18140000/0xb28d70e1257501c4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb28d70e1257501bd expref: 18 pid: 6517 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530073.846108:0:6539:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3735d880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6539:1875409555709824:0@lo:104: 00000100:00100000:0.0:1788530073.846147:0:6539:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530073.846611:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+18:8430:x1875409555709568:12345-0@lo:253: Request processed in 14866us (14987us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530073.846623:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788530073.846769:0:8430:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3735ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:8430:1875409555709568:0@lo:253: 10000000:01000000:1.0:1788530073.846783:0:8430:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788530073.846786:0:8430:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788530073.846788:0:8430:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788530073.846789:0:8430:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788530073.846790:0:8430:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:1.0:1788530073.846792:0:8430:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:1.0:1788530073.846793:0:8430:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:1.0:1788530073.846795:0:8430:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788530073.846796:0:8430:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788530073.846798:0:8430:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788530073.846799:0:8430:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788530073.846801:0:8430:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788530073.846815:0:8430:0:(tgt_mount.c:2823:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1788530073.847814:0:6539:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a9f18141800/0xb28d70e1257501a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb28d70e1257501a1 expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530073.847830:0:6539:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a9f18141800/0xb28d70e1257501a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb28d70e1257501a1 expref: 17 pid: 6517 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530073.847856:0:6539:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3735e300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6539:1875409555709952:0@lo:104: 00000100:00100000:0.0:1788530073.847919:0:6539:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530073.851411:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555709696 00000100:00100000:3.0:1788530073.851440:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555709696 00000100:00100000:3.0:1788530073.851520:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555709824 00000100:00100000:3.0:1788530073.851524:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555709824 00000100:00100000:3.0:1788530073.851551:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788530073.851585:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3735f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+4:6539:x1875409555709696:12345-0@lo:104: 00010000:00010000:3.0:1788530073.851614:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff9a9f18140a00/0xb28d70e12575026c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e125750273 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530073.851762:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788530073.851770:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3735f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+4:6539:x1875409555709696:12345-0@lo:104: Request processed in 208us (6932us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530073.851778:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788530073.851813:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788530073.851822:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3735ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+3:6539:x1875409555709824:12345-0@lo:104: 00010000:00010000:3.0:1788530073.851831:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff9a9f42166600/0xb28d70e1257501bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e1257501c4 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530073.851872:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788530073.851887:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3735ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+3:6539:x1875409555709824:12345-0@lo:104: Request processed in 58us (5730us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530073.851894:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00080000:10000000:1.0:1788530073.852132:0:8430:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:1.0:1788530073.852306:0:8430:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1788530073.852539:0:8430:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:1.0:1788530073.852735:0:8430:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00010000:00010000:3.0:1788530073.853018:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788530073.853028:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f18140a00/0xb28d70e12575026c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e125750273 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:1.0:1788530073.853033:0:8430:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00010000:00010000:3.0:1788530073.853050:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f18140a00 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:3.0:1788530073.853055:0:6512:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f18140a00/0xb28d70e12575026c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb28d70e125750273 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:1.0:1788530073.853219:0:8430:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00010000:00010000:3.0:1788530073.853502:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f18140a00/0xb28d70e12575026c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb28d70e125750273 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788530073.853511:0:6512:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f18140a00/0xb28d70e12575026c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb28d70e125750273 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788530073.853517:0:6512:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788530073.853596:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9f18140a00/0xb28d70e12575026c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125750273 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530073.853603:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788530073.853629:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f18140a00/0xb28d70e12575026c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125750273 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530073.853636:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f18140a00/0xb28d70e12575026c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125750273 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530073.853649:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3648:1875409555710080:0@lo:103: 00010000:00010000:3.0:1788530073.853662:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788530073.853668:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f42166600/0xb28d70e1257501bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e1257501c4 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530073.853674:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f42166600 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:3.0:1788530073.853677:0:6512:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f42166600/0xb28d70e1257501bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb28d70e1257501c4 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530073.853697:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f42166600/0xb28d70e1257501bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb28d70e1257501c4 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788530073.853704:0:6512:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f42166600/0xb28d70e1257501bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb28d70e1257501c4 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788530073.853709:0:6512:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788530073.853733:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9f42166600/0xb28d70e1257501bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e1257501c4 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530073.853743:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788530073.853744:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788530073.853766:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f42166600/0xb28d70e1257501bd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e1257501c4 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530073.853774:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f42166600/0xb28d70e1257501bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e1257501c4 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530073.853788:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530073.853791:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530073.853793:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530073.853802:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788530073.853938:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555710080 00000100:00100000:3.0:1788530073.853948:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555710080 00010000:00010000:3.0:1788530073.853986:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a9f3d101000/0xb28d70e125750273 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e12575026c expref: 18 pid: 6517 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530073.854027:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788530073.854039:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32bd3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+18:3648:x1875409555710080:12345-0@lo:103: 00010000:00010000:3.0:1788530073.854054:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788530073.854079:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a9f3d101000/0xb28d70e125750273 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e12575026c expref: 18 pid: 6517 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530073.854092:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a9f3d101000/0xb28d70e125750273 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb28d70e12575026c expref: 18 pid: 6517 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530073.854115:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788530073.854438:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32bd3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+18:3648:x1875409555710080:12345-0@lo:103: Request processed in 400us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530073.854446:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3648:1875409555710080:0@lo:103: 00000100:00100000:3.0:1788530073.854450:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788530073.854483:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788530073.854493:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3650:1875409555710208:0@lo:103: 00000100:00100000:3.0:1788530073.854524:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530073.854598:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555710208 00000100:00100000:1.0:1788530073.854603:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555710208 00010000:00010000:1.0:1788530073.854620:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a9f18140000/0xb28d70e1257501c4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e1257501bd expref: 18 pid: 6517 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530073.854646:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788530073.854653:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f328e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+18:3650:x1875409555710208:12345-0@lo:103: 00010000:00010000:1.0:1788530073.854662:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788530073.854666:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a9f18140000/0xb28d70e1257501c4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e1257501bd expref: 18 pid: 6517 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530073.854675:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a9f18140000/0xb28d70e1257501c4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb28d70e1257501bd expref: 18 pid: 6517 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530073.854686:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788530073.854715:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f328e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+18:3650:x1875409555710208:12345-0@lo:103: Request processed in 57us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530073.854722:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788530073.854772:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555709952 00000100:00100000:1.0:1788530073.854775:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555709952 00000100:00100000:0.0:1788530073.854790:0:6539:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f086dba80 going to sleep for 11 seconds 00000100:00100000:1.0:1788530073.854798:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788530073.854806:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3735c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+3:6539:x1875409555709952:12345-0@lo:104: 00010000:00010000:0.0:1788530073.854811:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f3d101000/0xb28d70e125750273 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb28d70e12575026c expref: 17 pid: 6517 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530073.854818:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff9a9f42167200/0xb28d70e1257501a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e1257501a8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530073.854825:0:6539:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3735d500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6539:1875409555709696:0@lo:104: 00010000:00010000:0.0:1788530073.854841:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f18140000/0xb28d70e1257501c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb28d70e1257501bd expref: 16 pid: 6517 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530073.854852:0:6539:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3735d880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6539:1875409555709824:0@lo:104: 00000100:00100000:0.0:1788530073.854865:0:6539:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3735e300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6539:1875409555709952:0@lo:104: 00010000:00010000:1.0:1788530073.854868:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788530073.854895:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3735c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+3:6539:x1875409555709952:12345-0@lo:104: Request processed in 88us (6974us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530073.854902:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:0.0:1788530073.854905:0:6539:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a9f3d100a00/0xb28d70e1257502c0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530073.855099:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3650:1875409555710208:0@lo:103: 00010000:00010000:3.0:1788530073.855116:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788530073.855121:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f42167200/0xb28d70e1257501a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e1257501a8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530073.855221:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f42167200 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:3.0:1788530073.855226:0:6512:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f42167200/0xb28d70e1257501a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb28d70e1257501a8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530073.855235:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f42167200/0xb28d70e1257501a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb28d70e1257501a8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788530073.855244:0:6512:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f42167200/0xb28d70e1257501a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb28d70e1257501a8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788530073.855250:0:6512:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788530073.855285:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9f42167200/0xb28d70e1257501a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e1257501a8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530073.855299:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788530073.855314:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f42167200/0xb28d70e1257501a1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e1257501a8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530073.855321:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f42167200/0xb28d70e1257501a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e1257501a8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530073.855336:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530073.855338:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530073.855339:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788530073.855348:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3650:1875409555710336:0@lo:103: 00000100:00100000:3.0:1788530073.855378:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530073.855401:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555710336 00000100:00100000:3.0:1788530073.855405:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555710336 00010000:00010000:3.0:1788530073.855423:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a9f18141800/0xb28d70e1257501a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e1257501a1 expref: 16 pid: 6517 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530073.855444:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788530073.855452:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f328e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+16:3650:x1875409555710336:12345-0@lo:103: 00010000:00010000:3.0:1788530073.855462:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788530073.855468:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a9f18141800/0xb28d70e1257501a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e1257501a1 expref: 16 pid: 6517 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530073.855478:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a9f18141800/0xb28d70e1257501a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb28d70e1257501a1 expref: 16 pid: 6517 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530073.855489:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f18141800/0xb28d70e1257501a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb28d70e1257501a1 expref: 16 pid: 6517 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530073.855512:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a9f3d100a00/0xb28d70e1257502c0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530073.855522:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f3d100a00/0xb28d70e1257502c0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788530073.855538:0:6510:0:(mgs_nids.c:706:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.018248997s 00010000:00010000:3.0:1788530073.855542:0:6510:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a9f3d100a00/0xb28d70e1257502c0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530073.855550:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a9f3d100a00/0xb28d70e1257502c0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530073.855577:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a9f3d100a00/0xb28d70e1257502c0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530073.855585:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a9f3d100a00/0xb28d70e1257502c0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530073.855592:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d100a00 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:3.0:1788530073.855596:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a9f3d100a00/0xb28d70e1257502c0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530073.855603:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a9f3d100a00/0xb28d70e1257502c0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530073.855616:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a9f3d100a00/0xb28d70e1257502c0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530073.855623:0:6539:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a9f3d100a00/0xb28d70e1257502c0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530073.855625:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788530073.855635:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a9f3d100a00/0xb28d70e1257502c0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530073.855644:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f3d100a00/0xb28d70e1257502c0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530073.855658:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f328e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+15:3650:x1875409555710336:12345-0@lo:103: Request processed in 206us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530073.855666:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788530073.855693:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3650:1875409555710336:0@lo:103: 00000001:00000004:0.0:1788530073.856292:0:8430:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1788530073.870697:0:8430:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1788530073.870709:0:8430:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1788530073.870749:0:8430:0:(tgt_mount.c:2543:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1788530073.870780:0:8430:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1788530073.872279:0:8430:0:(tgt_mount.c:2429:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788530073.872493:0:8430:0:(tgt_mount.c:2444:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:1.0:1788530074.820506:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788530074.941492:0:8514:0:(tgt_mount.c:2429:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788530074.945839:0:8514:0:(tgt_mount.c:2444:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788530075.200660:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788530075.200691:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555710464:0@lo:41: 00000100:00100000:1.0:1788530075.200775:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530075.201786:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555710464 00000100:00100000:1.0:1788530075.201796:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555710464 00000100:00100000:1.0:1788530075.201840:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788530075.201849:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32bd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555710464:12345-0@lo:41: 00000004:00000024:1.0:1788530075.201897:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:1.0:1788530075.201960:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32bd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555710464:12345-0@lo:41: Request processed in 110us (1184us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530075.201967:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788530075.202016:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555710464:0@lo:41: 00010000:00010000:3.0:1788530075.844838:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788530076.736971:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3735e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555710592:0@lo:41: 00000100:00100000:1.0:1788530076.737128:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530076.737279:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555710592 00000100:00100000:2.0:1788530076.737300:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555710592 00000100:00100000:2.0:1788530076.737370:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788530076.737381:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32bd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555710592:12345-0@lo:41: 00000004:00000024:2.0:1788530076.737434:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446547456 avail 1300307968 00000100:00100000:2.0:1788530076.738371:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32bd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555710592:12345-0@lo:41: Request processed in 987us (1252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530076.738380:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788530076.738472:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3735e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555710592:0@lo:41: 00010000:00010000:2.0:1788530076.867660:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530077.888912:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530078.918501:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788530079.301487:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3735d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3649:1875409555710720:0@lo:400: 00000100:00100000:0.0:1788530079.301548:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3735ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555710976:0@lo:400: 00000100:00100000:2.0:1788530079.301600:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530079.301618:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530079.301672:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3735fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555711232:0@lo:400: 00000100:00100000:2.0:1788530079.301699:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530079.301721:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788530079.301728:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3735d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875409555710848:0@lo:400: 00000100:00100000:2.0:1788530079.301755:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530079.301774:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3735d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875409555711360:0@lo:400: 00000100:00100000:2.0:1788530079.301798:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530079.301839:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555710720 00000100:00100000:2.0:1788530079.301846:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555710720 00000100:00100000:2.0:1788530079.301888:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788530079.302099:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+15:3649:x1875409555710720:12345-0@lo:400: 00000100:00100000:2.0:1788530079.302270:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+15:3649:x1875409555710720:12345-0@lo:400: Request processed in 172us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530079.302277:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788530079.302311:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555710976 00000100:00100000:2.0:1788530079.302314:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555710976 00000100:00100000:2.0:1788530079.302341:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555711232 00000100:00100000:2.0:1788530079.302344:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555711232 00000100:00100000:2.0:1788530079.302361:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788530079.302367:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3735e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555710976:12345-0@lo:400: 00000100:00100000:2.0:1788530079.302407:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3735e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555710976:12345-0@lo:400: Request processed in 39us (790us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530079.302412:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788530079.302424:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788530079.302429:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f2b92c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555711232:12345-0@lo:400: 00000100:00100000:2.0:1788530079.302457:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f2b92c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555711232:12345-0@lo:400: Request processed in 28us (758us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530079.302463:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788530079.302503:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3735fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555711232:0@lo:400: 00000100:00100000:2.0:1788530079.302515:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3735d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3649:1875409555710720:0@lo:400: 00000100:00100000:2.0:1788530079.306131:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555710848 00000100:00100000:2.0:1788530079.306148:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555710848 00000100:00100000:2.0:1788530079.306226:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555711360 00000100:00100000:2.0:1788530079.306230:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555711360 00000100:00100000:2.0:1788530079.306268:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788530079.306278:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f2b92c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875409555710848:12345-0@lo:400: 00000100:00100000:2.0:1788530079.306392:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f2b92c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875409555710848:12345-0@lo:400: Request processed in 115us (4636us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530079.306400:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788530079.306417:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788530079.306424:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f2b92d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875409555711360:12345-0@lo:400: 00000100:00100000:2.0:1788530079.306450:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f2b92d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875409555711360:12345-0@lo:400: Request processed in 28us (4652us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530079.306472:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1788530079.306500:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788530079.306547:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9f3735d500 x1875409555710848/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530095 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530079.306586:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3735d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875409555710848:0@lo:400: 00010000:00080000:2.0:1788530079.306602:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9f3735d180 x1875409555711360/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530095 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530079.306612:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3735d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875409555711360:0@lo:400: 00000100:00100000:0.0:1788530079.307107:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3735ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555710976:0@lo:400: 00000100:00100000:0.0:1788530079.307140:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3735f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875409555711104:0@lo:400: 00000100:00100000:0.0:1788530079.307188:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530079.307324:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555711104 00000100:00100000:0.0:1788530079.307329:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555711104 00000100:00100000:2.0:1788530079.307640:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3735e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875409555711488:0@lo:400: 00000100:00100000:2.0:1788530079.307677:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530079.307782:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555711488 00000100:00100000:3.0:1788530079.307788:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555711488 00000100:00100000:0.0:1788530079.307815:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788530079.307836:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3735ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875409555711104:12345-0@lo:400: 00000100:00100000:3.0:1788530079.307870:0:6523:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788530079.307880:0:6523:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1788530079.307898:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3735ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875409555711104:12345-0@lo:400: Request processed in 74us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530079.307906:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788530079.307924:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788530079.307931:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f2b92f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875409555711488:12345-0@lo:400: 00000100:00100000:0.0:1788530079.307969:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f2b92f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875409555711488:12345-0@lo:400: Request processed in 38us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530079.307975:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1788530079.308015:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9f3735f100 x1875409555711104/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530095 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530079.308027:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3735f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875409555711104:0@lo:400: 00000100:00080000:2.0:1788530079.308238:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1788530079.308264:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9f3735e680 x1875409555711488/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530095 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530079.308273:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3735e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875409555711488:0@lo:400: 00010000:00010000:1.0:1788530079.946870:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788530080.322655:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f2b92d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555711616:0@lo:41: 00000100:00100000:2.0:1788530080.322731:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530080.322835:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555711616 00000100:00100000:2.0:1788530080.322843:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555711616 00000100:00100000:2.0:1788530080.322888:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788530080.322897:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f2b92c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555711616:12345-0@lo:41: 00000004:00000024:2.0:1788530080.322930:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:2.0:1788530080.322980:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f2b92c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555711616:12345-0@lo:41: Request processed in 83us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530080.322988:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788530080.323051:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f2b92d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555711616:0@lo:41: 10000000:01000000:3.0:1788530080.323217:0:6521:0:(mgc_request.c:715:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788530080.323222:0:6521:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-mdtir-ffff9a9f33b6f800 from 5 10000000:01000000:3.0:1788530080.323227:0:6521:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788530080.323341:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91ca00/0xb28d70e1257502c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530080.323354:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91ca00/0xb28d70e1257502c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530080.323366:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91ca00/0xb28d70e1257502c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530080.323385:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555711744:0@lo:101: 00000100:00100000:3.0:1788530080.323426:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530080.323446:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f329c3300 going to sleep for 11 seconds 00000100:00100000:2.0:1788530080.323505:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555711744 00000100:00100000:2.0:1788530080.323510:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555711744 00000100:00100000:2.0:1788530080.323547:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788530080.323554:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+15:6521:x1875409555711744:12345-0@lo:101: 00010000:00010000:2.0:1788530080.323582:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530080.323714:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f18140e00/0xb28d70e1257502ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e1257502c7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530080.323738:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f18140e00/0xb28d70e1257502ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e1257502c7 expref: 16 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530080.323749:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f18140e00/0xb28d70e1257502ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e1257502c7 expref: 16 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530080.323759:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f18140e00, rc 0) 00000100:00100000:2.0:1788530080.323802:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+16:6521:x1875409555711744:12345-0@lo:101: Request processed in 249us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530080.323808:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788530080.323898:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555711744:0@lo:101: 00010000:00010000:3.0:1788530080.323915:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91ca00/0xb28d70e1257502c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257502ce expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530080.323940:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91ca00/0xb28d70e1257502c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e1257502ce expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530080.323991:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555711872:0@lo:256: 00000100:00100000:3.0:1788530080.324025:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530080.324054:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f329c3300 going to sleep for 11 seconds 00000100:00100000:2.0:1788530080.324732:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555711872 00000100:00100000:2.0:1788530080.324740:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555711872 00000100:00100000:2.0:1788530080.324781:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788530080.324791:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+16:6521:x1875409555711872:12345-0@lo:256: 20000000:01000000:2.0:1788530080.324810:0:6516:0:(mgs_nids.c:1159:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788530080.324842:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788530080.324846:0:6516:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1788530080.324949:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+16:6521:x1875409555711872:12345-0@lo:256: Request processed in 159us (922us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530080.324957:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788530080.325083:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555711872:0@lo:256: 10000000:01000000:3.0:1788530080.325136:0:6521:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788530080.325146:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91ca00/0xb28d70e1257502c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257502ce expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530080.325156:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91ca00/0xb28d70e1257502c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257502ce expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788530080.325171:0:6521:0:(mgc_request.c:715:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788530080.325173:0:6521:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-client-ffff9a9f32bea000 from 30 10000000:01000000:3.0:1788530080.325177:0:6521:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788530080.325205:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91da00/0xb28d70e1257502d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530080.325214:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91da00/0xb28d70e1257502d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530080.325224:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91da00/0xb28d70e1257502d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530080.325329:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555712000:0@lo:101: 00000100:00100000:3.0:1788530080.325376:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530080.325415:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f329c3300 going to sleep for 11 seconds 00000100:00100000:2.0:1788530080.325695:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555712000 00000100:00100000:2.0:1788530080.325701:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555712000 00000100:00100000:2.0:1788530080.325736:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788530080.325744:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+16:6521:x1875409555712000:12345-0@lo:101: 00010000:00010000:2.0:1788530080.325755:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530080.325769:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f18140200/0xb28d70e1257502dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e1257502d5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530080.325793:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f18140200/0xb28d70e1257502dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e1257502d5 expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530080.325804:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f18140200/0xb28d70e1257502dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e1257502d5 expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530080.325812:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f18140200, rc 0) 00000100:00100000:2.0:1788530080.325858:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+17:6521:x1875409555712000:12345-0@lo:101: Request processed in 115us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530080.325864:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788530080.325961:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555712000:0@lo:101: 00010000:00010000:3.0:1788530080.325973:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91da00/0xb28d70e1257502d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257502dc expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530080.325981:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91da00/0xb28d70e1257502d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e1257502dc expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788530080.326145:0:6521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1788530080.327548:0:6521:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788530080.337457:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1788530080.337522:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1788530080.337537:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1788530080.337551:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1788530080.337582:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1788530080.337673:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1788530080.337687:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1788530080.337700:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1788530080.337714:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1788530080.337726:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1788530080.337739:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1788530080.337753:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1788530080.337767:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1788530080.337791:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1788530080.337803:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1788530080.337830:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1788530080.337844:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1788530080.337856:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1788530080.337869:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1788530080.337882:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1788530080.337894:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1788530080.337905:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1788530080.337917:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1788530080.337934:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1788530080.337949:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:2.0:1788530080.337963:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:2.0:1788530080.337976:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:2.0:1788530080.337989:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:2.0:1788530080.338016:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:2.0:1788530080.338022:0:6521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:2.0:1788530080.338145:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f2b92d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555712128:0@lo:501: 00000100:00100000:2.0:1788530080.338216:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530080.338335:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f08cdce40 going to sleep for 11 seconds 00000100:00100000:3.0:1788530080.339360:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555712128 00000100:00100000:3.0:1788530080.339372:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555712128 00000100:00100000:3.0:1788530080.339457:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788530080.339469:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+17:6521:x1875409555712128:12345-0@lo:501: 00000100:00100000:3.0:1788530080.339739:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+17:6521:x1875409555712128:12345-0@lo:501: Request processed in 271us (1522us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530080.339747:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788530080.339874:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f2b92d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555712128:0@lo:501: 00000100:00100000:2.0:1788530080.339937:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f2b92d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555712256:0@lo:503: 00000100:00100000:2.0:1788530080.339984:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530080.340019:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f08cdce40 going to sleep for 11 seconds 00000100:00100000:3.0:1788530080.340688:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555712256 00000100:00100000:3.0:1788530080.340695:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555712256 00000100:00100000:3.0:1788530080.340726:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788530080.340733:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+17:6521:x1875409555712256:12345-0@lo:503: 00000100:00100000:3.0:1788530080.340893:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+17:6521:x1875409555712256:12345-0@lo:503: Request processed in 158us (908us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530080.340899:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788530080.341377:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f2b92d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555712256:0@lo:503: 00000040:00080000:2.0:1788530080.343303:0:6521:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788530080.343395:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f2b92d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555712384:0@lo:502: 00000100:00100000:2.0:1788530080.343459:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530080.343495:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f08cdc9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788530080.343673:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555712384 00000100:00100000:1.0:1788530080.343681:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555712384 00000100:00100000:1.0:1788530080.343723:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788530080.343733:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+17:6521:x1875409555712384:12345-0@lo:502: 00000100:00100000:1.0:1788530080.343852:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+17:6521:x1875409555712384:12345-0@lo:502: Request processed in 120us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530080.343860:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788530080.345382:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f2b92d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555712384:0@lo:502: 00000040:00080000:2.0:1788530080.345614:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1788530080.345643:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1788530080.345658:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1788530080.345671:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1788530080.345683:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1788530080.345697:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1788530080.345708:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1788530080.345721:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1788530080.345732:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1788530080.345743:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1788530080.345757:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1788530080.345768:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1788530080.345779:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1788530080.345789:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1788530080.345800:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1788530080.345812:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1788530080.345841:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1788530080.345853:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1788530080.345865:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1788530080.345877:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1788530080.345890:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1788530080.345903:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1788530080.345914:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1788530080.345926:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1788530080.345940:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:2.0:1788530080.345953:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:2.0:1788530080.345964:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:2.0:1788530080.345974:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:2.0:1788530080.345984:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:2.0:1788530080.345994:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:2.0:1788530080.346004:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:2.0:1788530080.346025:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:2.0:1788530080.346037:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:2.0:1788530080.346048:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:2.0:1788530080.346061:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:2.0:1788530080.346073:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:2.0:1788530080.346086:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000100:00100000:2.0:1788530080.346133:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f2b92d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555712512:0@lo:502: 00000100:00100000:2.0:1788530080.348672:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530080.349045:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f08cdc9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788530080.353556:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555712512 00000100:00100000:3.0:1788530080.353584:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555712512 00000100:00100000:2.0:1788530080.356054:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788530080.356070:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+17:6521:x1875409555712512:12345-0@lo:502: 00000100:00100000:2.0:1788530080.356261:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+17:6521:x1875409555712512:12345-0@lo:502: Request processed in 194us (7597us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530080.356269:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788530080.356335:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f2b92d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555712512:0@lo:502: 00000040:00080000:2.0:1788530080.356418:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:2.0:1788530080.356432:0:6521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000040:00080000:2.0:1788530080.357363:0:8742:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 39 count 39 00000020:01000000:3.0:1788530080.357515:0:6521:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1788530080.357533:0:6521:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788530080.357542:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91da00/0xb28d70e1257502d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257502dc expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530080.357553:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91da00/0xb28d70e1257502d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257502dc expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788530080.357588:0:6521:0:(mgc_request.c:715:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788530080.357590:0:6521:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-mdtir-ffff9a9f32bea000 from 5 10000000:01000000:3.0:1788530080.357594:0:6521:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788530080.357625:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91c200/0xb28d70e1257502e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530080.357634:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91c200/0xb28d70e1257502e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530080.357644:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91c200/0xb28d70e1257502e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530080.357664:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555712640:0@lo:101: 00000100:00100000:3.0:1788530080.357711:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530080.357847:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555712640 00000100:00100000:2.0:1788530080.357854:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555712640 00000100:00100000:2.0:1788530080.357890:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788530080.357898:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+17:6521:x1875409555712640:12345-0@lo:101: 00010000:00010000:2.0:1788530080.357909:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530080.357921:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f18141000/0xb28d70e1257502ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e1257502e3 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530080.357941:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f18141000/0xb28d70e1257502ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e1257502e3 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530080.357963:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f18141000/0xb28d70e1257502ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e1257502e3 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530080.357971:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f18141000, rc 0) 00000100:00100000:2.0:1788530080.357999:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+18:6521:x1875409555712640:12345-0@lo:101: Request processed in 102us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530080.358005:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788530080.358062:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f329c3cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788530080.358080:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555712640:0@lo:101: 00010000:00010000:3.0:1788530080.358093:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91c200/0xb28d70e1257502e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257502ea expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530080.358101:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91c200/0xb28d70e1257502e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e1257502ea expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530080.358163:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555712768:0@lo:256: 00000100:00100000:3.0:1788530080.358543:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530080.358918:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555712768 00000100:00100000:2.0:1788530080.358923:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555712768 00000100:00100000:2.0:1788530080.358958:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788530080.358965:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+18:6521:x1875409555712768:12345-0@lo:256: 20000000:01000000:2.0:1788530080.358982:0:6518:0:(mgs_nids.c:1159:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788530080.358999:0:6518:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788530080.359001:0:6518:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1788530080.359077:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+18:6521:x1875409555712768:12345-0@lo:256: Request processed in 112us (878us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530080.359084:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788530080.359142:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f329c3cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788530080.359167:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555712768:0@lo:256: 10000000:01000000:3.0:1788530080.359328:0:6521:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788530080.359335:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91c200/0xb28d70e1257502e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257502ea expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530080.359344:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91c200/0xb28d70e1257502e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257502ea expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788530080.359355:0:6521:0:(mgc_request.c:715:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1788530080.359357:0:6521:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:3.0:1788530080.359360:0:6521:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1788530080.359383:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d200/0xb28d70e1257502f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530080.359390:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d200/0xb28d70e1257502f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530080.359399:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d200/0xb28d70e1257502f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530080.359412:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555712896:0@lo:101: 00000100:00100000:3.0:1788530080.359439:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530080.359494:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f329c3cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788530080.363455:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555712896 00000100:00100000:2.0:1788530080.363483:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555712896 00000100:00100000:2.0:1788530080.363553:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788530080.363580:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+18:6521:x1875409555712896:12345-0@lo:101: 00010000:00010000:2.0:1788530080.363597:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530080.363618:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f18141200/0xb28d70e1257502f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e1257502f1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530080.363648:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f18141200/0xb28d70e1257502f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e1257502f1 expref: 19 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530080.363672:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f18141200/0xb28d70e1257502f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e1257502f1 expref: 19 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530080.363680:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f18141200, rc 0) 00000100:00100000:2.0:1788530080.363772:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+19:6521:x1875409555712896:12345-0@lo:101: Request processed in 211us (4332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530080.363778:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788530080.364100:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555712896:0@lo:101: 00010000:00010000:3.0:1788530080.364126:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d200/0xb28d70e1257502f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257502f8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530080.364159:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d200/0xb28d70e1257502f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e1257502f8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788530080.364491:0:6521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:3.0:1788530080.364850:0:6521:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788530080.365023:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1788530080.365047:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 136 off8552 00000040:00080000:3.0:1788530080.365063:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 176 off8728 00000040:00080000:3.0:1788530080.365078:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8952 00000040:00080000:3.0:1788530080.365094:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9176 00000040:00080000:3.0:1788530080.365107:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9296 00000040:00080000:3.0:1788530080.365121:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 112 off9408 00000040:00080000:3.0:1788530080.365133:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 160 off9568 00000040:00080000:3.0:1788530080.365144:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9792 00000040:00080000:3.0:1788530080.365343:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off10016 00000040:00080000:3.0:1788530080.365362:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 88 off10104 00000040:00080000:3.0:1788530080.365376:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 144 off10248 00000040:00080000:3.0:1788530080.365390:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 152 off10400 00000040:00080000:3.0:1788530080.365403:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 168 off10568 00000040:00080000:3.0:1788530080.365415:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 224 off10792 00000040:00080000:3.0:1788530080.365429:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 224 off11016 00000040:00080000:3.0:1788530080.365444:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 80 off11096 00000040:00080000:3.0:1788530080.365460:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11320 00000040:00080000:3.0:1788530080.365476:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 224 off11544 00000040:00080000:3.0:1788530080.365491:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 160 off11704 00000040:00080000:3.0:1788530080.365505:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11928 00000040:00080000:3.0:1788530080.366675:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 224 off12152 00000040:00080000:3.0:1788530080.366700:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 80 off12232 00000040:00080000:3.0:1788530080.366726:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 224 off12456 00000040:00080000:3.0:1788530080.366981:0:6521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:3.0:1788530080.367082:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555713024:0@lo:501: 00000100:00100000:3.0:1788530080.368287:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530080.368337:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f329c3cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788530080.368603:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555713024 00000100:00100000:3.0:1788530080.368614:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555713024 00000100:00100000:3.0:1788530080.368670:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788530080.368679:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+19:6521:x1875409555713024:12345-0@lo:501: 00000100:00100000:3.0:1788530080.370011:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+19:6521:x1875409555713024:12345-0@lo:501: Request processed in 1326us (2852us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530080.370024:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788530080.373686:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555713024:0@lo:501: 00000100:00100000:3.0:1788530080.373751:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555713152:0@lo:503: 00000100:00100000:3.0:1788530080.373811:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530080.373948:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f329c3cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788530080.378373:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555713152 00000100:00100000:0.0:1788530080.378391:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555713152 00000100:00100000:0.0:1788530080.381193:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788530080.381223:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+19:6521:x1875409555713152:12345-0@lo:503: 00000100:00100000:0.0:1788530080.381436:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+19:6521:x1875409555713152:12345-0@lo:503: Request processed in 226us (7624us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530080.381445:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788530080.381606:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555713152:0@lo:503: 00000040:00080000:3.0:1788530080.382161:0:6521:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788530080.382269:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555713280:0@lo:502: 00000100:00100000:3.0:1788530080.382322:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530080.393143:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555713280 00000100:00100000:2.0:1788530080.393940:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555713280 00000100:00100000:2.0:1788530080.394041:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788530080.394053:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+19:6521:x1875409555713280:12345-0@lo:502: 00000100:00100000:2.0:1788530080.394292:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+19:6521:x1875409555713280:12345-0@lo:502: Request processed in 241us (11969us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530080.394300:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788530080.394880:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f329c3cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788530080.394909:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555713280:0@lo:502: 00000040:00080000:2.0:1788530080.395974:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1788530080.396889:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 136 off8552 00000040:00080000:2.0:1788530080.396932:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 176 off8728 00000040:00080000:2.0:1788530080.396948:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8952 00000040:00080000:2.0:1788530080.396962:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9176 00000040:00080000:2.0:1788530080.396975:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9296 00000040:00080000:2.0:1788530080.396988:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 112 off9408 00000040:00080000:2.0:1788530080.397004:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 160 off9568 00000040:00080000:2.0:1788530080.397018:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9792 00000040:00080000:2.0:1788530080.397035:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off10016 00000040:00080000:2.0:1788530080.397049:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 88 off10104 00000040:00080000:2.0:1788530080.397063:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 144 off10248 00000040:00080000:2.0:1788530080.397091:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 152 off10400 00000040:00080000:2.0:1788530080.397105:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 168 off10568 00000040:00080000:2.0:1788530080.397117:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 224 off10792 00000040:00080000:2.0:1788530080.397129:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 224 off11016 00000040:00080000:2.0:1788530080.397140:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 80 off11096 00000040:00080000:2.0:1788530080.397176:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11320 00000040:00080000:2.0:1788530080.397193:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 224 off11544 00000040:00080000:2.0:1788530080.397206:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 160 off11704 00000040:00080000:2.0:1788530080.397219:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11928 00000040:00080000:2.0:1788530080.397938:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 224 off12152 00000040:00080000:2.0:1788530080.397972:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 80 off12232 00000040:00080000:2.0:1788530080.397988:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 224 off12456 00000040:00080000:2.0:1788530080.398004:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 224 off12680 00000040:00080000:2.0:1788530080.398017:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 88 off12768 00000040:00080000:2.0:1788530080.398030:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 144 off12912 00000040:00080000:2.0:1788530080.398044:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 152 off13064 00000040:00080000:2.0:1788530080.398056:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 136 off13200 00000040:00080000:2.0:1788530080.398067:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13424 00000040:00080000:2.0:1788530080.398078:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 224 off13648 00000040:00080000:2.0:1788530080.398088:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 80 off13728 00000100:00100000:2.0:1788530080.398129:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f2b92d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555713408:0@lo:502: 00000100:00100000:2.0:1788530080.398215:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530080.398272:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555713408 00000100:00100000:2.0:1788530080.398278:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555713408 00000100:00100000:2.0:1788530080.398346:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788530080.398355:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f396c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+19:6521:x1875409555713408:12345-0@lo:502: 00000100:00100000:2.0:1788530080.398487:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f396c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+19:6521:x1875409555713408:12345-0@lo:502: Request processed in 132us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530080.398495:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788530080.398541:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f08cdc540 going to sleep for 11 seconds 00000100:00100000:2.0:1788530080.398576:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f2b92d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555713408:0@lo:502: 00000040:00080000:2.0:1788530080.398751:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 224 off13952 00000040:00080000:2.0:1788530080.398760:0:6521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 33 count 34 00000020:01000000:2.0:1788530080.399734:0:8745:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788530080.399746:0:8745:0:(obd_mount.c:963:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1788530080.399755:0:8745:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788530080.399758:0:8745:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788530080.399764:0:8745:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788530080.399769:0:8745:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.141@tcp to nid 0x20000c0a8ca8d (192.168.202.141@tcp) 00000020:01000000:2.0:1788530080.399802:0:8745:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1788530080.399806:0:8745:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788530080.399832:0:8745:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9a9f33d96620) 00000020:00000080:2.0:1788530080.399855:0:8745:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:2.0:1788530080.399861:0:8745:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788530080.399952:0:8745:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:2.0:1788530080.399958:0:8745:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788530080.399965:0:8745:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb28d70e125750306 00010000:00080000:2.0:1788530080.399998:0:8745:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a9e0242c000@lustre-OST0000-osc-MDT0001: add connection 192.168.202.141@tcp at head 00010000:00010000:2.0:1788530080.400316:0:8745:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:3.0:1788530080.413850:0:8745:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1788530080.413881:0:8745:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1788530080.414231:0:8745:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788530080.414425:0:8745:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788530080.414509:0:8745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1788530080.414626:0:8745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1788530080.415414:0:8746:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788530080.415419:0:8746:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788530080.416135:0:8745:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788530080.416148:0:8745:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788530080.416316:0:8745:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788530080.416341:0:8745:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb28d70e12575030d 00000100:00080000:2.0:1788530080.416352:0:8745:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788530080.416358:0:8745:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9a9e0242c000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:2.0:1788530080.416395:0:8745:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9f2b92d880 x1875409555713536/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788530080.416420:0:8745:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788530080.416484:0:8745:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788530080.416488:0:8745:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788530080.416490:0:8745:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788530080.416493:0:8745:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788530080.416497:0:8745:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788530080.416499:0:8745:0:(obd_config.c:1563:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788530080.416502:0:8745:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788530080.416504:0:8745:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788530080.416523:0:8745:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788530080.416526:0:8745:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788530080.416527:0:8745:0:(obd_config.c:1563:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788530080.416530:0:8745:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 34 count 34 00000100:00100000:0.0:1788530080.416705:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f2b92d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875409555713536:0@lo:8: 00000100:00100000:0.0:1788530080.416800:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530080.416964:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3735c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875409555713664:0@lo:400: 00000100:00100000:0.0:1788530080.417000:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530080.417021:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3735ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875409555714176:0@lo:400: 00000100:00100000:0.0:1788530080.417043:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530080.417062:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788530080.417074:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3735f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875409555713792:0@lo:400: 00000100:00100000:0.0:1788530080.417111:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530080.417138:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3735c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555713920:0@lo:400: 00000100:00100000:0.0:1788530080.417355:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530080.417378:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788530080.417384:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3735dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875409555714048:0@lo:400: 00000100:00100000:0.0:1788530080.417408:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530080.417439:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555713664 00000100:00100000:0.0:1788530080.417446:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555713664 00000100:00100000:0.0:1788530080.417478:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555714176 00000100:00100000:0.0:1788530080.417481:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555714176 00000100:00100000:0.0:1788530080.417492:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555713792 00000100:00100000:0.0:1788530080.417494:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555713792 00000100:00100000:0.0:1788530080.417503:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555714048 00000100:00100000:0.0:1788530080.417505:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555714048 00000100:00100000:0.0:1788530080.417517:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788530080.417524:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3735df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875409555713664:12345-0@lo:400: 00000100:00100000:0.0:1788530080.417604:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3735df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875409555713664:12345-0@lo:400: Request processed in 79us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530080.417612:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788530080.417628:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788530080.417635:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3735e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875409555714176:12345-0@lo:400: 00000100:00100000:0.0:1788530080.417662:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3735e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875409555714176:12345-0@lo:400: Request processed in 28us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530080.417667:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788530080.417677:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788530080.417683:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3735ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875409555713792:12345-0@lo:400: 00000100:00100000:0.0:1788530080.417704:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3735ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875409555713792:12345-0@lo:400: Request processed in 22us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530080.417717:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788530080.417727:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788530080.417855:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555713536 00000100:00100000:2.0:1788530080.417860:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555713536 00000100:00100000:2.0:1788530080.417881:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788530080.417886:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3735f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3646:x1875409555713536:12345-0@lo:8: 00010000:00080000:2.0:1788530080.417910:0:8436:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 288 last 0 00000020:00000080:2.0:1788530080.417936:0:8436:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb28d70e125750314 00002000:00100000:2.0:1788530080.417976:0:8436:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9a9e0242f000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a05 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:2.0:1788530080.417981:0:8436:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:2.0:1788530080.417985:0:8436:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1788530080.418049:0:8436:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788530080.418403:0:8436:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:2.0:1788530080.418426:0:8436:0:(import.c:65:import_set_state_nolock()) ffff9a9e02429800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788530080.418481:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3735f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1875409555713536:12345-0@lo:8: Request processed in 594us (1682us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530080.418488:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788530080.418538:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9f2b92d880 x1875409555713536/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788530090 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530080.418578:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788530080.418587:0:3646:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1788530080.418594:0:3646:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788530080.418599:0:3646:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788530080.418602:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9e0242c000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788530080.418611:0:3646:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788530080.418616:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f2b92d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875409555713536:0@lo:8: 00000004:00080000:2.0:1788530080.418642:0:8746:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788530080.418690:0:8746:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 288321128482ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788530080.418696:0:8746:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1788530080.418839:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3735d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875409555714048:12345-0@lo:400: 00000100:00100000:0.0:1788530080.418878:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3735d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875409555714048:12345-0@lo:400: Request processed in 1145us (1469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530080.418885:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788530080.418910:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555713920 00000100:00100000:0.0:1788530080.418914:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555713920 00000100:00100000:0.0:1788530080.418940:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788530080.418946:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3735d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555713920:12345-0@lo:400: 00000100:00100000:0.0:1788530080.418975:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3735d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555713920:12345-0@lo:400: Request processed in 29us (1620us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530080.418981:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:0.0:1788530080.419018:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9f3735dc00 x1875409555714048/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530096 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530080.419029:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3735dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875409555714048:0@lo:400: 00000100:00100000:0.0:1788530080.419039:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3735c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555713920:0@lo:400: 00010000:00080000:0.0:1788530080.419067:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9f3735f480 x1875409555713792/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530096 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530080.419076:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3735f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875409555713792:0@lo:400: 00000020:01000000:3.0:1788530080.419356:0:6521:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:3.0:1788530080.419373:0:6521:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1788530080.419382:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d200/0xb28d70e1257502f1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257502f8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530080.419405:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d200/0xb28d70e1257502f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257502f8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788530080.419416:0:6521:0:(mgc_request.c:715:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788530080.419419:0:6521:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-sptlrpc-ffff9a9f32bea000 from 1 10000000:01000000:3.0:1788530080.419422:0:6521:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788530080.419452:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91cc00/0xb28d70e12575031b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530080.419461:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91cc00/0xb28d70e12575031b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530080.419470:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91cc00/0xb28d70e12575031b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530080.419487:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555714304:0@lo:101: 00000100:00100000:3.0:1788530080.419529:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530080.419580:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f329c3480 going to sleep for 11 seconds 00010000:00080000:0.0:1788530080.420744:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9f3735c000 x1875409555713664/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530096 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530080.420758:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3735c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875409555713664:0@lo:400: 00010000:00080000:0.0:1788530080.420772:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9f3735ed80 x1875409555714176/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530096 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530080.420789:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3735ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875409555714176:0@lo:400: 00000100:00100000:0.0:1788530080.420886:0:8747:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3735ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8747:1875409555714432:0@lo:700: 00000100:00100000:0.0:1788530080.420936:0:8747:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530080.420972:0:8747:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f0a15a840 going to sleep for 11 seconds 00000100:00100000:2.0:1788530080.421136:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555714304 00000100:00100000:2.0:1788530080.421143:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555714304 00000100:00100000:2.0:1788530080.421199:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788530080.421208:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f396c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+19:6521:x1875409555714304:12345-0@lo:101: 00010000:00010000:2.0:1788530080.421222:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530080.421242:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f18141400/0xb28d70e125750322 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e12575031b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530080.421267:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f18141400/0xb28d70e125750322 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e12575031b expref: 20 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530080.421278:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f18141400/0xb28d70e125750322 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e12575031b expref: 20 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530080.421287:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f18141400, rc 0) 00000100:00100000:2.0:1788530080.421324:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f396c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+20:6521:x1875409555714304:12345-0@lo:101: Request processed in 117us (1794us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530080.421331:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000004:00080000:2.0:1788530080.423269:0:7454:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:3.0:1788530080.426951:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555714432 00000100:00100000:3.0:1788530080.426967:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555714432 00000100:00100000:3.0:1788530080.427036:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788530080.427047:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3735c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8747:x1875409555714432:12345-0@lo:700: 00000100:00080000:2.0:1788530080.428122:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788530080.428316:0:8445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e7800 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8445:1875409555714560:0@lo:700: 00000100:00100000:3.0:1788530080.428382:0:8445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530080.428421:0:8445:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f17d3ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1788530080.428467:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555714304:0@lo:101: 00010000:00010000:3.0:1788530080.428489:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91cc00/0xb28d70e12575031b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125750322 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530080.428511:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91cc00/0xb28d70e12575031b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e125750322 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530080.428612:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555714688:0@lo:501: 00000100:00100000:3.0:1788530080.428639:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530080.428668:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555714688 00000100:00100000:3.0:1788530080.428674:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555714688 00000100:00100000:3.0:1788530080.428708:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788530080.428716:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f396c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+20:6521:x1875409555714688:12345-0@lo:501: 00000100:00100000:2.0:1788530080.428844:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555714560 00000100:00100000:2.0:1788530080.428848:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555714560 00000100:00100000:2.0:1788530080.428880:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788530080.428887:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f328e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8445:x1875409555714560:12345-0@lo:700: 00000100:00100000:3.0:1788530080.429254:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f396c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+20:6521:x1875409555714688:12345-0@lo:501: Request processed in 537us (613us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788530080.429261:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788530080.429299:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f329c3480 going to sleep for 11 seconds 00000100:00100000:3.0:1788530080.429312:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555714688:0@lo:501: 10000000:01000000:3.0:1788530080.429326:0:6521:0:(mgc_request_server.c:748:mgc_llog_local_copy()) MGC192.168.202.141@tcp: no remote llog for lustre-sptlrpc, check MGS config 00000100:00100000:3.0:1788530080.429356:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555714816:0@lo:501: 00000100:00100000:3.0:1788530080.429378:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530080.429391:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f329c3480 going to sleep for 11 seconds 00000100:00100000:3.0:1788530080.429403:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555714816 00000100:00100000:3.0:1788530080.429406:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555714816 00000100:00100000:3.0:1788530080.429977:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788530080.429987:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f396c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+20:6521:x1875409555714816:12345-0@lo:501: 00000100:00100000:3.0:1788530080.430061:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f396c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+20:6521:x1875409555714816:12345-0@lo:501: Request processed in 76us (682us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788530080.430068:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788530080.430311:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555714816:0@lo:501: 10000000:01000000:1.0:1788530080.430337:0:6521:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788530080.430347:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91cc00/0xb28d70e12575031b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125750322 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530080.430357:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91cc00/0xb28d70e12575031b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125750322 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788530080.430368:0:6521:0:(mgc_request.c:715:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788530080.430371:0:6521:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-client-ffff9a9f0aaed800 from 30 10000000:01000000:1.0:1788530080.430374:0:6521:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788530080.430399:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f42166400/0xb28d70e125750329 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530080.430408:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f42166400/0xb28d70e125750329 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530080.430417:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f42166400/0xb28d70e125750329 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530080.430432:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555714944:0@lo:101: 00000100:00100000:1.0:1788530080.430471:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530080.430761:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f2c1b3cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788530080.430900:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555714944 00000100:00100000:2.0:1788530080.430906:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555714944 00000100:00100000:2.0:1788530080.430937:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788530080.430944:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f396c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+20:6521:x1875409555714944:12345-0@lo:101: 00010000:00010000:2.0:1788530080.430954:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530080.430966:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f18141600/0xb28d70e125750330 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e125750329 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530080.430987:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f18141600/0xb28d70e125750330 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e125750329 expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530080.430997:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f18141600/0xb28d70e125750330 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125750329 expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530080.431005:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f18141600, rc 0) 00000100:00100000:2.0:1788530080.431048:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f396c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+21:6521:x1875409555714944:12345-0@lo:101: Request processed in 104us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530080.431055:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788530080.434753:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555714944:0@lo:101: 00010000:00010000:1.0:1788530080.434788:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f42166400/0xb28d70e125750329 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125750330 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530080.434803:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f42166400/0xb28d70e125750329 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e125750330 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530080.434880:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555715072:0@lo:501: 00000100:00100000:1.0:1788530080.434956:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530080.435013:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555715072 00000100:00100000:1.0:1788530080.435021:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555715072 00000100:00100000:1.0:1788530080.435078:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788530080.435097:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f396c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+21:6521:x1875409555715072:12345-0@lo:501: 00000100:00100000:1.0:1788530080.435258:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f396c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+21:6521:x1875409555715072:12345-0@lo:501: Request processed in 163us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530080.435265:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788530080.435322:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f2c1b3cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788530080.435335:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555715072:0@lo:501: 00000100:00100000:1.0:1788530080.435360:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555715200:0@lo:503: 00000100:00100000:1.0:1788530080.435405:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530080.435425:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555715200 00000100:00100000:1.0:1788530080.435428:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555715200 00000100:00100000:1.0:1788530080.435448:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788530080.435453:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f396c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+21:6521:x1875409555715200:12345-0@lo:503: 00000100:00100000:1.0:1788530080.435536:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f396c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+21:6521:x1875409555715200:12345-0@lo:503: Request processed in 82us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530080.435543:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788530080.435615:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f2c1b3cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788530080.435628:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555715200:0@lo:503: 40000000:02000000:2.0:1788530080.438558:0:6530:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000100:00100000:2.0:1788530080.444697:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f328e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8445:x1875409555714560:12345-0@lo:700: Request processed in 15802us (16305us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530080.444712:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788530080.444938:0:8748:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f2b92d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:8748:1875409555715328:0@lo:502: 00000100:00100000:2.0:1788530080.445001:0:8748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530080.445036:0:8748:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f05320300 going to sleep for 11 seconds 00000100:00100000:1.0:1788530080.445159:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555715328 00000100:00100000:1.0:1788530080.445166:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555715328 00000100:00100000:1.0:1788530080.445206:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788530080.445215:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f396c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+21:8748:x1875409555715328:12345-0@lo:502: 00000100:00100000:1.0:1788530080.445321:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f396c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+21:8748:x1875409555715328:12345-0@lo:502: Request processed in 107us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530080.445328:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788530080.445557:0:8748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f2b92d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:8748:1875409555715328:0@lo:502: 00000100:00100000:2.0:1788530080.445951:0:8748:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f2b92d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:8748:1875409555715456:0@lo:502: 00000100:00100000:2.0:1788530080.446000:0:8748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530080.446044:0:8748:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f05320300 going to sleep for 11 seconds 00010000:00080000:0.0:1788530080.446139:0:8445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9f328e7800 x1875409555714560/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788530096 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530080.446281:0:8445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e7800 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8445:1875409555714560:0@lo:700: 40000000:02000000:0.0:1788530080.446294:0:8445:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000100:00100000:1.0:1788530080.447912:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555715456 00000100:00100000:1.0:1788530080.447933:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555715456 00000100:00100000:1.0:1788530080.448033:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788530080.448047:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f396c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+21:8748:x1875409555715456:12345-0@lo:502: 00000100:00100000:1.0:1788530080.448525:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f396c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+21:8748:x1875409555715456:12345-0@lo:502: Request processed in 480us (2523us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530080.448533:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788530080.448829:0:8748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f2b92d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:8748:1875409555715456:0@lo:502: 00000040:00080000:2.0:1788530080.448868:0:8748:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1788530080.449847:0:6521:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1788530080.449860:0:6521:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788530080.449872:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f42166400/0xb28d70e125750329 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125750330 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530080.449888:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f42166400/0xb28d70e125750329 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125750330 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788530080.449920:0:6521:0:(mgc_request.c:715:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788530080.449923:0:6521:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-mdtir-ffff9a9f0aaed800 from 5 10000000:01000000:1.0:1788530080.449927:0:6521:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788530080.449969:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f42166600/0xb28d70e125750337 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530080.449978:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f42166600/0xb28d70e125750337 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530080.449988:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f42166600/0xb28d70e125750337 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530080.450011:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555715584:0@lo:101: 00000100:00100000:1.0:1788530080.450065:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530080.450119:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f32b9fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1788530080.450299:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555715584 00000100:00100000:2.0:1788530080.450306:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555715584 00000100:00100000:2.0:1788530080.450354:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788530080.450363:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f396c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+21:6521:x1875409555715584:12345-0@lo:101: 00010000:00010000:2.0:1788530080.450377:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530080.450392:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f18140800/0xb28d70e12575033e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e125750337 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530080.450420:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f18140800/0xb28d70e12575033e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e125750337 expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530080.450431:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f18140800/0xb28d70e12575033e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125750337 expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530080.450440:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f18140800, rc 0) 00000100:00100000:2.0:1788530080.450477:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f396c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+22:6521:x1875409555715584:12345-0@lo:101: Request processed in 115us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530080.450483:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788530080.450588:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555715584:0@lo:101: 00010000:00010000:1.0:1788530080.450602:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f42166600/0xb28d70e125750337 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575033e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530080.450611:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f42166600/0xb28d70e125750337 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e12575033e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530080.450665:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555715712:0@lo:256: 00000100:00100000:1.0:1788530080.450695:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530080.450712:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f32b9fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1788530080.450893:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555715712 00000100:00100000:2.0:1788530080.450904:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555715712 00000100:00100000:2.0:1788530080.450934:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788530080.450941:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f396c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+22:6521:x1875409555715712:12345-0@lo:256: 20000000:01000000:2.0:1788530080.450954:0:6517:0:(mgs_nids.c:1159:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788530080.450969:0:6517:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788530080.450972:0:6517:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1788530080.451061:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f396c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+22:6521:x1875409555715712:12345-0@lo:256: Request processed in 120us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530080.451068:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788530080.451261:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555715712:0@lo:256: 10000000:01000000:1.0:1788530080.451302:0:6521:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788530080.451313:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f42166600/0xb28d70e125750337 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575033e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530080.451321:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f42166600/0xb28d70e125750337 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575033e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788530080.451329:0:6521:0:(mgc_request.c:715:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788530080.451332:0:6521:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:1.0:1788530080.451334:0:6521:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788530080.451351:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f42167200/0xb28d70e125750345 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530080.451359:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f42167200/0xb28d70e125750345 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530080.451368:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f42167200/0xb28d70e125750345 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530080.451380:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555715840:0@lo:101: 00000100:00100000:1.0:1788530080.451404:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530080.451425:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555715840 00000100:00100000:1.0:1788530080.451428:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555715840 00000100:00100000:1.0:1788530080.451452:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788530080.451459:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f396c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+22:6521:x1875409555715840:12345-0@lo:101: 00010000:00010000:1.0:1788530080.451467:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530080.451479:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f42167e00/0xb28d70e12575034c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e125750345 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530080.451495:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f42167e00/0xb28d70e12575034c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e125750345 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530080.451516:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f42167e00/0xb28d70e12575034c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125750345 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530080.451524:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f42167e00, rc 0) 00000100:00100000:1.0:1788530080.451548:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f396c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+23:6521:x1875409555715840:12345-0@lo:101: Request processed in 89us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530080.451553:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788530080.451602:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f32b9fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788530080.451614:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555715840:0@lo:101: 00010000:00010000:1.0:1788530080.451623:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f42167200/0xb28d70e125750345 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575034c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530080.451631:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f42167200/0xb28d70e125750345 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e12575034c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530080.451657:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555715968:0@lo:501: 00000100:00100000:1.0:1788530080.451678:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530080.451694:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555715968 00000100:00100000:1.0:1788530080.451698:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555715968 00000100:00100000:1.0:1788530080.451718:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788530080.451724:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f396c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+23:6521:x1875409555715968:12345-0@lo:501: 00000100:00100000:1.0:1788530080.453351:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f396c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+23:6521:x1875409555715968:12345-0@lo:501: Request processed in 1621us (1665us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530080.453362:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788530080.453421:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f32b9fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788530080.453441:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555715968:0@lo:501: 00000100:00100000:1.0:1788530080.453486:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555716096:0@lo:503: 00000100:00100000:1.0:1788530080.453527:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530080.453545:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f32b9fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1788530080.453676:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555716096 00000100:00100000:2.0:1788530080.453683:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555716096 00000100:00100000:2.0:1788530080.453715:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788530080.453723:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+23:6521:x1875409555716096:12345-0@lo:503: 00000100:00100000:2.0:1788530080.453850:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+23:6521:x1875409555716096:12345-0@lo:503: Request processed in 127us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530080.453858:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788530080.462893:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555716096:0@lo:503: 00000100:00100000:3.0:1788530080.464392:0:8749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:8749:1875409555716224:0@lo:502: 00000100:00100000:3.0:1788530080.464481:0:8749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530080.464528:0:8749:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f04d829c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788530080.464849:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555716224 00000100:00100000:1.0:1788530080.464857:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555716224 00000100:00100000:1.0:1788530080.464903:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788530080.464913:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+23:8749:x1875409555716224:12345-0@lo:502: 00000100:00100000:1.0:1788530080.465038:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+23:8749:x1875409555716224:12345-0@lo:502: Request processed in 127us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530080.465047:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788530080.465344:0:8749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:8749:1875409555716224:0@lo:502: 00000020:01000000:3.0:1788530080.465373:0:8749:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788530080.465381:0:8749:0:(obd_mount.c:963:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788530080.465388:0:8749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788530080.465390:0:8749:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788530080.465395:0:8749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788530080.465399:0:8749:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.141@tcp to nid 0x20000c0a8ca8d (192.168.202.141@tcp) 00000020:01000000:3.0:1788530080.465419:0:8749:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788530080.465422:0:8749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788530080.465436:0:8749:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9a9f2c104c98) 00000020:00000080:3.0:1788530080.465456:0:8749:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:3.0:1788530080.465462:0:8749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788530080.465554:0:8749:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788530080.465580:0:8749:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:3.0:1788530080.465595:0:8749:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb28d70e12575035a 00010000:00080000:3.0:1788530080.465625:0:8749:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a9e02588000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.141@tcp at head 00010000:00010000:3.0:1788530080.467025:0:8749:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000001:00100000:1.0:1788530080.471825:0:8431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1788530080.472072:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3735c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8747:x1875409555714432:12345-0@lo:700: Request processed in 45022us (51131us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530080.472117:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788530080.472790:0:8747:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9f3735ed80 x1875409555714432/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788530096 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530080.472805:0:8747:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3735ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8747:1875409555714432:0@lo:700: 00000040:01000000:0.0:1788530080.480467:0:8749:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1788530080.480510:0:8749:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788530080.480905:0:8749:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788530080.482500:0:8749:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788530080.488103:0:8749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1788530080.488214:0:8749:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1788530080.491899:0:8750:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788530080.491906:0:8750:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1788530080.492608:0:8749:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788530080.492620:0:8749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788530080.492653:0:8749:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788530080.492674:0:8749:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb28d70e125750361 00000100:00080000:0.0:1788530080.492686:0:8749:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788530080.493321:0:8749:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9a9e02588000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:0.0:1788530080.493359:0:8749:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9f3735f480 x1875409555716352/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788530080.493435:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3735f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875409555716352:0@lo:8: 00000100:00100000:3.0:1788530080.493498:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530080.493839:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555716352 00000100:00100000:0.0:1788530080.493855:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555716352 00000100:00100000:0.0:1788530080.493885:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788530080.493891:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f328e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3646:x1875409555716352:12345-0@lo:8: 00010000:00080000:0.0:1788530080.493915:0:8439:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 288 last 0 00000020:00000080:0.0:1788530080.493952:0:8439:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb28d70e125750368 00002000:00100000:0.0:1788530080.493964:0:8439:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9a9e025cf000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a05 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1788530080.493968:0:8439:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1788530080.493970:0:8439:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788530080.494041:0:8439:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788530080.494061:0:8439:0:(import.c:65:import_set_state_nolock()) ffff9a9e025c9800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788530080.494344:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788530080.494355:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555716480:0@lo:13: 00000100:00100000:1.0:1788530080.494397:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1788530080.494421:0:8747:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:1.0:1788530080.494438:0:8747:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8747:1875409555716608:0@lo:7: 00000100:00100000:1.0:1788530080.494456:0:8747:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530080.494476:0:8438:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788530080.494482:0:8438:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1788530080.494598:0:8747:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f32b9fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788530080.494620:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555716608 00000100:00100000:1.0:1788530080.494624:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555716608 00000100:00100000:1.0:1788530080.494713:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788530080.494720:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32bd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8747:x1875409555716608:12345-0@lo:7: 00000100:00100000:2.0:1788530080.494879:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555716480 00000100:00100000:2.0:1788530080.494885:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555716480 00000100:00100000:2.0:1788530080.494918:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788530080.494926:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32bd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3649:x1875409555716480:12345-0@lo:13: 00002000:00000024:2.0:1788530080.494950:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:2.0:1788530080.495001:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32bd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3649:x1875409555716480:12345-0@lo:13: Request processed in 76us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530080.495007:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788530080.495044:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9f32bd0a80 x1875409555716480/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530096 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530080.495065:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555716480:0@lo:13: 00000100:00100000:0.0:1788530080.495285:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f328e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3646:x1875409555716352:12345-0@lo:8: Request processed in 1391us (1785us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530080.495294:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788530080.495341:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9f3735f480 x1875409555716352/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788530090 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530080.495350:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788530080.495359:0:3646:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788530080.495369:0:3646:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788530080.495376:0:3646:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788530080.495379:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9e02588000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788530080.495391:0:3646:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788530080.495396:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3735f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875409555716352:0@lo:8: 00000100:00080000:0.0:1788530080.495425:0:8749:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1788530080.495553:0:8749:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788530080.495573:0:8749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788530080.495575:0:8749:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788530080.495579:0:8749:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788530080.495589:0:8749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788530080.495591:0:8749:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788530080.495595:0:8749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788530080.495597:0:8749:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788530080.495625:0:8749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3735f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:8749:1875409555716736:0@lo:502: 00000100:00100000:0.0:1788530080.495669:0:8749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530080.495696:0:8749:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f0a15a540 going to sleep for 11 seconds 00000100:00100000:1.0:1788530080.496288:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555716736 00000100:00100000:1.0:1788530080.496296:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555716736 00000100:00100000:1.0:1788530080.496337:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788530080.496346:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+23:8749:x1875409555716736:12345-0@lo:502: 00000100:00100000:1.0:1788530080.496521:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+23:8749:x1875409555716736:12345-0@lo:502: Request processed in 175us (851us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530080.496528:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000004:00080000:3.0:1788530080.496888:0:8750:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788530080.496979:0:8750:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 288399418232ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788530080.496986:0:8750:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1788530080.497863:0:8749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3735f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:8749:1875409555716736:0@lo:502: 00000020:01000000:0.0:1788530080.497904:0:8749:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788530080.497913:0:8749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788530080.497915:0:8749:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788530080.497922:0:8749:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:1.0:1788530080.501515:0:6521:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:1.0:1788530080.501531:0:6521:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788530080.501542:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f42167200/0xb28d70e125750345 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575034c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530080.501556:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f42167200/0xb28d70e125750345 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575034c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788530080.501582:0:6521:0:(mgc_request.c:715:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788530080.501585:0:6521:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-sptlrpc-ffff9a9f0aaed800 from 1 10000000:01000000:1.0:1788530080.501588:0:6521:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788530080.501636:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9e025dd000/0xb28d70e12575036f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530080.501645:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9e025dd000/0xb28d70e12575036f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530080.501657:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9e025dd000/0xb28d70e12575036f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530080.501679:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555716864:0@lo:101: 00000100:00100000:1.0:1788530080.503531:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530080.503588:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f3d103900 going to sleep for 11 seconds 00000100:00100000:1.0:1788530080.504924:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555716864 00000100:00100000:1.0:1788530080.504938:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555716864 00000100:00100000:1.0:1788530080.504999:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788530080.505009:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+23:6521:x1875409555716864:12345-0@lo:101: 00010000:00010000:1.0:1788530080.505025:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530080.505044:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9e025dc200/0xb28d70e125750376 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e12575036f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530080.505071:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9e025dc200/0xb28d70e125750376 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e12575036f expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530080.505082:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9e025dc200/0xb28d70e125750376 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e12575036f expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530080.505091:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9e025dc200, rc 0) 00000100:00100000:1.0:1788530080.505148:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+24:6521:x1875409555716864:12345-0@lo:101: Request processed in 141us (1622us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530080.506433:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788530080.506518:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555716864:0@lo:101: 00010000:00010000:1.0:1788530080.506539:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9e025dd000/0xb28d70e12575036f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125750376 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530080.506550:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9e025dd000/0xb28d70e12575036f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e125750376 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530080.506612:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555716992:0@lo:501: 00000100:00100000:1.0:1788530080.506663:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530080.506694:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f3d103900 going to sleep for 11 seconds 00000100:00100000:1.0:1788530080.510325:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555716992 00000100:00100000:1.0:1788530080.510349:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555716992 00000100:00100000:1.0:1788530080.510419:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788530080.510432:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+24:6521:x1875409555716992:12345-0@lo:501: 00000100:00100000:1.0:1788530080.510617:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+24:6521:x1875409555716992:12345-0@lo:501: Request processed in 188us (3953us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788530080.510625:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788530080.512977:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555716992:0@lo:501: 10000000:01000000:1.0:1788530080.514280:0:6521:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788530080.514293:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9e025dd000/0xb28d70e12575036f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125750376 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530080.514305:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9e025dd000/0xb28d70e12575036f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125750376 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788530080.514371:0:6502:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:1.0:1788530080.514450:0:8751:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1788530080.514476:0:8751:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd1500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8751:1875409555717248:0@lo:7: 00000100:00100000:1.0:1788530080.514543:0:8751:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530080.514589:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555717248 00000100:00100000:1.0:1788530080.514595:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555717248 00000100:00100000:1.0:1788530080.514644:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788530080.514653:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32bd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8751:x1875409555717248:12345-0@lo:7: 00000100:00100000:1.0:1788530080.514702:0:8751:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f3d103900 going to sleep for 11 seconds 00000100:00080000:2.0:1788530080.514968:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788530080.515866:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555717120:0@lo:13: 00000100:00100000:0.0:1788530080.515928:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:0.0:1788530080.526415:0:8752:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1788530080.526427:0:8752:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:0.0:1788530080.526529:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32bd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8747:x1875409555716608:12345-0@lo:7: Request processed in 31805us (32067us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530080.526540:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788530080.526702:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555717120 00000100:00100000:3.0:1788530080.526710:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555717120 00000100:00100000:3.0:1788530080.526848:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788530080.526859:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3735f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1875409555717120:12345-0@lo:13: 00002000:00000024:3.0:1788530080.526882:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:3.0:1788530080.527219:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3735f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1875409555717120:12345-0@lo:13: Request processed in 362us (11289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530080.527227:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788530080.527267:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9f32bd2a00 x1875409555717120/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530096 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530080.527288:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555717120:0@lo:13: 00010000:00080000:0.0:1788530080.530436:0:8747:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9f32bd2d80 x1875409555716608/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788530096 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530080.530455:0:8747:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8747:1875409555716608:0@lo:7: 00000004:00080000:0.0:1788530080.530471:0:8747:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:0.0:1788530080.530522:0:8747:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3735c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8747:1875409555717376:0@lo:5: 00000100:00100000:0.0:1788530080.530609:0:8747:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530080.530666:0:8747:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f0a15a000 going to sleep for 11 seconds 00000100:00100000:2.0:1788530080.530859:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555717376 00000100:00100000:2.0:1788530080.530866:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555717376 00000100:00100000:2.0:1788530080.531838:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788530080.531859:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3735dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8747:x1875409555717376:12345-0@lo:5: 00002000:00080000:2.0:1788530080.531894:0:8439:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:2.0:1788530080.533026:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3735dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8747:x1875409555717376:12345-0@lo:5: Request processed in 1166us (2410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530080.533039:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788530080.533830:0:8747:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9f3735c700 x1875409555717376/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788530096 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530080.533849:0:8747:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3735c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8747:1875409555717376:0@lo:5: 00000004:00080000:2.0:1788530080.533868:0:8747:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:2.0:1788530080.533924:0:8747:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f2b92d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8747:1875409555717504:0@lo:5: 00000100:00100000:2.0:1788530080.533975:0:8747:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530080.534008:0:8747:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f17d3ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1788530080.534036:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555717504 00000100:00100000:2.0:1788530080.534043:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555717504 00000100:00100000:2.0:1788530080.536278:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788530080.536297:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f2b92d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8747:x1875409555717504:12345-0@lo:5: 00002000:00080000:2.0:1788530080.536339:0:8752:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00002000:00080000:1.0:1788530080.547696:0:8438:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:1.0:1788530080.547710:0:8438:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:1.0:1788530080.547771:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32bd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8751:x1875409555717248:12345-0@lo:7: Request processed in 33116us (33224us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530080.547781:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788530080.547843:0:8751:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9f32bd1500 x1875409555717248/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788530096 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530080.547856:0:8751:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd1500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8751:1875409555717248:0@lo:7: 00000004:00080000:1.0:1788530080.547870:0:8751:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:1.0:1788530080.547909:0:8751:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd1500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8751:1875409555717632:0@lo:5: 00000100:00100000:1.0:1788530080.547940:0:8751:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530080.547971:0:8751:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f3d103900 going to sleep for 11 seconds 00000100:00100000:2.0:1788530080.548588:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f2b92d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:8747:x1875409555717504:12345-0@lo:5: Request processed in 12295us (14610us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788530080.548598:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788530080.548620:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555717632 00000100:00100000:2.0:1788530080.548626:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555717632 00000100:00100000:2.0:1788530080.548675:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788530080.548691:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32bd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8751:x1875409555717632:12345-0@lo:5: 00002000:00080000:2.0:1788530080.548726:0:8752:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1788530080.548731:0:8752:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00010000:00080000:3.0:1788530080.558306:0:8747:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9f2b92d880 x1875409555717504/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788530096 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530080.558340:0:8747:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f2b92d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8747:1875409555717504:0@lo:5: 00000004:00080000:3.0:1788530080.558363:0:8747:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:3.0:1788530080.558435:0:8747:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e7800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8747:1875409555717760:0@lo:900: 00000100:00100000:3.0:1788530080.558523:0:8747:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530080.558557:0:8747:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f04d82d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788530080.558703:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555717760 00000100:00100000:1.0:1788530080.558713:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555717760 00000100:00100000:1.0:1788530080.558786:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788530080.558801:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f328e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8747:x1875409555717760:12345-0@lo:900: 00000100:00100000:1.0:1788530080.558880:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f328e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8747:x1875409555717760:12345-0@lo:900: Request processed in 83us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530080.558889:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788530080.560052:0:8747:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9f328e7800 x1875409555717760/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788530096 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530080.560070:0:8747:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e7800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8747:1875409555717760:0@lo:900: 00000001:00080000:3.0:1788530080.563220:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000001:00080000:3.0:1788530080.563238:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:3.0:1788530080.563245:0:8431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1788530080.563711:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32bd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:8751:x1875409555717632:12345-0@lo:5: Request processed in 15014us (15763us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1788530080.563725:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788530080.563879:0:8751:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9f32bd1500 x1875409555717632/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788530096 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530080.563892:0:8751:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788530080.563900:0:8751:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd1500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8751:1875409555717632:0@lo:5: 00000004:00080000:1.0:1788530080.563917:0:8751:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1788530080.563968:0:8751:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd1500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8751:1875409555717888:0@lo:700: 00000100:00100000:1.0:1788530080.564005:0:8751:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530080.564107:0:8751:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f3d103900 going to sleep for 11 seconds 00000100:00100000:2.0:1788530080.565473:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555717888 00000100:00100000:2.0:1788530080.565490:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555717888 00000100:00100000:2.0:1788530080.565578:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788530080.565589:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32bd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8751:x1875409555717888:12345-0@lo:700: 00000100:00100000:2.0:1788530080.579036:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32bd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8751:x1875409555717888:12345-0@lo:700: Request processed in 13430us (15011us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530080.579056:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788530080.579237:0:8751:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9f32bd1500 x1875409555717888/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788530096 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530080.579254:0:8751:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd1500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8751:1875409555717888:0@lo:700: 00000004:02000040:3.0:1788530080.583279:0:8751:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:3.0:1788530080.587384:0:8751:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e7800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8751:1875409555718016:0@lo:5: 00000100:00100000:3.0:1788530080.587473:0:8751:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530080.587577:0:8751:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f04d82d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788530080.587643:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555718016 00000100:00100000:1.0:1788530080.587652:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555718016 00000100:00100000:1.0:1788530080.587712:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788530080.587723:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f328e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8751:x1875409555718016:12345-0@lo:5: 00002000:00080000:1.0:1788530080.592534:0:8438:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:1.0:1788530080.592556:0:8438:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:1.0:1788530080.594301:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f328e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8751:x1875409555718016:12345-0@lo:5: Request processed in 6570us (6818us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788530080.594316:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1788530080.594408:0:8751:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9f328e7800 x1875409555718016/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788530096 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530080.594428:0:8751:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e7800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8751:1875409555718016:0@lo:5: 00000004:00080000:1.0:1788530080.594447:0:8751:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00010000:00010000:1.0:1788530080.964896:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788530081.862822:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555718144:0@lo:41: 00000100:00100000:0.0:1788530081.862911:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530081.863197:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555718144 00000100:00100000:1.0:1788530081.863207:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555718144 00000100:00100000:3.0:1788530081.864854:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788530081.864871:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3735d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555718144:12345-0@lo:41: 00000004:00000024:3.0:1788530081.864910:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446502400 avail 1300262912 00000100:00100000:3.0:1788530081.865034:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3735d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555718144:12345-0@lo:41: Request processed in 168us (2123us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530081.865042:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788530081.865208:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555718144:0@lo:41: 00000001:02000400:1.0:1788530081.917452:0:8814:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg241-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788530081.986821:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788530083.003017:0:8867:0:(tgt_mount.c:2429:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788530083.003455:0:8867:0:(tgt_mount.c:2444:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788530083.010479:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788530083.934459:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00010000:00010000:2.0:1788530084.033447:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530085.057958:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788530085.445896:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788530085.445923:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555718272:0@lo:41: 00000100:00100000:3.0:1788530085.446016:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530085.446111:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555718272 00000100:00100000:3.0:1788530085.446119:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555718272 00000100:00100000:3.0:1788530085.446174:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788530085.446184:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555718272:12345-0@lo:41: 00000004:00000024:3.0:1788530085.446225:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:3.0:1788530085.446270:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555718272:12345-0@lo:41: Request processed in 86us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530085.446277:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788530085.446324:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555718272:0@lo:41: 00000100:00100000:3.0:1788530085.953834:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32a54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555718400:0@lo:13: 00000100:00100000:3.0:1788530085.953929:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530085.954207:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555718400 00000100:00100000:3.0:1788530085.954218:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555718400 00000100:00100000:3.0:1788530085.954339:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788530085.954349:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555718400:12345-0@lo:13: 00002000:00000024:3.0:1788530085.954390:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788530085.954437:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555718400:12345-0@lo:13: Request processed in 89us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530085.954444:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1788530085.954465:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788530085.954595:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9f32a54000 x1875409555718400/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530101 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530085.954607:0:3650:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1788530085.954630:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32a54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555718400:0@lo:13: 00000100:00100000:1.0:1788530085.955184:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555718528:0@lo:13: 00000100:00100000:1.0:1788530085.955236:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530085.960351:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32a55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875409555718784:0@lo:400: 00000100:00100000:1.0:1788530085.960351:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32a54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3648:1875409555718656:0@lo:400: 00000100:00100000:2.0:1788530085.962836:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32a57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555719040:0@lo:400: 00000100:00100000:1.0:1788530085.964460:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530085.964540:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32a57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875409555719168:0@lo:400: 00000100:00100000:1.0:1788530085.964739:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530085.965593:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555718656 00000100:00100000:0.0:1788530085.965609:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555718656 00000100:00100000:0.0:1788530085.965686:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788530085.965698:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+24:3648:x1875409555718656:12345-0@lo:400: 00000100:00100000:0.0:1788530085.965816:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+24:3648:x1875409555718656:12345-0@lo:400: Request processed in 119us (1371us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530085.965825:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788530085.967151:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555719168 00000100:00100000:0.0:1788530085.967164:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555719168 00000100:00100000:0.0:1788530085.967236:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788530085.967244:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32bd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875409555719168:12345-0@lo:400: 00000100:00100000:0.0:1788530085.967325:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32bd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875409555719168:12345-0@lo:400: Request processed in 82us (2586us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530085.967332:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788530085.967397:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32a54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3648:1875409555718656:0@lo:400: 00010000:00080000:0.0:1788530085.967414:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9f32a57480 x1875409555719168/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530101 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530085.967427:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32a57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875409555719168:0@lo:400: 00000100:00080000:3.0:1788530085.969107:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788530085.969182:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32a54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875409555718912:0@lo:400: 00000100:00100000:3.0:1788530085.969275:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530085.969348:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530085.969379:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555718912 00000100:00100000:3.0:1788530085.969388:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555718912 00000100:00100000:3.0:1788530085.969440:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555718784 00000100:00100000:3.0:1788530085.969443:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555718784 00000100:00100000:3.0:1788530085.969462:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788530085.969470:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875409555718912:12345-0@lo:400: 00000100:00100000:3.0:1788530085.969537:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875409555718912:12345-0@lo:400: Request processed in 68us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530085.969544:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788530085.969577:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788530085.969583:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875409555718784:12345-0@lo:400: 00000100:00100000:3.0:1788530085.969609:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875409555718784:12345-0@lo:400: Request processed in 27us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530085.969625:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1788530085.969669:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9f32a54a80 x1875409555718912/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530101 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530085.969684:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32a54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875409555718912:0@lo:400: 00010000:00080000:3.0:1788530085.969709:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9f32a55500 x1875409555718784/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530101 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530085.969717:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32a55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875409555718784:0@lo:400: 00000100:00100000:3.0:1788530085.969724:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32a54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875409555719296:0@lo:400: 00000100:00100000:3.0:1788530085.969745:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530085.969759:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555719296 00000100:00100000:3.0:1788530085.969773:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555719296 00000100:00100000:3.0:1788530085.969798:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788530085.969804:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875409555719296:12345-0@lo:400: 00000100:00100000:3.0:1788530085.969829:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875409555719296:12345-0@lo:400: Request processed in 25us (84us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530085.969835:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:3.0:1788530085.969846:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1788530085.969858:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9f32a54700 x1875409555719296/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530101 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530085.969866:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32a54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875409555719296:0@lo:400: 00000100:00100000:0.0:1788530085.972098:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555718528 00000100:00100000:0.0:1788530085.972115:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555718528 00000100:00100000:0.0:1788530085.972181:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788530085.972191:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32bd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555718528:12345-0@lo:13: 00002000:00000024:0.0:1788530085.972216:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788530085.972307:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32bd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555718528:12345-0@lo:13: Request processed in 117us (17071us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530085.972314:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1788530085.973154:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788530085.974837:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530085.974966:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555719040 00000100:00100000:3.0:1788530085.974983:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555719040 00000100:00100000:3.0:1788530085.975094:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788530085.975109:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f2b92ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555719040:12345-0@lo:400: 00010000:00080000:2.0:1788530085.976123:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9f32bd1500 x1875409555718528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530101 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530085.976141:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:2.0:1788530085.976177:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555718528:0@lo:13: 00000100:00100000:3.0:1788530085.996904:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f2b92ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555719040:12345-0@lo:400: Request processed in 21790us (22068us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530085.996920:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788530085.997880:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32a57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555719040:0@lo:400: 00010000:00010000:3.0:1788530086.084734:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788530086.158642:0:8968:0:(tgt_mount.c:2429:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788530086.158941:0:8968:0:(tgt_mount.c:2444:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788530086.985649:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f2b92e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555719424:0@lo:41: 00000100:00100000:1.0:1788530086.985721:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530086.985847:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555719424 00000100:00100000:2.0:1788530086.985855:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555719424 00000100:00100000:2.0:1788530086.985908:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788530086.985917:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32bd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555719424:12345-0@lo:41: 00000004:00000024:2.0:1788530086.985951:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446502400 avail 1300262912 00000100:00100000:2.0:1788530086.985997:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32bd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555719424:12345-0@lo:41: Request processed in 81us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530086.986027:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788530086.986648:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f2b92e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555719424:0@lo:41: 00010000:00010000:1.0:1788530087.105166:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788530087.595126:0:9016:0:(tgt_mount.c:2429:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788530087.595136:0:9016:0:(tgt_mount.c:2444:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:3.0:1788530088.129721:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530089.155398:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530090.176669:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788530090.561749:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788530090.561793:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32a54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555719552:0@lo:41: 00000100:00100000:3.0:1788530090.561893:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530090.562391:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555719552 00000100:00100000:2.0:1788530090.562408:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555719552 00000100:00100000:2.0:1788530090.568886:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788530090.568926:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555719552:12345-0@lo:41: 00000004:00000024:2.0:1788530090.569011:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:2.0:1788530090.569180:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555719552:12345-0@lo:41: Request processed in 276us (7287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530090.569188:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788530090.569391:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32a54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555719552:0@lo:41: 00000100:00100000:0.0:1788530091.074327:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d25a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555720064:0@lo:400: 00000100:00100000:0.0:1788530091.074465:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530091.074542:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d258700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555720576:0@lo:400: 00000100:00100000:3.0:1788530091.074817:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3735fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3648:1875409555719680:0@lo:400: 00000100:00100000:3.0:1788530091.074860:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530091.074890:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d25bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875409555720192:0@lo:400: 00000100:00100000:3.0:1788530091.074915:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530091.074971:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555719680 00000100:00100000:3.0:1788530091.074990:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555719680 00000100:00100000:3.0:1788530091.075050:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788530091.075061:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+24:3648:x1875409555719680:12345-0@lo:400: 00000100:00100000:3.0:1788530091.075124:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+24:3648:x1875409555719680:12345-0@lo:400: Request processed in 64us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530091.075139:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788530091.075183:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555720192 00000100:00100000:3.0:1788530091.075187:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555720192 00000100:00100000:3.0:1788530091.075239:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788530091.075251:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875409555720192:12345-0@lo:400: 00000100:00100000:3.0:1788530091.075285:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875409555720192:12345-0@lo:400: Request processed in 39us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530091.075301:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1788530091.075327:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788530091.075365:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3735fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3648:1875409555719680:0@lo:400: 00010000:00080000:3.0:1788530091.075382:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9f3d25bb80 x1875409555720192/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530107 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530091.075396:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d25bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875409555720192:0@lo:400: 00000100:00100000:0.0:1788530091.075636:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530091.075679:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3735c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875409555719808:0@lo:400: 00000100:00100000:0.0:1788530091.075707:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530091.075735:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d259f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875409555720320:0@lo:400: 00000100:00100000:0.0:1788530091.075759:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530091.075838:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788530091.075846:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3735ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875409555719936:0@lo:400: 00000100:00100000:0.0:1788530091.075869:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530091.075882:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d258e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555720448:0@lo:400: 00000100:00100000:0.0:1788530091.075908:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530091.075941:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555720064 00000100:00100000:0.0:1788530091.075946:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555720064 00000100:00100000:3.0:1788530091.076241:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555720576 00000100:00100000:3.0:1788530091.076246:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555720576 00000100:00100000:3.0:1788530091.076278:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555720448 00000100:00100000:3.0:1788530091.076280:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555720448 00000100:00100000:3.0:1788530091.076308:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788530091.076317:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3960ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555720576:12345-0@lo:400: 00000100:00100000:3.0:1788530091.076352:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3960ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555720576:12345-0@lo:400: Request processed in 37us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530091.076358:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788530091.076370:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788530091.076375:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3960f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555720448:12345-0@lo:400: 00000100:00100000:3.0:1788530091.076406:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3960f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555720448:12345-0@lo:400: Request processed in 31us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530091.076412:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788530091.076429:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555719808 00000100:00100000:3.0:1788530091.076434:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555719808 00000100:00100000:3.0:1788530091.076467:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555720320 00000100:00100000:3.0:1788530091.076470:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555720320 00000100:00100000:3.0:1788530091.076481:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555719936 00000100:00100000:3.0:1788530091.076483:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555719936 00000100:00100000:3.0:1788530091.076495:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788530091.076512:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3960df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875409555719808:12345-0@lo:400: 00000100:00100000:3.0:1788530091.076542:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3960df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875409555719808:12345-0@lo:400: Request processed in 31us (834us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530091.076548:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788530091.076579:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788530091.076586:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3960c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875409555720320:12345-0@lo:400: 00000100:00100000:3.0:1788530091.076625:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3960c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875409555720320:12345-0@lo:400: Request processed in 40us (865us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530091.076631:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788530091.076643:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788530091.076649:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3960c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875409555719936:12345-0@lo:400: 00000100:00100000:3.0:1788530091.076678:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3960c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875409555719936:12345-0@lo:400: Request processed in 29us (807us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530091.076683:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:3.0:1788530091.076708:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788530091.076722:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788530091.078818:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788530091.078877:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d25ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555720064:12345-0@lo:400: 00000100:00100000:0.0:1788530091.078999:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d25ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555720064:12345-0@lo:400: Request processed in 150us (4535us total) trans 0 rc 0/0 00010000:00080000:1.0:1788530091.082397:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9f3735ed80 x1875409555719936/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530107 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530091.082423:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3735ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875409555719936:0@lo:400: 00010000:00080000:1.0:1788530091.082439:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9f3d258e00 x1875409555720448/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788530107 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530091.082448:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d258e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555720448:0@lo:400: 00010000:00080000:1.0:1788530091.082463:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9f3735c700 x1875409555719808/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530107 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530091.082472:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3735c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875409555719808:0@lo:400: 00010000:00080000:1.0:1788530091.082494:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9f3d259f80 x1875409555720320/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530107 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530091.082503:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d259f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875409555720320:0@lo:400: 00000100:00100000:1.0:1788530091.082651:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555720832:0@lo:13: 00000100:00100000:2.0:1788530091.087310:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f2b92df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555720704:0@lo:13: 00000100:00100000:2.0:1788530091.087481:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d25a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555720064:0@lo:400: 00010000:00080000:2.0:1788530091.087506:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9f3d258700 x1875409555720576/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788530107 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530091.087517:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d258700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555720576:0@lo:400: 00000100:00100000:1.0:1788530091.087810:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530091.091893:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555720832 00000100:00100000:2.0:1788530091.091915:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555720832 00000100:00100000:2.0:1788530091.092029:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788530091.092046:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32bd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555720832:12345-0@lo:13: 00002000:00000024:2.0:1788530091.092104:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788530091.092262:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32bd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555720832:12345-0@lo:13: Request processed in 221us (9546us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530091.092271:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788530091.092320:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530091.092384:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555720704 00000100:00100000:2.0:1788530091.092413:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555720704 00000100:00100000:2.0:1788530091.092432:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788530091.092439:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f2b92ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555720704:12345-0@lo:13: 00002000:00000024:2.0:1788530091.092450:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788530091.092485:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f2b92ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555720704:12345-0@lo:13: Request processed in 46us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530091.092491:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788530091.092534:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9f2b92df80 x1875409555720704/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530107 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530091.092577:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f2b92df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555720704:0@lo:13: 00010000:00080000:2.0:1788530091.092613:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9f32bd2d80 x1875409555720832/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530107 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530091.092626:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555720832:0@lo:13: 00000100:00100000:0.0:1788530091.098889:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:0.0:1788530091.201693:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788530092.096894:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788530092.096943:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32a54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555720960:0@lo:41: 00000100:00100000:3.0:1788530092.097611:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530092.098213:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555720960 00000100:00100000:1.0:1788530092.098229:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555720960 00000100:00100000:1.0:1788530092.098327:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788530092.098338:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555720960:12345-0@lo:41: 00000004:00000024:1.0:1788530092.098383:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446502400 avail 1300262912 00000100:00100000:1.0:1788530092.099627:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555720960:12345-0@lo:41: Request processed in 1281us (2009us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530092.099640:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788530092.100308:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32a54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555720960:0@lo:41: 00010000:00010000:3.0:1788530092.225716:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530093.249441:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530094.276715:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530095.297302:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788530095.689014:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555721088:0@lo:41: 00000100:00100000:1.0:1788530095.689124:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530095.689238:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555721088 00000100:00100000:1.0:1788530095.689251:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555721088 00000100:00100000:1.0:1788530095.689313:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788530095.689323:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32bd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555721088:12345-0@lo:41: 00000004:00000024:1.0:1788530095.689361:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1788530095.689402:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32bd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555721088:12345-0@lo:41: Request processed in 81us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530095.689408:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788530095.689456:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555721088:0@lo:41: 00000100:00100000:1.0:1788530096.202338:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32a54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555721216:0@lo:13: 00000100:00100000:1.0:1788530096.202449:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530096.202548:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788530096.202558:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555721344:0@lo:13: 00000100:00100000:1.0:1788530096.202615:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530096.202675:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555721216 00000100:00100000:1.0:1788530096.202685:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555721216 00000100:00100000:1.0:1788530096.202760:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555721344 00000100:00100000:1.0:1788530096.202764:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555721344 00000100:00100000:1.0:1788530096.202790:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788530096.202801:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f08db7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555721216:12345-0@lo:13: 00002000:00000024:1.0:1788530096.202846:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788530096.202915:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f08db7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555721216:12345-0@lo:13: Request processed in 114us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530096.202922:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788530096.202946:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788530096.202953:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f08db7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555721344:12345-0@lo:13: 00002000:00000024:1.0:1788530096.202963:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788530096.203008:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f08db7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555721344:12345-0@lo:13: Request processed in 56us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530096.203014:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1788530096.203040:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788530096.203066:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9f32bd0a80 x1875409555721344/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530112 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1788530096.203068:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9f32a54000 x1875409555721216/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530112 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530096.203090:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32a54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555721216:0@lo:13: 00000100:00100000:1.0:1788530096.203090:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555721344:0@lo:13: 00000100:00100000:3.0:1788530096.212065:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f08db4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3650:1875409555721472:0@lo:400: 00000100:00100000:1.0:1788530096.212065:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f08db4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875409555721600:0@lo:400: 00000100:00100000:2.0:1788530096.212185:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0231d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875409555721856:0@lo:400: 00000100:00100000:3.0:1788530096.217831:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530096.219405:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530096.219486:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555721728:0@lo:400: 00000100:00100000:2.0:1788530096.219524:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530096.219546:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0231c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875409555722240:0@lo:400: 00000100:00100000:2.0:1788530096.219580:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530096.219596:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0231ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555721984:0@lo:400: 00000100:00100000:2.0:1788530096.219611:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555721728 00000100:00100000:2.0:1788530096.219620:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555721728 00000100:00100000:3.0:1788530096.219631:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530096.219663:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555721984 00000100:00100000:2.0:1788530096.219677:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555721984 00000100:00100000:3.0:1788530096.219680:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555721856 00000100:00100000:3.0:1788530096.219683:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555721856 00000100:00100000:2.0:1788530096.219694:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788530096.219703:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f2b92e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555721728:12345-0@lo:400: 00000100:00100000:3.0:1788530096.219726:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555722240 00000100:00100000:3.0:1788530096.219728:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555722240 00000100:00100000:3.0:1788530096.219755:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788530096.219762:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f2b92df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875409555721856:12345-0@lo:400: 00000100:00100000:2.0:1788530096.219774:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f2b92e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555721728:12345-0@lo:400: Request processed in 72us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530096.219781:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788530096.219795:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f2b92df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875409555721856:12345-0@lo:400: Request processed in 34us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530096.219798:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788530096.219801:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788530096.219803:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555721984:12345-0@lo:400: 00000100:00100000:3.0:1788530096.219812:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788530096.219817:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f2b92d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875409555722240:12345-0@lo:400: 00000100:00100000:2.0:1788530096.219832:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555721984:12345-0@lo:400: Request processed in 29us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530096.219839:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f2b92d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875409555722240:12345-0@lo:400: Request processed in 23us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530096.219839:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788530096.219845:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:3.0:1788530096.219869:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788530096.219876:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555721728:0@lo:400: 00000100:00100000:3.0:1788530096.219887:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0231ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555721984:0@lo:400: 00010000:00080000:2.0:1788530096.219889:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9e0231c380 x1875409555722240/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530112 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530096.219899:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0231c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875409555722240:0@lo:400: 00010000:00080000:2.0:1788530096.219923:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9e0231d880 x1875409555721856/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530112 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530096.219932:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0231d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875409555721856:0@lo:400: 00000100:00100000:1.0:1788530096.222763:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530096.222836:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0231e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875409555722112:0@lo:400: 00000100:00100000:1.0:1788530096.222887:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530096.222955:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555721600 00000100:00100000:1.0:1788530096.222966:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555721600 00000100:00100000:0.0:1788530096.223041:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555721472 00000100:00100000:0.0:1788530096.223046:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555721472 00000100:00100000:1.0:1788530096.223047:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555722112 00000100:00100000:1.0:1788530096.223064:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555722112 00000100:00100000:0.0:1788530096.223102:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788530096.223103:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788530096.223111:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0231ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875409555721600:12345-0@lo:400: 00000100:00100000:0.0:1788530096.223126:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+24:3650:x1875409555721472:12345-0@lo:400: 00000100:00100000:3.0:1788530096.226306:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788530096.226354:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0231f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875409555722112:12345-0@lo:400: 00000100:00100000:0.0:1788530096.230641:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+24:3650:x1875409555721472:12345-0@lo:400: Request processed in 7516us (12805us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530096.230661:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788530096.232040:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0231ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875409555721600:12345-0@lo:400: Request processed in 8923us (9279us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530096.232054:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:1.0:1788530096.232107:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788530096.232406:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9f08db4e00 x1875409555721600/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530112 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530096.232424:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f08db4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875409555721600:0@lo:400: 00000100:00100000:1.0:1788530096.232503:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f08db4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3650:1875409555721472:0@lo:400: 00000100:00100000:3.0:1788530096.234304:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0231f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875409555722112:12345-0@lo:400: Request processed in 7967us (11408us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530096.234321:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:1.0:1788530096.238288:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9e0231e300 x1875409555722112/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530112 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530096.238309:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0231e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875409555722112:0@lo:400: 00010000:00010000:3.0:1788530096.323410:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788530097.216875:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788530097.216945:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d258700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555722368:0@lo:41: 00000100:00100000:3.0:1788530097.217049:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530097.217149:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555722368 00000100:00100000:3.0:1788530097.217157:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555722368 00000100:00100000:3.0:1788530097.217224:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788530097.217234:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d25a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555722368:12345-0@lo:41: 00000004:00000024:3.0:1788530097.217284:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446502400 avail 1300262912 00000100:00100000:3.0:1788530097.217343:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d25a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555722368:12345-0@lo:41: Request processed in 109us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530097.217367:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788530097.217775:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d258700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555722368:0@lo:41: 00010000:00010000:0.0:1788530097.358758:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530098.372216:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530099.392991:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530100.416796:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788530100.810212:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d258700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555722496:0@lo:41: 00000100:00100000:2.0:1788530100.810320:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530100.810463:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555722496 00000100:00100000:0.0:1788530100.810476:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555722496 00000100:00100000:0.0:1788530100.810548:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788530100.810587:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32bd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555722496:12345-0@lo:41: 00000004:00000024:0.0:1788530100.810642:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1788530100.825615:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32bd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555722496:12345-0@lo:41: Request processed in 15042us (15279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530100.825643:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788530100.826277:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d258700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555722496:0@lo:41: 00000100:00100000:1.0:1788530101.314556:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0231e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3647:1875409555722624:0@lo:400: 00000100:00100000:1.0:1788530101.314727:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530101.314804:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0231ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555723136:0@lo:400: 00000100:00100000:1.0:1788530101.314841:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530101.314865:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0231f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555723648:0@lo:400: 00000100:00100000:1.0:1788530101.314893:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530101.314925:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788530101.314932:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0231fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875409555722752:0@lo:400: 00000100:00100000:1.0:1788530101.314964:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530101.314983:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0231df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875409555723264:0@lo:400: 00000100:00100000:1.0:1788530101.315021:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530101.315077:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0231d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555722880:0@lo:400: 00000100:00100000:1.0:1788530101.315108:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530101.315128:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0231c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875409555723392:0@lo:400: 00000100:00100000:1.0:1788530101.315152:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530101.315174:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788530101.315179:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0231e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875409555723008:0@lo:400: 00000100:00100000:1.0:1788530101.315203:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530101.315221:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0231c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555723520:0@lo:400: 00000100:00100000:1.0:1788530101.315245:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530101.315284:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555722624 00000100:00100000:1.0:1788530101.315299:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555722624 00000100:00100000:1.0:1788530101.315379:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788530101.315392:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+24:3647:x1875409555722624:12345-0@lo:400: 00000100:00100000:1.0:1788530101.315459:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+24:3647:x1875409555722624:12345-0@lo:400: Request processed in 69us (733us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530101.315468:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788530101.315513:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555722752 00000100:00100000:1.0:1788530101.315517:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555722752 00000100:00100000:1.0:1788530101.315539:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555723264 00000100:00100000:1.0:1788530101.315541:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555723264 00000100:00100000:1.0:1788530101.315597:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555723392 00000100:00100000:1.0:1788530101.315600:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555723392 00000100:00100000:1.0:1788530101.315624:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555723008 00000100:00100000:1.0:1788530101.315628:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555723008 00000100:00100000:1.0:1788530101.315644:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788530101.315652:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0231d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875409555722752:12345-0@lo:400: 00000100:00100000:1.0:1788530101.315691:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0231d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875409555722752:12345-0@lo:400: Request processed in 39us (726us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530101.315709:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788530101.315730:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788530101.315738:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0231f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875409555723264:12345-0@lo:400: 00000100:00100000:1.0:1788530101.315775:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0231f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875409555723264:12345-0@lo:400: Request processed in 39us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530101.315780:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788530101.315794:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788530101.315800:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0231c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875409555723392:12345-0@lo:400: 00000100:00100000:1.0:1788530101.315839:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0231c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875409555723392:12345-0@lo:400: Request processed in 37us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530101.315847:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788530101.315861:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788530101.315867:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0231ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875409555723008:12345-0@lo:400: 00000100:00100000:1.0:1788530101.315900:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0231ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875409555723008:12345-0@lo:400: Request processed in 34us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530101.315907:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:1.0:1788530101.315973:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9e0231fb80 x1875409555722752/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530117 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530101.315993:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0231fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875409555722752:0@lo:400: 00010000:00080000:1.0:1788530101.316014:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9e0231df80 x1875409555723264/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530117 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530101.316024:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0231df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875409555723264:0@lo:400: 00000100:00100000:1.0:1788530101.316036:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0231e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3647:1875409555722624:0@lo:400: 00000100:00100000:3.0:1788530101.316061:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555723136 00000100:00100000:3.0:1788530101.316083:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555723136 00000100:00080000:1.0:1788530101.316090:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788530101.316106:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788530101.316139:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9e0231e680 x1875409555723008/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530117 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530101.316149:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555722880 00000100:00100000:1.0:1788530101.316153:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0231e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875409555723008:0@lo:400: 00000100:00100000:3.0:1788530101.316157:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555722880 00010000:00080000:1.0:1788530101.316173:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9e0231c700 x1875409555723392/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530117 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530101.316187:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0231c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875409555723392:0@lo:400: 00000100:00100000:3.0:1788530101.316202:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788530101.316220:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0231dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555723136:12345-0@lo:400: 00000100:00100000:3.0:1788530101.316512:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0231dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555723136:12345-0@lo:400: Request processed in 297us (1669us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530101.316520:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788530101.316541:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788530101.316547:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0231d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555722880:12345-0@lo:400: 00000100:00100000:3.0:1788530101.316630:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0231d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555722880:12345-0@lo:400: Request processed in 83us (1521us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530101.316636:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788530101.316672:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555723648 00000100:00100000:3.0:1788530101.316676:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555723648 00000100:00100000:3.0:1788530101.316709:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555723520 00000100:00100000:3.0:1788530101.316712:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555723520 00000100:00100000:3.0:1788530101.316730:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788530101.316736:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0231ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555723648:12345-0@lo:400: 00000100:00100000:3.0:1788530101.316766:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0231ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555723648:12345-0@lo:400: Request processed in 31us (1873us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530101.316773:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788530101.316782:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788530101.316788:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f08db4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555723520:12345-0@lo:400: 00000100:00100000:3.0:1788530101.316809:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f08db4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555723520:12345-0@lo:400: Request processed in 22us (1564us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530101.316814:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788530101.317026:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9e0231c000 x1875409555723520/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788530117 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530101.317043:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0231c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555723520:0@lo:400: 00000100:00100000:3.0:1788530101.317055:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0231d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555722880:0@lo:400: 00000100:00080000:3.0:1788530101.317084:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788530101.317104:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d259f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555723776:0@lo:13: 00000100:00100000:3.0:1788530101.317149:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530101.317192:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555723776 00000100:00100000:3.0:1788530101.317195:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555723776 00000100:00100000:3.0:1788530101.317220:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788530101.317226:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d258e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555723776:12345-0@lo:13: 00002000:00000024:3.0:1788530101.317254:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788530101.317285:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d258e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555723776:12345-0@lo:13: Request processed in 59us (136us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530101.317296:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1788530101.317321:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9f3d259f80 x1875409555723776/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530117 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530101.317334:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d259f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555723776:0@lo:13: 00000100:00100000:1.0:1788530101.320285:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0231ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555723136:0@lo:400: 00010000:00080000:1.0:1788530101.320319:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9e0231f480 x1875409555723648/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788530117 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530101.320333:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0231f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555723648:0@lo:400: 00000100:00100000:2.0:1788530101.321751:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3960dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555723904:0@lo:13: 00000100:00100000:2.0:1788530101.321895:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530101.323476:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555723904 00000100:00100000:3.0:1788530101.323499:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555723904 00000100:00100000:3.0:1788530101.323642:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788530101.323657:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0263e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555723904:12345-0@lo:13: 00002000:00000024:3.0:1788530101.323692:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788530101.323817:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0263e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555723904:12345-0@lo:13: Request processed in 164us (1922us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530101.323828:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1788530101.323870:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9f3960dc00 x1875409555723904/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530117 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530101.323911:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3960dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555723904:0@lo:13: 00010000:00010000:0.0:1788530101.441787:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788530102.338386:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788530102.338434:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d259f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555724032:0@lo:41: 00000100:00100000:1.0:1788530102.338529:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530102.338790:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555724032 00000100:00100000:3.0:1788530102.338802:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555724032 00000100:00100000:3.0:1788530102.338877:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788530102.338891:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f08db4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555724032:12345-0@lo:41: 00000004:00000024:3.0:1788530102.338950:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446502400 avail 1300262912 00000100:00100000:3.0:1788530102.339032:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f08db4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555724032:12345-0@lo:41: Request processed in 142us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530102.339049:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788530102.339118:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d259f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555724032:0@lo:41: 00010000:00010000:3.0:1788530102.464936:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788530103.045827:0:9516:0:(obd_mount.c:925:lmd_print()) mount data: 00000020:01000004:1.0:1788530103.045835:0:9516:0:(obd_mount.c:928:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:1.0:1788530103.045837:0:9516:0:(obd_mount.c:931:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1788530103.046059:0:9516:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9a9e01aa6000 00000020:01000004:1.0:1788530103.046090:0:9516:0:(tgt_mount.c:2585:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1788530103.046114:0:9516:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788530103.046138:0:9516:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9a9f2c14b310) 00000020:00000080:1.0:1788530103.046166:0:9516:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788530103.126946:0:9516:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1788530103.141736:0:9516:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:1.0:1788530103.182973:0:9516:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788530103.183271:0:9516:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1788530103.183289:0:9516:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788530103.183304:0:9516:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xb28d70e125750384 00000020:01000004:1.0:1788530103.183313:0:9516:0:(tgt_mount.c:2670:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:1.0:1788530103.183353:0:9516:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.141@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788530103.183357:0:9516:0:(mgc_request.c:1372:mgc_set_info_async()) InitRecov MGC192.168.202.141@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788530103.183365:0:9516:0:(tgt_mount.c:1882:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1788530103.183404:0:9516:0:(tgt_mount.c:1482:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.141@tcp, index=0001, flags=0x20062 00000020:01000004:1.0:1788530103.183409:0:9516:0:(tgt_mount.c:1239:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788530103.183410:0:9516:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788530103.183412:0:9516:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788530103.183413:0:9516:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:1.0:1788530103.183415:0:9516:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:1.0:1788530103.183416:0:9516:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:1.0:1788530103.183418:0:9516:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788530103.183420:0:9516:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788530103.183422:0:9516:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788530103.183424:0:9516:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788530103.183425:0:9516:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788530103.183429:0:9516:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:1.0:1788530103.183431:0:9516:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788530103.183433:0:9516:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788530103.183434:0:9516:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788530103.183436:0:9516:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:1.0:1788530103.183436:0:9516:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:1.0:1788530103.183438:0:9516:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:1.0:1788530103.183439:0:9516:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788530103.183440:0:9516:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788530103.183441:0:9516:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788530103.183442:0:9516:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788530103.183443:0:9516:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788530103.183482:0:9516:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788530103.183505:0:9516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0231f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:9516:1875409555724160:0@lo:253: 00000100:00100000:1.0:1788530103.183684:0:9516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530103.183761:0:9516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e024a3600 going to sleep for 11 seconds 00000100:00100000:3.0:1788530103.185156:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555724160 00000100:00100000:3.0:1788530103.185177:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555724160 00000100:00100000:3.0:1788530103.185271:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788530103.185283:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+24:9516:x1875409555724160:12345-0@lo:253: 20000000:01000000:3.0:1788530103.185360:0:6517:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788530103.185365:0:6517:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:3.0:1788530103.185373:0:6517:0:(mgs_llog.c:875:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:3.0:1788530103.185378:0:6517:0:(mgs_llog.c:3868:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:3.0:1788530103.192004:0:6517:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788530103.194684:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:3.0:1788530103.194736:0:6517:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:3.0:1788530103.194905:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:3.0:1788530103.194915:0:6517:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:3.0:1788530103.194931:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:3.0:1788530103.194953:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:3.0:1788530103.195369:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:3.0:1788530103.195396:0:6517:0:(mgs_llog.c:3821:mgs_write_log_osc_to_lov()) add nid 192.168.202.141@tcp 20000000:01000000:3.0:1788530103.195399:0:6517:0:(mgs_llog.c:1545:record_base_raw()) lcfg (null) 0xcf005 192.168.202.141@tcp (null) (null) (null) 00000040:00080000:3.0:1788530103.195418:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:3.0:1788530103.195425:0:6517:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788530103.195440:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:3.0:1788530103.195447:0:6517:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.202.141@tcp (null) (null) 00000040:00080000:3.0:1788530103.195459:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:3.0:1788530103.195467:0:6517:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1788530103.195482:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:3.0:1788530103.195499:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:3.0:1788530103.195647:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:3.0:1788530103.195660:0:6517:0:(mgs_llog.c:3821:mgs_write_log_osc_to_lov()) add nid 192.168.202.141@tcp 20000000:01000000:3.0:1788530103.195661:0:6517:0:(mgs_llog.c:1545:record_base_raw()) lcfg (null) 0xcf005 192.168.202.141@tcp (null) (null) (null) 00000040:00080000:3.0:1788530103.195676:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:3.0:1788530103.195681:0:6517:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788530103.195695:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:3.0:1788530103.195701:0:6517:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.202.141@tcp (null) (null) 00000040:00080000:3.0:1788530103.195736:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:3.0:1788530103.195743:0:6517:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1788530103.195755:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:3.0:1788530103.196633:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:3.0:1788530103.197902:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:3.0:1788530103.197941:0:6517:0:(mgs_llog.c:3821:mgs_write_log_osc_to_lov()) add nid 192.168.202.141@tcp 20000000:01000000:3.0:1788530103.197944:0:6517:0:(mgs_llog.c:1545:record_base_raw()) lcfg (null) 0xcf005 192.168.202.141@tcp (null) (null) (null) 00000040:00080000:3.0:1788530103.197965:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:3.0:1788530103.197971:0:6517:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1788530103.197985:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:3.0:1788530103.197990:0:6517:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.202.141@tcp (null) (null) 00000040:00080000:3.0:1788530103.198003:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:3.0:1788530103.198010:0:6517:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1788530103.198022:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:3.0:1788530103.198036:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:3.0:1788530103.198392:0:6517:0:(mgs_llog.c:5258:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788530103.198397:0:6517:0:(mgs_llog.c:4754:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788530103.198403:0:6517:0:(mgs_llog.c:4187:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788530103.198477:0:6517:0:(mgs_llog.c:2556:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788530103.198481:0:6517:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788530103.199031:0:9522:0:(mgs_llog.c:1082:mgs_modify_handler()) Changing rec 36 marker 25 1->4: lustre sys.timeout 20000000:01000000:2.0:1788530103.199066:0:9522:0:(mgs_llog.c:1082:mgs_modify_handler()) Changing rec 38 marker 25 2->4: lustre sys.timeout 00000040:00080000:2.0:1788530103.199082:0:9522:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:3.0:1788530103.199359:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:3.0:1788530103.199381:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:3.0:1788530103.199397:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:3.0:1788530103.199414:0:6517:0:(mgs_llog.c:2556:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1788530103.199416:0:6517:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788530103.217182:0:9523:0:(mgs_llog.c:1082:mgs_modify_handler()) Changing rec 5 marker 26 1->4: lustre sys.timeout 20000000:01000000:2.0:1788530103.217275:0:9523:0:(mgs_llog.c:1082:mgs_modify_handler()) Changing rec 7 marker 26 2->4: lustre sys.timeout 00000040:00080000:2.0:1788530103.217288:0:9523:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1788530103.217635:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1788530103.217669:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:3.0:1788530103.217685:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:3.0:1788530103.217715:0:6517:0:(mgs_llog.c:2556:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1788530103.217719:0:6517:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788530103.219228:0:9524:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:3.0:1788530103.219470:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:3.0:1788530103.219502:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:3.0:1788530103.219537:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:3.0:1788530103.219556:0:6517:0:(mgs_llog.c:2556:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788530103.219585:0:6517:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788530103.224336:0:9525:0:(mgs_llog.c:1082:mgs_modify_handler()) Changing rec 31 marker 27 1->4: lustre sys.timeout 20000000:01000000:2.0:1788530103.224430:0:9525:0:(mgs_llog.c:1082:mgs_modify_handler()) Changing rec 33 marker 27 2->4: lustre sys.timeout 00000040:00080000:2.0:1788530103.224449:0:9525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:0.0:1788530103.228623:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:0.0:1788530103.228671:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:0.0:1788530103.228690:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:0.0:1788530103.228720:0:6517:0:(mgs_llog.c:2556:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1788530103.228724:0:6517:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788530103.229873:0:9526:0:(mgs_llog.c:1082:mgs_modify_handler()) Changing rec 31 marker 28 1->4: lustre sys.timeout 20000000:01000000:0.0:1788530103.229915:0:9526:0:(mgs_llog.c:1082:mgs_modify_handler()) Changing rec 33 marker 28 2->4: lustre sys.timeout 00000040:00080000:0.0:1788530103.229933:0:9526:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:1.0:1788530103.230351:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:1.0:1788530103.230376:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:1.0:1788530103.230391:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 10000000:01000000:1.0:1788530103.230422:0:6517:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788530103.230448:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a9e025ddc00/0xb28d70e12575038b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530103.230483:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a9f18140400/0xb28d70e125750249 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125750242 expref: 24 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530103.230491:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a9f42167600/0xb28d70e125750257 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125750250 expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530103.230498:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a9f42166000/0xb28d70e12575028f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125750288 expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530103.230505:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a9f18140200/0xb28d70e1257502dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e1257502d5 expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530103.230513:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a9f18141200/0xb28d70e1257502f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e1257502f1 expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530103.230521:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a9f18141400/0xb28d70e125750322 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e12575031b expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530103.230528:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a9f18141600/0xb28d70e125750330 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125750329 expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530103.230535:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a9f42167e00/0xb28d70e12575034c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125750345 expref: 24 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530103.230543:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a9e025dc200/0xb28d70e125750376 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e12575036f expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530103.230552:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a9e025ddc00/0xb28d70e12575038b lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530103.230658:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a9e025dc200/0xb28d70e125750376 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb28d70e12575036f expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530103.230678:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a9e025dc200/0xb28d70e125750376 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb28d70e12575036f expref: 24 pid: 6517 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530103.230697:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0231ed80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6517:1875409555724288:0@lo:104: 00000100:00100000:1.0:1788530103.230812:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788530103.230888:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a9f42167e00/0xb28d70e12575034c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb28d70e125750345 expref: 24 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530103.230896:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a9f42167e00/0xb28d70e12575034c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb28d70e125750345 expref: 24 pid: 6518 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530103.230905:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0231c000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6517:1875409555724416:0@lo:104: 00000100:00100000:1.0:1788530103.230929:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788530103.230952:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a9f18141600/0xb28d70e125750330 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb28d70e125750329 expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530103.230960:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a9f18141600/0xb28d70e125750330 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb28d70e125750329 expref: 24 pid: 6517 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530103.230968:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0231e680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6517:1875409555724544:0@lo:104: 00000100:00100000:1.0:1788530103.230989:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788530103.231005:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a9f18141400/0xb28d70e125750322 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb28d70e12575031b expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530103.231013:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a9f18141400/0xb28d70e125750322 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb28d70e12575031b expref: 24 pid: 6517 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530103.231029:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0231df80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6517:1875409555724672:0@lo:104: 00000100:00100000:1.0:1788530103.231058:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788530103.231074:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a9f18141200/0xb28d70e1257502f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb28d70e1257502f1 expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530103.231082:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a9f18141200/0xb28d70e1257502f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb28d70e1257502f1 expref: 24 pid: 6517 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530103.231091:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0231fb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6517:1875409555724800:0@lo:104: 00010000:00010000:1.0:1788530103.231158:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a9f18140200/0xb28d70e1257502dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb28d70e1257502d5 expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530103.231168:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a9f18140200/0xb28d70e1257502dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb28d70e1257502d5 expref: 24 pid: 6517 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530103.231177:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d7b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6517:1875409555724928:0@lo:104: 00010000:00010000:1.0:1788530103.231204:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a9f42166000/0xb28d70e12575028f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb28d70e125750288 expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530103.231212:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a9f42166000/0xb28d70e12575028f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb28d70e125750288 expref: 24 pid: 6517 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530103.231220:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d5180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6517:1875409555725056:0@lo:104: 00010000:00010000:1.0:1788530103.231245:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a9f42167600/0xb28d70e125750257 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb28d70e125750250 expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530103.231252:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a9f42167600/0xb28d70e125750257 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb28d70e125750250 expref: 24 pid: 6516 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530103.231271:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d6680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6517:1875409555725184:0@lo:104: 00010000:00010000:1.0:1788530103.231298:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a9f18140400/0xb28d70e125750249 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb28d70e125750242 expref: 24 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530103.231307:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a9f18140400/0xb28d70e125750249 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb28d70e125750242 expref: 24 pid: 6518 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530103.231315:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d6d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6517:1875409555725312:0@lo:104: 00000100:00100000:1.0:1788530103.231336:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e024a3840 going to sleep for 11 seconds 00000100:00100000:0.0:1788530103.232943:0:6506:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788530103.232993:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530103.233019:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530103.233030:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530103.233040:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530103.233049:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530103.233068:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555724288 00000100:00100000:0.0:1788530103.233077:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555724288 00000100:00100000:0.0:1788530103.233133:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555724416 00000100:00100000:0.0:1788530103.233136:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555724416 00000100:00100000:0.0:1788530103.234288:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555724544 00000100:00100000:0.0:1788530103.234296:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555724544 00000100:00100000:0.0:1788530103.234311:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555724672 00000100:00100000:0.0:1788530103.234314:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555724672 00000100:00100000:0.0:1788530103.234324:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555724800 00000100:00100000:0.0:1788530103.234327:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555724800 00000100:00100000:0.0:1788530103.234339:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555724928 00000100:00100000:0.0:1788530103.234341:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555724928 00000100:00100000:0.0:1788530103.234352:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555725056 00000100:00100000:0.0:1788530103.234354:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555725056 00000100:00100000:0.0:1788530103.234364:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555725184 00000100:00100000:0.0:1788530103.234366:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555725184 00000100:00100000:0.0:1788530103.234375:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555725312 00000100:00100000:0.0:1788530103.234377:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555725312 00000100:00100000:0.0:1788530103.234392:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788530103.234403:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0231d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+11:6517:x1875409555724288:12345-0@lo:104: 00010000:00010000:0.0:1788530103.234426:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff9a9e025dd000/0xb28d70e12575036f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e125750376 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.234518:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788530103.234525:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0231d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+11:6517:x1875409555724288:12345-0@lo:104: Request processed in 125us (3714us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530103.234534:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788530103.234557:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788530103.234580:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0231c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+10:6517:x1875409555724416:12345-0@lo:104: 00010000:00010000:0.0:1788530103.234589:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff9a9f42167200/0xb28d70e125750345 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e12575034c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.234660:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788530103.234666:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0231c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+10:6517:x1875409555724416:12345-0@lo:104: Request processed in 87us (3737us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530103.234673:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788530103.234686:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788530103.234692:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0231e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+9:6517:x1875409555724544:12345-0@lo:104: 00010000:00010000:0.0:1788530103.234700:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff9a9f42166400/0xb28d70e125750329 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e125750330 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.234729:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788530103.234734:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0231e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+9:6517:x1875409555724544:12345-0@lo:104: Request processed in 43us (3745us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530103.234739:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788530103.234752:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788530103.234757:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f33ded450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+8:6517:x1875409555724672:12345-0@lo:104: 00010000:00010000:0.0:1788530103.234765:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91cc00/0xb28d70e12575031b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e125750322 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.234990:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1788530103.234995:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f33ded450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+8:6517:x1875409555724672:12345-0@lo:104: Request processed in 238us (3937us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530103.235000:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788530103.235039:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788530103.235045:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3960ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+7:6517:x1875409555724800:12345-0@lo:104: 00010000:00010000:0.0:1788530103.235053:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d200/0xb28d70e1257502f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e1257502f8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.235088:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1788530103.235093:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3960ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+7:6517:x1875409555724800:12345-0@lo:104: Request processed in 49us (2102us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530103.235099:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788530103.235112:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788530103.235117:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3960d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+6:6517:x1875409555724928:12345-0@lo:104: 00010000:00010000:0.0:1788530103.235125:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91da00/0xb28d70e1257502d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e1257502dc expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530103.236058:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0231ed80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6517:1875409555724288:0@lo:104: 00000100:00100000:1.0:1788530103.236072:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0231c000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6517:1875409555724416:0@lo:104: 00000100:00100000:1.0:1788530103.236080:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0231e680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6517:1875409555724544:0@lo:104: 00000100:00100000:1.0:1788530103.236088:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0231df80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6517:1875409555724672:0@lo:104: 00000100:00100000:1.0:1788530103.236096:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0231fb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6517:1875409555724800:0@lo:104: 00010000:00010000:0.0:1788530103.236912:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:0.0:1788530103.236926:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3960d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+6:6517:x1875409555724928:12345-0@lo:104: Request processed in 1805us (3903us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530103.236937:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788530103.236983:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788530103.236994:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3960f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+5:6517:x1875409555725056:12345-0@lo:104: 00010000:00010000:0.0:1788530103.237015:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff9a9f18141a00/0xb28d70e125750288 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e12575028f expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.237072:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:0.0:1788530103.237077:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3960f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+5:6517:x1875409555725056:12345-0@lo:104: Request processed in 87us (4046us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530103.237083:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788530103.237096:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788530103.237103:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3960d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+4:6517:x1875409555725184:12345-0@lo:104: 00010000:00010000:0.0:1788530103.237112:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d000/0xb28d70e125750250 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e125750257 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530103.237332:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d7b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6517:1875409555724928:0@lo:104: 00000100:00100000:1.0:1788530103.237342:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d5180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6517:1875409555725056:0@lo:104: 00010000:00010000:0.0:1788530103.239994:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to priority blp list, 8 blwis in pool 00000100:00100000:0.0:1788530103.240014:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3960d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+4:6517:x1875409555725184:12345-0@lo:104: Request processed in 2903us (6964us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530103.240028:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788530103.240078:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788530103.240092:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3960ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+3:6517:x1875409555725312:12345-0@lo:104: 00010000:00010000:0.0:1788530103.240116:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff9a9f42166800/0xb28d70e125750242 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e125750249 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.240202:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to priority blp list, 9 blwis in pool 00000100:00100000:0.0:1788530103.240207:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3960ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+3:6517:x1875409555725312:12345-0@lo:104: Request processed in 122us (7157us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530103.240214:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:0.0:1788530103.240282:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:0.0:1788530103.240289:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9e025dd000/0xb28d70e12575036f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e125750376 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.240299:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9e025dd000 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:0.0:1788530103.240304:0:6511:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9e025dd000/0xb28d70e12575036f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xb28d70e125750376 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.240316:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9e025dd000/0xb28d70e12575036f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xb28d70e125750376 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788530103.240323:0:6511:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9e025dd000/0xb28d70e12575036f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xb28d70e125750376 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788530103.240330:0:6511:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788530103.240414:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9e025dd000/0xb28d70e12575036f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125750376 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.240423:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788530103.240457:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9e025dd000/0xb28d70e12575036f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125750376 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.240465:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9e025dd000/0xb28d70e12575036f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125750376 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.240482:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:0.0:1788530103.240485:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f42167200/0xb28d70e125750345 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e12575034c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.240490:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f42167200 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:0.0:1788530103.240493:0:6511:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f42167200/0xb28d70e125750345 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xb28d70e12575034c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.240500:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f42167200/0xb28d70e125750345 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xb28d70e12575034c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788530103.240507:0:6511:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f42167200/0xb28d70e125750345 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xb28d70e12575034c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788530103.240513:0:6511:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788530103.240525:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9f42167200/0xb28d70e125750345 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e12575034c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.240532:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788530103.240537:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f42167200/0xb28d70e125750345 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e12575034c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.240554:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f42167200/0xb28d70e125750345 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e12575034c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.240617:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1788530103.240621:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f42166400/0xb28d70e125750329 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e125750330 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.240628:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f42166400 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:0.0:1788530103.240631:0:6511:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f42166400/0xb28d70e125750329 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xb28d70e125750330 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.240639:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f42166400/0xb28d70e125750329 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xb28d70e125750330 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788530103.240645:0:6511:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f42166400/0xb28d70e125750329 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xb28d70e125750330 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788530103.240650:0:6511:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788530103.240665:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9f42166400/0xb28d70e125750329 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125750330 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.240672:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788530103.240690:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f42166400/0xb28d70e125750329 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125750330 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.240697:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f42166400/0xb28d70e125750329 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125750330 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.240709:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1788530103.240718:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91cc00/0xb28d70e12575031b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e125750322 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.240726:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f0c91cc00 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:0.0:1788530103.240729:0:6511:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91cc00/0xb28d70e12575031b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xb28d70e125750322 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.240737:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91cc00/0xb28d70e12575031b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xb28d70e125750322 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788530103.240743:0:6511:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91cc00/0xb28d70e12575031b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xb28d70e125750322 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788530103.240749:0:6511:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788530103.240764:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91cc00/0xb28d70e12575031b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125750322 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.240771:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788530103.240777:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91cc00/0xb28d70e12575031b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125750322 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.240784:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91cc00/0xb28d70e12575031b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125750322 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.240794:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788530103.240798:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d200/0xb28d70e1257502f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e1257502f8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.240804:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f0c91d200 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:0.0:1788530103.240806:0:6511:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d200/0xb28d70e1257502f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xb28d70e1257502f8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.240824:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d200/0xb28d70e1257502f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xb28d70e1257502f8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788530103.240831:0:6511:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d200/0xb28d70e1257502f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xb28d70e1257502f8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788530103.240836:0:6511:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788530103.240851:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d200/0xb28d70e1257502f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e1257502f8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.240857:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788530103.240861:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d200/0xb28d70e1257502f1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e1257502f8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.240868:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d200/0xb28d70e1257502f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e1257502f8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.240879:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788530103.240882:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91da00/0xb28d70e1257502d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e1257502dc expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.240888:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f0c91da00 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:0.0:1788530103.240892:0:6511:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91da00/0xb28d70e1257502d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xb28d70e1257502dc expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.240899:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91da00/0xb28d70e1257502d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xb28d70e1257502dc expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788530103.240906:0:6511:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91da00/0xb28d70e1257502d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xb28d70e1257502dc expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788530103.240917:0:6511:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788530103.240932:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91da00/0xb28d70e1257502d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e1257502dc expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.240938:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788530103.240942:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91da00/0xb28d70e1257502d5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e1257502dc expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.240948:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91da00/0xb28d70e1257502d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e1257502dc expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.240957:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788530103.240961:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f18141a00/0xb28d70e125750288 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e12575028f expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.240966:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f18141a00 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:0.0:1788530103.240969:0:6511:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f18141a00/0xb28d70e125750288 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb28d70e12575028f expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.240976:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f18141a00/0xb28d70e125750288 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb28d70e12575028f expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788530103.240981:0:6511:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f18141a00/0xb28d70e125750288 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb28d70e12575028f expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788530103.240986:0:6511:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788530103.240999:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9f18141a00/0xb28d70e125750288 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e12575028f expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.241005:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788530103.241014:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f18141a00/0xb28d70e125750288 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e12575028f expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.241022:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f18141a00/0xb28d70e125750288 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e12575028f expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.241032:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788530103.241036:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d000/0xb28d70e125750250 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e125750257 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.241042:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f0c91d000 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:0.0:1788530103.241045:0:6511:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d000/0xb28d70e125750250 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb28d70e125750257 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.241052:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d000/0xb28d70e125750250 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb28d70e125750257 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788530103.241058:0:6511:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d000/0xb28d70e125750250 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb28d70e125750257 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788530103.241063:0:6511:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788530103.241078:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d000/0xb28d70e125750250 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125750257 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.241084:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788530103.241088:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d000/0xb28d70e125750250 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125750257 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.241094:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d000/0xb28d70e125750250 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125750257 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.241104:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788530103.241113:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f42166800/0xb28d70e125750242 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e125750249 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.241120:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f42166800 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:0.0:1788530103.241123:0:6511:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f42166800/0xb28d70e125750242 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb28d70e125750249 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.241130:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f42166800/0xb28d70e125750242 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb28d70e125750249 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788530103.241136:0:6511:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f42166800/0xb28d70e125750242 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb28d70e125750249 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788530103.241141:0:6511:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788530103.241156:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9f42166800/0xb28d70e125750242 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125750249 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.241163:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788530103.241167:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f42166800/0xb28d70e125750242 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125750249 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.241173:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f42166800/0xb28d70e125750242 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125750249 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.241190:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530103.241193:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530103.241195:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530103.241207:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788530103.241229:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3960e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3647:1875409555725440:0@lo:103: 00000100:00100000:0.0:1788530103.241299:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530103.241351:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3960fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3647:1875409555725952:0@lo:103: 00000100:00100000:0.0:1788530103.241381:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530103.241397:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0231d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3647:1875409555726464:0@lo:103: 00000100:00100000:0.0:1788530103.241436:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530103.241462:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788530103.241468:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3960c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3647:1875409555725568:0@lo:103: 00000100:00100000:0.0:1788530103.241491:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530103.241499:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3960d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3647:1875409555726080:0@lo:103: 00000100:00100000:0.0:1788530103.241516:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530103.241585:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3960ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3649:1875409555725696:0@lo:103: 00000100:00100000:2.0:1788530103.243388:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555725440 00000100:00100000:2.0:1788530103.243406:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555725440 00010000:00010000:2.0:1788530103.243463:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a9e025dc200/0xb28d70e125750376 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e12575036f expref: 25 pid: 6517 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530103.243491:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555725952 00000100:00100000:2.0:1788530103.243494:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555725952 00010000:00010000:2.0:1788530103.243506:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a9f18141200/0xb28d70e1257502f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e1257502f1 expref: 26 pid: 6517 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530103.243517:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555726464 00000100:00100000:2.0:1788530103.243520:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555726464 00010000:00010000:2.0:1788530103.243531:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a9f18140400/0xb28d70e125750249 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e125750242 expref: 27 pid: 6518 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530103.243542:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555725568 00000100:00100000:2.0:1788530103.243545:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555725568 00010000:00010000:2.0:1788530103.243557:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a9f42167e00/0xb28d70e12575034c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e125750345 expref: 28 pid: 6518 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530103.243587:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555726080 00000100:00100000:2.0:1788530103.243590:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555726080 00010000:00010000:2.0:1788530103.243635:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a9f18140200/0xb28d70e1257502dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e1257502d5 expref: 29 pid: 6517 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530103.243653:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788530103.243663:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0231c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:3647:x1875409555725440:12345-0@lo:103: 00010000:00010000:2.0:1788530103.243680:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788530103.243685:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a9e025dc200/0xb28d70e125750376 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e12575036f expref: 29 pid: 6517 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530103.243698:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a9e025dc200/0xb28d70e125750376 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb28d70e12575036f expref: 29 pid: 6517 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530103.243720:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9e025dc200/0xb28d70e125750376 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb28d70e12575036f expref: 29 pid: 6517 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530103.243739:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788530103.243838:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0231c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+28:3647:x1875409555725440:12345-0@lo:103: Request processed in 176us (2540us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530103.243846:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788530103.243867:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788530103.243874:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0231e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+27:3647:x1875409555725952:12345-0@lo:103: 00010000:00010000:2.0:1788530103.243882:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788530103.243886:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a9f18141200/0xb28d70e1257502f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e1257502f1 expref: 27 pid: 6517 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530103.243895:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a9f18141200/0xb28d70e1257502f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb28d70e1257502f1 expref: 27 pid: 6517 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530103.243906:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f18141200/0xb28d70e1257502f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb28d70e1257502f1 expref: 27 pid: 6517 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530103.243927:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788530103.243953:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0231e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+26:3647:x1875409555725952:12345-0@lo:103: Request processed in 79us (2571us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530103.243959:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788530103.243973:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788530103.243979:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027da300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+25:3647:x1875409555726464:12345-0@lo:103: 00010000:00010000:2.0:1788530103.243987:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788530103.243991:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a9f18140400/0xb28d70e125750249 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e125750242 expref: 25 pid: 6518 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530103.244000:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a9f18140400/0xb28d70e125750249 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb28d70e125750242 expref: 25 pid: 6518 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530103.244009:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788530103.244030:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027da300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+25:3647:x1875409555726464:12345-0@lo:103: Request processed in 51us (2593us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530103.244036:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788530103.244048:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788530103.244054:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f396c0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+24:3647:x1875409555725568:12345-0@lo:103: 00010000:00010000:2.0:1788530103.244062:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788530103.244066:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a9f42167e00/0xb28d70e12575034c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e125750345 expref: 24 pid: 6518 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530103.244075:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a9f42167e00/0xb28d70e12575034c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb28d70e125750345 expref: 24 pid: 6518 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530103.244085:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f42167e00/0xb28d70e12575034c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb28d70e125750345 expref: 24 pid: 6518 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530103.244102:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788530103.244126:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f396c0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+23:3647:x1875409555725568:12345-0@lo:103: Request processed in 73us (2635us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530103.244132:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788530103.244180:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788530103.244187:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+22:3647:x1875409555726080:12345-0@lo:103: 00010000:00010000:2.0:1788530103.244194:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788530103.244198:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a9f18140200/0xb28d70e1257502dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e1257502d5 expref: 22 pid: 6517 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530103.244206:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a9f18140200/0xb28d70e1257502dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb28d70e1257502d5 expref: 22 pid: 6517 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530103.244217:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f18140200/0xb28d70e1257502dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb28d70e1257502d5 expref: 22 pid: 6517 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530103.244226:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788530103.244248:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+21:3647:x1875409555726080:12345-0@lo:103: Request processed in 62us (2730us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530103.244254:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788530103.244284:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3960f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3650:1875409555725824:0@lo:103: 00000100:00100000:2.0:1788530103.244320:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530103.244357:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3960dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3650:1875409555726336:0@lo:103: 00000100:00100000:2.0:1788530103.244377:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530103.244401:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555725824 00000100:00100000:2.0:1788530103.244405:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555725824 00010000:00010000:2.0:1788530103.244418:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a9f18141400/0xb28d70e125750322 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e12575031b expref: 21 pid: 6517 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530103.244439:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555726336 00000100:00100000:2.0:1788530103.244442:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555726336 00010000:00010000:2.0:1788530103.244454:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a9f42167600/0xb28d70e125750257 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e125750250 expref: 22 pid: 6516 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530103.244465:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788530103.244471:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0263ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+22:3650:x1875409555725824:12345-0@lo:103: 00010000:00010000:2.0:1788530103.244478:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788530103.244483:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a9f18141400/0xb28d70e125750322 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e12575031b expref: 22 pid: 6517 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530103.244491:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a9f18141400/0xb28d70e125750322 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb28d70e12575031b expref: 22 pid: 6517 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530103.244502:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f18141400/0xb28d70e125750322 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb28d70e12575031b expref: 22 pid: 6517 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530103.244510:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788530103.244535:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0263ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+21:3650:x1875409555725824:12345-0@lo:103: Request processed in 64us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530103.244542:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788530103.244554:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788530103.244581:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0263df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+20:3650:x1875409555726336:12345-0@lo:103: 00010000:00010000:2.0:1788530103.244588:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788530103.244593:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a9f42167600/0xb28d70e125750257 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e125750250 expref: 20 pid: 6516 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530103.244613:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a9f42167600/0xb28d70e125750257 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb28d70e125750250 expref: 20 pid: 6516 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530103.244631:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788530103.244655:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0263df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+20:3650:x1875409555726336:12345-0@lo:103: Request processed in 95us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530103.244661:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788530103.244706:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3960f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3650:1875409555725824:0@lo:103: 00000100:00100000:2.0:1788530103.244715:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3960dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3650:1875409555726336:0@lo:103: 00000100:00100000:0.0:1788530103.245139:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530103.245188:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3960e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3649:1875409555726208:0@lo:103: 00000100:00100000:0.0:1788530103.245215:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530103.245243:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555725696 00000100:00100000:0.0:1788530103.245246:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555725696 00010000:00010000:0.0:1788530103.245269:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a9f18141600/0xb28d70e125750330 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e125750329 expref: 20 pid: 6517 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530103.245286:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555726208 00000100:00100000:0.0:1788530103.245288:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555726208 00010000:00010000:0.0:1788530103.245299:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a9f42166000/0xb28d70e12575028f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e125750288 expref: 21 pid: 6517 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530103.245311:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788530103.245317:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+21:3649:x1875409555725696:12345-0@lo:103: 00010000:00010000:0.0:1788530103.245327:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788530103.245331:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a9f18141600/0xb28d70e125750330 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e125750329 expref: 21 pid: 6517 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.245352:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a9f18141600/0xb28d70e125750330 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb28d70e125750329 expref: 21 pid: 6517 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.245363:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f18141600/0xb28d70e125750330 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb28d70e125750329 expref: 21 pid: 6517 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.245373:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788530103.245403:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+20:3649:x1875409555725696:12345-0@lo:103: Request processed in 87us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530103.245409:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788530103.245424:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788530103.245430:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+19:3649:x1875409555726208:12345-0@lo:103: 00010000:00010000:0.0:1788530103.245437:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788530103.245442:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a9f42166000/0xb28d70e12575028f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e125750288 expref: 19 pid: 6517 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.245450:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a9f42166000/0xb28d70e12575028f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb28d70e125750288 expref: 19 pid: 6517 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.245460:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f42166000/0xb28d70e12575028f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb28d70e125750288 expref: 19 pid: 6517 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.245476:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a9e025ddc00/0xb28d70e12575038b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.245486:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9e025ddc00/0xb28d70e12575038b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.245504:0:6508:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a9e025ddc00/0xb28d70e12575038b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.245519:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a9e025ddc00/0xb28d70e12575038b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.245526:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a9e025ddc00/0xb28d70e12575038b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.245534:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a9e025ddc00/0xb28d70e12575038b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.245540:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9e025ddc00 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:0.0:1788530103.245545:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a9e025ddc00/0xb28d70e12575038b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.245555:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a9e025ddc00/0xb28d70e12575038b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.245590:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a9e025ddc00/0xb28d70e12575038b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.245612:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788530103.245637:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+18:3649:x1875409555726208:12345-0@lo:103: Request processed in 206us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530103.245643:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788530103.245680:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3960c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3647:1875409555725568:0@lo:103: 00000100:00100000:0.0:1788530103.245691:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3960d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3647:1875409555726080:0@lo:103: 00000100:00100000:0.0:1788530103.245701:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3960e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3647:1875409555725440:0@lo:103: 00000100:00100000:0.0:1788530103.245709:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3960fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3647:1875409555725952:0@lo:103: 00000100:00100000:0.0:1788530103.245729:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0231d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3647:1875409555726464:0@lo:103: 00000100:00100000:0.0:1788530103.246871:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3960ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3649:1875409555725696:0@lo:103: 00000100:00100000:0.0:1788530103.246910:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3960e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3649:1875409555726208:0@lo:103: 00010000:00010000:1.0:1788530103.247916:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f42167600/0xb28d70e125750257 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb28d70e125750250 expref: 17 pid: 6516 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530103.247938:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d6680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6517:1875409555725184:0@lo:104: 00010000:00010000:1.0:1788530103.247954:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f18140400/0xb28d70e125750249 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb28d70e125750242 expref: 16 pid: 6518 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530103.247963:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d6d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6517:1875409555725312:0@lo:104: 00010000:00010000:1.0:1788530103.248021:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a9e025ddc00/0xb28d70e12575038b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530103.248033:0:6517:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a9e025ddc00/0xb28d70e12575038b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530103.248040:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a9e025ddc00/0xb28d70e12575038b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530103.248046:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9e025ddc00/0xb28d70e12575038b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788530103.248064:0:6517:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788530103.267174:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+15:9516:x1875409555724160:12345-0@lo:253: Request processed in 81878us (83476us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530103.267195:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788530103.267525:0:9516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0231f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:9516:1875409555724160:0@lo:253: 10000000:01000000:3.0:1788530103.267548:0:9516:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788530103.267553:0:9516:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788530103.267555:0:9516:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788530103.267557:0:9516:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788530103.267587:0:9516:0:(tgt_mount.c:1242:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1788530103.267588:0:9516:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:3.0:1788530103.267590:0:9516:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:3.0:1788530103.267592:0:9516:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788530103.267594:0:9516:0:(tgt_mount.c:1260:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788530103.267596:0:9516:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788530103.267605:0:9516:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788530103.267636:0:9516:0:(tgt_mount.c:115:server_register_mount()) register mount ffff9a9e01aa6000 from lustre-OST0001 10000000:01000000:3.0:1788530103.267679:0:9516:0:(mgc_request.c:2342:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1788530103.267683:0:9516:0:(mgc_request.c:424:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788530103.267695:0:9516:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9a9e01aa6000 10000000:01000000:3.0:1788530103.267703:0:9516:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788530103.267728:0:9516:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.202.141@tcp: setup lustre-OST0001-osd 00000040:01000000:3.0:1788530103.289996:0:9516:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.141@tcp ctxt 1 is initialized 00000040:01000000:3.0:1788530103.312461:0:9516:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.141@tcp ctxt 0 is initialized 10000000:01000000:3.0:1788530103.312492:0:9516:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-sptlrpc-ffff9a9e01aa6000 from 1 10000000:01000000:3.0:1788530103.312496:0:9516:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788530103.312552:0:9516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d400/0xb28d70e125750392 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530103.312998:0:9516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d400/0xb28d70e125750392 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530103.313012:0:9516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d400/0xb28d70e125750392 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530103.313054:0:9516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d259f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:9516:1875409555726592:0@lo:101: 00000100:00100000:3.0:1788530103.313254:0:9516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530103.313351:0:9516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f07d08600 going to sleep for 11 seconds 00000100:00100000:0.0:1788530103.321304:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555726592 00000100:00100000:0.0:1788530103.321329:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555726592 00000100:00100000:1.0:1788530103.321647:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788530103.321664:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+15:9516:x1875409555726592:12345-0@lo:101: 00010000:00010000:1.0:1788530103.321688:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530103.321719:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9e025ddc00/0xb28d70e125750399 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e125750392 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530103.321756:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9e025ddc00/0xb28d70e125750399 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e125750392 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530103.321781:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9e025ddc00/0xb28d70e125750399 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125750392 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530103.321792:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9e025ddc00, rc 0) 00000100:00100000:1.0:1788530103.324046:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+16:9516:x1875409555726592:12345-0@lo:101: Request processed in 2374us (10779us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530103.324061:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788530103.327989:0:9516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d259f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:9516:1875409555726592:0@lo:101: 00010000:00010000:3.0:1788530103.328036:0:9516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d400/0xb28d70e125750392 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125750399 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530103.328053:0:9516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d400/0xb28d70e125750392 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e125750399 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530103.328233:0:9516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d259f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:9516:1875409555726720:0@lo:501: 00000100:00100000:3.0:1788530103.328340:0:9516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530103.328393:0:9516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f07d08600 going to sleep for 11 seconds 00000100:00100000:0.0:1788530103.328555:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555726720 00000100:00100000:0.0:1788530103.328605:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555726720 00000100:00100000:0.0:1788530103.328674:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788530103.328685:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+16:9516:x1875409555726720:12345-0@lo:501: 00000100:00100000:0.0:1788530103.328798:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+16:9516:x1875409555726720:12345-0@lo:501: Request processed in 113us (458us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788530103.328806:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788530103.329108:0:9516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d259f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:9516:1875409555726720:0@lo:501: 10000000:01000000:3.0:1788530103.329130:0:9516:0:(mgc_request_server.c:748:mgc_llog_local_copy()) MGC192.168.202.141@tcp: no remote llog for lustre-sptlrpc, check MGS config 00000100:00100000:3.0:1788530103.329182:0:9516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d259f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:9516:1875409555726848:0@lo:501: 00000100:00100000:3.0:1788530103.329212:0:9516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530103.329232:0:9516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f07d08600 going to sleep for 11 seconds 00000100:00100000:0.0:1788530103.329314:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555726848 00000100:00100000:0.0:1788530103.329320:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555726848 00000100:00100000:0.0:1788530103.329351:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788530103.329359:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+16:9516:x1875409555726848:12345-0@lo:501: 00000100:00100000:0.0:1788530103.329416:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+16:9516:x1875409555726848:12345-0@lo:501: Request processed in 58us (202us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788530103.329422:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788530103.330038:0:9516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d259f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:9516:1875409555726848:0@lo:501: 10000000:01000000:3.0:1788530103.330072:0:9516:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788530103.330095:0:9516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d400/0xb28d70e125750392 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125750399 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530103.330106:0:9516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d400/0xb28d70e125750392 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125750399 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788530103.330387:0:9516:0:(mgc_request.c:206:do_config_log_add()) do adding config log params-ffff9a9e01aa6000 10000000:01000000:3.0:1788530103.330412:0:9516:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788530103.330447:0:9516:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.202.141@tcp: setup lustre-OST0001-osd 00000040:01000000:3.0:1788530103.330548:0:9516:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.141@tcp ctxt 1 is initialized 00000040:01000000:3.0:1788530103.330556:0:9516:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.141@tcp ctxt 0 is initialized 10000000:01000000:3.0:1788530103.330588:0:9516:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788530103.330592:0:9516:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788530103.330635:0:9516:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.202.141@tcp: setup lustre-OST0001-osd 00000040:01000000:3.0:1788530103.330667:0:9516:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.141@tcp ctxt 1 is initialized 00000040:01000000:3.0:1788530103.330673:0:9516:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.141@tcp ctxt 0 is initialized 10000000:01000000:3.0:1788530103.330681:0:9516:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-mdtir-ffff9a9e01aa6000 10000000:01000000:3.0:1788530103.330685:0:9516:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788530103.330707:0:9516:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788530103.330711:0:9516:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788530103.330748:0:9516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91c800/0xb28d70e1257503a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530103.330757:0:9516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91c800/0xb28d70e1257503a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530103.331052:0:9516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91c800/0xb28d70e1257503a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530103.331074:0:9516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d259f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:9516:1875409555726976:0@lo:101: 00000100:00100000:3.0:1788530103.331152:0:9516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530103.331189:0:9516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f2c3bb9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788530103.331246:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555726976 00000100:00100000:0.0:1788530103.331251:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555726976 00000100:00100000:0.0:1788530103.331298:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788530103.331306:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+16:9516:x1875409555726976:12345-0@lo:101: 00010000:00010000:0.0:1788530103.331329:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530103.331346:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f3d100c00/0xb28d70e1257503a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e1257503a0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.331374:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f3d100c00/0xb28d70e1257503a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e1257503a0 expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.331386:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f3d100c00/0xb28d70e1257503a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e1257503a0 expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.331397:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d100c00, rc 0) 00000100:00100000:0.0:1788530103.331444:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+17:9516:x1875409555726976:12345-0@lo:101: Request processed in 138us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530103.331451:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788530103.331615:0:9516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d259f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:9516:1875409555726976:0@lo:101: 00010000:00010000:3.0:1788530103.331631:0:9516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91c800/0xb28d70e1257503a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257503a7 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530103.331648:0:9516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91c800/0xb28d70e1257503a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e1257503a7 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530103.331720:0:9516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d259f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:9516:1875409555727104:0@lo:501: 00000100:00100000:3.0:1788530103.331749:0:9516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530103.331841:0:9516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f2c3bb9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788530103.331949:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555727104 00000100:00100000:0.0:1788530103.331954:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555727104 00000100:00100000:0.0:1788530103.332025:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788530103.332033:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+17:9516:x1875409555727104:12345-0@lo:501: 00000100:00100000:0.0:1788530103.332158:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+17:9516:x1875409555727104:12345-0@lo:501: Request processed in 126us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530103.332166:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788530103.332419:0:9516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d259f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:9516:1875409555727104:0@lo:501: 00000100:00100000:3.0:1788530103.332472:0:9516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d259f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:9516:1875409555727232:0@lo:503: 00000100:00100000:3.0:1788530103.332523:0:9516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530103.332546:0:9516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f2c3bb9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788530103.332793:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555727232 00000100:00100000:0.0:1788530103.332798:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555727232 00000100:00100000:0.0:1788530103.332842:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788530103.332850:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+17:9516:x1875409555727232:12345-0@lo:503: 00000100:00100000:0.0:1788530103.333167:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+17:9516:x1875409555727232:12345-0@lo:503: Request processed in 317us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530103.333175:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788530103.333547:0:9516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d259f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:9516:1875409555727232:0@lo:503: 00000040:00080000:3.0:1788530103.334242:0:9516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788530103.334394:0:9516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d259f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:9516:1875409555727360:0@lo:502: 00000100:00100000:3.0:1788530103.334467:0:9516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530103.334635:0:9516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f2c3bb9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788530103.334784:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555727360 00000100:00100000:1.0:1788530103.334800:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555727360 00000100:00100000:1.0:1788530103.334911:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788530103.334924:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+17:9516:x1875409555727360:12345-0@lo:502: 00000100:00100000:1.0:1788530103.335104:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+17:9516:x1875409555727360:12345-0@lo:502: Request processed in 182us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530103.335113:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788530103.335409:0:9516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d259f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:9516:1875409555727360:0@lo:502: 00000040:00080000:3.0:1788530103.335721:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788530103.335783:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1788530103.335801:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1788530103.335814:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1788530103.335827:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1788530103.335839:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1788530103.337176:0:9516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d259f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:9516:1875409555727488:0@lo:502: 00000100:00100000:3.0:1788530103.337279:0:9516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530103.337325:0:9516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f2c3bb9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788530103.337685:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555727488 00000100:00100000:1.0:1788530103.337695:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555727488 00000100:00100000:1.0:1788530103.337745:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788530103.337756:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+17:9516:x1875409555727488:12345-0@lo:502: 00000100:00100000:1.0:1788530103.338040:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+17:9516:x1875409555727488:12345-0@lo:502: Request processed in 284us (762us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530103.338048:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788530103.338308:0:9516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d259f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:9516:1875409555727488:0@lo:502: 00000040:00080000:3.0:1788530103.338411:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1788530103.338430:0:9516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:3.0:1788530103.339515:0:9527:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788530103.339527:0:9527:0:(obd_mount.c:963:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:3.0:1788530103.339534:0:9527:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788530103.339537:0:9527:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1788530103.339543:0:9527:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788530103.339700:0:9527:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9a9e027be620) 00000020:00000080:3.0:1788530103.339731:0:9527:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788530103.339739:0:9527:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788530103.339842:0:9527:0:(tgt_mount.c:167:server_get_mount()) get mount ffff9a9e01aa6000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1788530103.339852:0:9527:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788530103.339860:0:9527:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xb28d70e1257503b5 00010000:00010000:3.0:1788530103.347460:0:9527:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:0.0:1788530103.348248:0:9527:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1788530103.357724:0:9527:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1788530103.362669:0:9527:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1788530103.376488:0:9527:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:1.0:1788530103.379037:0:9527:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:1.0:1788530103.393389:0:9527:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:0.0:1788530103.398036:0:9527:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1788530103.398053:0:9527:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788530103.398062:0:9527:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788530103.398064:0:9527:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1788530103.398069:0:9527:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788530103.398074:0:9527:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788530103.398075:0:9527:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788530103.398079:0:9527:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788530103.398081:0:9527:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788530103.398121:0:9527:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788530103.398124:0:9527:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788530103.398125:0:9527:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788530103.398129:0:9527:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1788530103.398262:0:9516:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1788530103.398294:0:9516:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788530103.398330:0:9516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91c800/0xb28d70e1257503a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257503a7 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530103.398345:0:9516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91c800/0xb28d70e1257503a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257503a7 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788530103.398357:0:9516:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-mdtir-ffff9a9e01aa6000 from 1 10000000:01000000:1.0:1788530103.398362:0:9516:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788530103.398429:0:9516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9e025dc000/0xb28d70e1257503bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530103.398438:0:9516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9e025dc000/0xb28d70e1257503bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530103.398453:0:9516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9e025dc000/0xb28d70e1257503bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530103.398487:0:9516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:9516:1875409555727616:0@lo:101: 00000100:00100000:1.0:1788530103.399880:0:9516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530103.399951:0:9516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f09214480 going to sleep for 11 seconds 00000100:00100000:0.0:1788530103.401019:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555727616 00000100:00100000:0.0:1788530103.401036:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555727616 00000100:00100000:0.0:1788530103.401115:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788530103.401129:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+17:9516:x1875409555727616:12345-0@lo:101: 00010000:00010000:0.0:1788530103.401157:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530103.401185:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f3d100e00/0xb28d70e1257503c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e1257503bc expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.401227:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f3d100e00/0xb28d70e1257503c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e1257503bc expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.401242:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f3d100e00/0xb28d70e1257503c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e1257503bc expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.401253:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d100e00, rc 0) 00000100:00100000:0.0:1788530103.401361:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+18:9516:x1875409555727616:12345-0@lo:101: Request processed in 233us (1498us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530103.401368:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788530103.402487:0:9516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:9516:1875409555727616:0@lo:101: 00010000:00010000:1.0:1788530103.402522:0:9516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9e025dc000/0xb28d70e1257503bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257503c3 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530103.402536:0:9516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9e025dc000/0xb28d70e1257503bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e1257503c3 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530103.403496:0:9516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:9516:1875409555727744:0@lo:256: 00000100:00100000:1.0:1788530103.403642:0:9516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530103.403700:0:9516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f09214480 going to sleep for 11 seconds 00000100:00100000:2.0:1788530103.404795:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555727744 00000100:00100000:2.0:1788530103.404806:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555727744 00000100:00100000:2.0:1788530103.404876:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788530103.404887:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+18:9516:x1875409555727744:12345-0@lo:256: 20000000:01000000:2.0:1788530103.404909:0:6517:0:(mgs_nids.c:1159:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788530103.404932:0:6517:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788530103.404937:0:6517:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788530103.404940:0:6517:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788530103.404943:0:6517:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1788530103.405101:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+18:9516:x1875409555727744:12345-0@lo:256: Request processed in 216us (1459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530103.405110:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788530103.405410:0:9516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:9516:1875409555727744:0@lo:256: 10000000:01000000:3.0:1788530103.406157:0:9516:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788530103.406182:0:9516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9e025dc000/0xb28d70e1257503bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257503c3 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530103.406199:0:9516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9e025dc000/0xb28d70e1257503bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257503c3 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788530103.406209:0:9516:0:(mgc_request.c:2194:mgc_process_log()) Process log params-ffff9a9e01aa6000 from 1 10000000:01000000:3.0:1788530103.406213:0:9516:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788530103.406276:0:9516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d600/0xb28d70e1257503ca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530103.406286:0:9516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d600/0xb28d70e1257503ca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530103.406315:0:9516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d600/0xb28d70e1257503ca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530103.406345:0:9516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d259f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:9516:1875409555727872:0@lo:101: 00000100:00100000:3.0:1788530103.406425:0:9516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530103.406479:0:9516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f2c3bb6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788530103.407001:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555727872 00000100:00100000:1.0:1788530103.407015:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555727872 00000100:00100000:2.0:1788530103.415164:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788530103.415197:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+18:9516:x1875409555727872:12345-0@lo:101: 00010000:00010000:2.0:1788530103.415228:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530103.415259:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f18141400/0xb28d70e1257503d1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e1257503ca expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530103.415302:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f18141400/0xb28d70e1257503d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e1257503ca expref: 19 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530103.415335:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f18141400/0xb28d70e1257503d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e1257503ca expref: 19 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530103.415348:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f18141400, rc 0) 00000100:00100000:2.0:1788530103.415494:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+19:9516:x1875409555727872:12345-0@lo:101: Request processed in 311us (9068us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530103.415503:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788530103.415685:0:9516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d259f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:9516:1875409555727872:0@lo:101: 00010000:00010000:0.0:1788530103.415712:0:9516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d600/0xb28d70e1257503ca lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257503d1 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.415723:0:9516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d600/0xb28d70e1257503ca lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e1257503d1 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530103.415853:0:9516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027dbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:9516:1875409555728000:0@lo:501: 00000100:00100000:0.0:1788530103.415898:0:9516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530103.423454:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555728000 00000100:00100000:3.0:1788530103.423478:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555728000 00000100:00100000:3.0:1788530103.423577:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788530103.423593:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+19:9516:x1875409555728000:12345-0@lo:501: 00000100:00100000:3.0:1788530103.429414:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+19:9516:x1875409555728000:12345-0@lo:501: Request processed in 5809us (13499us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530103.429434:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788530103.430980:0:9516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f18125300 going to sleep for 11 seconds 00000100:00100000:1.0:1788530103.431030:0:9516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027dbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:9516:1875409555728000:0@lo:501: 00000100:00100000:1.0:1788530103.433129:0:9516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:9516:1875409555728128:0@lo:503: 00000100:00100000:1.0:1788530103.433243:0:9516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530103.433319:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555728128 00000100:00100000:1.0:1788530103.433320:0:9516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f092140c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788530103.433338:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555728128 00000100:00100000:3.0:1788530103.433410:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788530103.433422:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+19:9516:x1875409555728128:12345-0@lo:503: 00000100:00100000:3.0:1788530103.433671:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+19:9516:x1875409555728128:12345-0@lo:503: Request processed in 250us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530103.433680:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788530103.434242:0:9516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:9516:1875409555728128:0@lo:503: 00000040:00080000:1.0:1788530103.434629:0:9516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788530103.437334:0:9516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:9516:1875409555728256:0@lo:502: 00000100:00100000:1.0:1788530103.437470:0:9516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530103.437530:0:9516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f092140c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788530103.440097:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555728256 00000100:00100000:3.0:1788530103.440122:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555728256 00000100:00100000:3.0:1788530103.440196:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788530103.440208:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+19:9516:x1875409555728256:12345-0@lo:502: 00000100:00100000:3.0:1788530103.440452:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+19:9516:x1875409555728256:12345-0@lo:502: Request processed in 246us (2983us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530103.440472:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788530103.440581:0:9516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:9516:1875409555728256:0@lo:502: 00000040:00080000:3.0:1788530103.440923:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1788530103.440964:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1788530103.441012:0:9516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d25bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:9516:1875409555728384:0@lo:502: 00000100:00100000:3.0:1788530103.441068:0:9516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530103.441110:0:9516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f2c3bb6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788530103.441130:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555728384 00000100:00100000:3.0:1788530103.441134:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555728384 00000100:00100000:3.0:1788530103.441157:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788530103.441163:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+19:9516:x1875409555728384:12345-0@lo:502: 00000100:00100000:3.0:1788530103.441237:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+19:9516:x1875409555728384:12345-0@lo:502: Request processed in 73us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530103.441243:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788530103.441285:0:9516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d25bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:9516:1875409555728384:0@lo:502: 00000040:00080000:3.0:1788530103.441320:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1788530103.441328:0:9516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1788530103.451082:0:9531:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788530103.451107:0:9531:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788530103.451111:0:9531:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788530103.451144:0:9531:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a9e01aa6000 00000020:00000080:2.0:1788530103.451147:0:9531:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788530103.451163:0:9531:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788530103.451166:0:9531:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788530103.451167:0:9531:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788530103.451171:0:9531:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1788530103.451391:0:9516:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788530103.451417:0:9516:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788530103.451448:0:9516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d600/0xb28d70e1257503ca lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257503d1 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530103.451464:0:9516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d600/0xb28d70e1257503ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257503d1 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788530103.451547:0:9516:0:(mgc_request.c:2342:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788530103.451552:0:9516:0:(mgc_request.c:424:config_log_add()) add config log lustre-client-ffff9a9e01aa6000 10000000:01000000:3.0:1788530103.451615:0:9516:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-client-ffff9a9e01aa6000 10000000:01000000:3.0:1788530103.451621:0:9516:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788530103.451651:0:9516:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.202.141@tcp: setup lustre-OST0001-osd 00000040:01000000:3.0:1788530103.451751:0:9516:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.141@tcp ctxt 1 is initialized 00000040:01000000:3.0:1788530103.451761:0:9516:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.141@tcp ctxt 0 is initialized 10000000:01000000:3.0:1788530103.451961:0:9516:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-client-ffff9a9e01aa6000 from 1 10000000:01000000:3.0:1788530103.451966:0:9516:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788530103.452028:0:9516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91de00/0xb28d70e1257503d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530103.452037:0:9516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91de00/0xb28d70e1257503d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530103.452052:0:9516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91de00/0xb28d70e1257503d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530103.452087:0:9516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d25bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:9516:1875409555728512:0@lo:101: 00000100:00100000:3.0:1788530103.452207:0:9516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530103.452395:0:9516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f2c3bb6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788530103.454401:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555728512 00000100:00100000:0.0:1788530103.454419:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555728512 00000100:00100000:0.0:1788530103.454522:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788530103.454534:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+19:9516:x1875409555728512:12345-0@lo:101: 00010000:00010000:0.0:1788530103.454557:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530103.454619:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f3d100a00/0xb28d70e1257503df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e1257503d8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.454658:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f3d100a00/0xb28d70e1257503df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e1257503d8 expref: 20 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.454672:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f3d100a00/0xb28d70e1257503df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e1257503d8 expref: 20 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.454683:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d100a00, rc 0) 00000100:00100000:3.0:1788530103.454922:0:9516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d25bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:9516:1875409555728512:0@lo:101: 00010000:00010000:3.0:1788530103.454950:0:9516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91de00/0xb28d70e1257503d8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257503df expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530103.454962:0:9516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91de00/0xb28d70e1257503d8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e1257503df expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530103.455103:0:9516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d25bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:9516:1875409555728640:0@lo:501: 00000100:00100000:3.0:1788530103.455189:0:9516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530103.455247:0:9516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f2c3bb6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788530103.455419:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555728640 00000100:00100000:2.0:1788530103.455425:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555728640 00000100:00100000:2.0:1788530103.455463:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788530103.455474:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+21:9516:x1875409555728640:12345-0@lo:501: 00000100:00100000:2.0:1788530103.455664:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+21:9516:x1875409555728640:12345-0@lo:501: Request processed in 190us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530103.455674:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788530103.455756:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+20:9516:x1875409555728512:12345-0@lo:101: Request processed in 1224us (3550us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530103.455763:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788530103.455968:0:9516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d25bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:9516:1875409555728640:0@lo:501: 00000100:00100000:3.0:1788530103.456025:0:9516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d25bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:9516:1875409555728768:0@lo:503: 00000100:00100000:3.0:1788530103.456066:0:9516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530103.456089:0:9516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f2c3bb6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788530103.456188:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555728768 00000100:00100000:2.0:1788530103.456194:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555728768 00000100:00100000:2.0:1788530103.456220:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788530103.456227:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+20:9516:x1875409555728768:12345-0@lo:503: 00000100:00100000:2.0:1788530103.456334:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+20:9516:x1875409555728768:12345-0@lo:503: Request processed in 107us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530103.456346:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788530103.456466:0:9516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d25bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:9516:1875409555728768:0@lo:503: 00000040:00080000:3.0:1788530103.457184:0:9516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788530103.457317:0:9516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d25bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:9516:1875409555728896:0@lo:502: 00000100:00100000:3.0:1788530103.457380:0:9516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530103.457426:0:9516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f18162180 going to sleep for 11 seconds 00000100:00100000:2.0:1788530103.457541:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555728896 00000100:00100000:2.0:1788530103.457548:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555728896 00000100:00100000:2.0:1788530103.457613:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788530103.457622:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+20:9516:x1875409555728896:12345-0@lo:502: 00000100:00100000:2.0:1788530103.457745:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+20:9516:x1875409555728896:12345-0@lo:502: Request processed in 123us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530103.457754:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788530103.459983:0:9516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d25bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:9516:1875409555728896:0@lo:502: 00000040:00080000:3.0:1788530103.460354:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1788530103.460395:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1788530103.460408:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1788530103.460422:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1788530103.460435:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1788530103.460447:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1788530103.460462:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1788530103.460494:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1788530103.460510:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1788530103.460523:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1788530103.460535:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1788530103.460548:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1788530103.460588:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1788530103.460616:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1788530103.460632:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1788530103.460646:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1788530103.460659:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1788530103.460672:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1788530103.460683:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1788530103.460694:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1788530103.460714:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1788530103.460725:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1788530103.460736:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1788530103.460760:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1788530103.461027:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1788530103.461042:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1788530103.461053:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1788530103.461064:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:3.0:1788530103.461075:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1788530103.461087:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:3.0:1788530103.461099:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:3.0:1788530103.461111:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:3.0:1788530103.461124:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:3.0:1788530103.461136:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:3.0:1788530103.461148:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:3.0:1788530103.461160:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:3.0:1788530103.461173:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:3.0:1788530103.461185:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:3.0:1788530103.461196:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:3.0:1788530103.461221:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:3.0:1788530103.461236:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:3.0:1788530103.461249:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:3.0:1788530103.461262:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:3.0:1788530103.461276:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:3.0:1788530103.461288:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:3.0:1788530103.461301:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:3.0:1788530103.461352:0:9516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d25bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:9516:1875409555729024:0@lo:502: 00000100:00100000:3.0:1788530103.461447:0:9516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530103.461509:0:9516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f2c3bb6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788530103.465512:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555729024 00000100:00100000:1.0:1788530103.465531:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555729024 00000100:00100000:0.0:1788530103.475447:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788530103.475492:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+20:9516:x1875409555729024:12345-0@lo:502: 00000100:00100000:0.0:1788530103.475878:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+20:9516:x1875409555729024:12345-0@lo:502: Request processed in 410us (14430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530103.475887:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788530103.476021:0:9516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d25bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:9516:1875409555729024:0@lo:502: 00000040:00080000:1.0:1788530103.477277:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:1.0:1788530103.477296:0:9516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:0.0:1788530103.479982:0:9532:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788530103.480015:0:9532:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9a9f3d214c98) 00000020:00000080:0.0:1788530103.480055:0:9532:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:0.0:1788530103.480238:0:9532:0:(tgt_mount.c:167:server_get_mount()) get mount ffff9a9e01aa6000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788530103.480243:0:9532:0:(tgt_mount.c:201:server_put_mount()) put mount ffff9a9e01aa6000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788530103.480246:0:9532:0:(obd_mount.c:712:lustre_put_lsi()) put ffff9a9e01aa6000 3 00010000:00080000:0.0:1788530103.480299:0:9532:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a9e0223a800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.141@tcp at head 00010000:00010000:0.0:1788530103.487119:0:9532:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:0.0:1788530103.489261:0:9532:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1788530103.489339:0:9532:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788530103.489361:0:9532:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xb28d70e1257503ed 00000100:00080000:0.0:1788530103.489375:0:9532:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788530103.489384:0:9532:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9a9e0223a800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:0.0:1788530103.489448:0:9532:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9e027d9180 x1875409555729152/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788530103.489491:0:9532:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788530103.489802:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1875409555729152:0@lo:38: 00000100:00100000:1.0:1788530103.490327:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530103.490543:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555729152 00000100:00100000:0.0:1788530103.490555:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555729152 00000100:00100000:0.0:1788530103.491025:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788530103.491039:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3646:x1875409555729152:12345-0@lo:38: 00010000:00010000:3.0:1788530103.491186:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788530103.491437:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0263dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555729664:0@lo:400: 00000100:00100000:2.0:1788530103.491527:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530103.491619:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0263d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555730176:0@lo:400: 00000100:00100000:2.0:1788530103.491651:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530103.491680:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788530103.491686:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0263c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875409555729280:0@lo:400: 00000100:00100000:2.0:1788530103.491713:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530103.491730:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0263ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875409555729792:0@lo:400: 00000100:00100000:2.0:1788530103.491752:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788530103.491946:0:8678:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 311 last 0 00000020:00000080:0.0:1788530103.492003:0:8678:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xb28d70e1257503f4 00000004:00100000:0.0:1788530103.492028:0:8678:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:3.0:1788530103.492099:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0263c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555729408:0@lo:400: 00000100:00100000:3.0:1788530103.492137:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530103.492188:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0263d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875409555729920:0@lo:400: 00000100:00100000:3.0:1788530103.492214:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530103.492228:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788530103.492234:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0263f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875409555729536:0@lo:400: 00000100:00100000:3.0:1788530103.492257:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530103.492268:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0263f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555730048:0@lo:400: 00000100:00100000:3.0:1788530103.492288:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530103.492339:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555730176 00000100:00100000:3.0:1788530103.492348:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555730176 00000100:00100000:3.0:1788530103.492406:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555730048 00000100:00100000:3.0:1788530103.492409:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555730048 00000100:00100000:3.0:1788530103.492435:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788530103.492443:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0263e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555730176:12345-0@lo:400: 00000100:00100000:3.0:1788530103.492498:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0263e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555730176:12345-0@lo:400: Request processed in 56us (846us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530103.492506:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788530103.492525:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788530103.492531:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3735f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555730048:12345-0@lo:400: 00000100:00100000:3.0:1788530103.492580:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3735f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555730048:12345-0@lo:400: Request processed in 49us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530103.492587:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1788530103.492616:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788530103.492663:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e0263f800 x1875409555730048/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788530119 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530103.492682:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0263f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555730048:0@lo:400: 00000100:00080000:0.0:1788530103.492947:0:8678:0:(import.c:65:import_set_state_nolock()) ffff9a9e025cb000 : changing import state from RECOVER to FULL 00010000:00080000:2.0:1788530103.493176:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e0263d880 x1875409555730176/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788530119 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530103.493188:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0263d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555730176:0@lo:400: 00000100:00100000:2.0:1788530103.493226:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555729664 00000100:00100000:2.0:1788530103.493231:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555729664 00000100:00100000:2.0:1788530103.493261:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555729408 00000100:00100000:2.0:1788530103.493264:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555729408 00000100:00100000:2.0:1788530103.493278:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788530103.493285:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0263ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555729664:12345-0@lo:400: 00000100:00100000:3.0:1788530103.493409:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555729280 00000100:00100000:3.0:1788530103.493414:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555729280 00000100:00100000:3.0:1788530103.493460:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555729792 00000100:00100000:3.0:1788530103.493464:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555729792 00000100:00100000:3.0:1788530103.493489:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555729920 00000100:00100000:3.0:1788530103.493492:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555729920 00000100:00100000:3.0:1788530103.493506:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555729536 00000100:00100000:3.0:1788530103.493509:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555729536 00000100:00100000:3.0:1788530103.493522:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788530103.493529:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0263c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875409555729280:12345-0@lo:400: 00000100:00100000:2.0:1788530103.501343:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0263ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555729664:12345-0@lo:400: Request processed in 8037us (9796us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530103.501367:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788530103.501423:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788530103.501443:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d25bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555729408:12345-0@lo:400: 00000100:00100000:2.0:1788530103.501532:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d25bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555729408:12345-0@lo:400: Request processed in 100us (9394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530103.501538:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788530103.505210:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875409555729152:12345-0@lo:38: Request processed in 14162us (14873us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530103.505227:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788530103.505276:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788530103.505293:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0263ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875409555729792:12345-0@lo:400: 00000100:00100000:0.0:1788530103.505397:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0263ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875409555729792:12345-0@lo:400: Request processed in 112us (13643us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530103.505404:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788530103.505418:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788530103.505425:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d259f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875409555729920:12345-0@lo:400: 00000100:00100000:0.0:1788530103.505450:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d259f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875409555729920:12345-0@lo:400: Request processed in 27us (13236us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530103.505456:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788530103.505465:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788530103.505472:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d258700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875409555729536:12345-0@lo:400: 00000100:00100000:0.0:1788530103.505493:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d258700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875409555729536:12345-0@lo:400: Request processed in 22us (13236us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530103.505499:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:0.0:1788530103.506132:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e027d9180 x1875409555729152/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788530113 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530103.506150:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788530103.506164:0:3646:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1788530103.506177:0:3646:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788530103.506183:0:3646:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788530103.506187:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9e0223a800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788530103.506195:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1875409555729152:0@lo:38: 00000020:01000004:0.0:1788530103.506417:0:9532:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788530103.506437:0:9532:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9a9f3d216620) 00000020:00000080:0.0:1788530103.506465:0:9532:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:0.0:1788530103.506648:0:9532:0:(tgt_mount.c:167:server_get_mount()) get mount ffff9a9e01aa6000 from lustre-OST0001, refs=3 00010000:00080000:2.0:1788530103.506887:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e0263ea00 x1875409555729792/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530119 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530103.506908:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0263ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875409555729792:0@lo:400: 00000100:00100000:2.0:1788530103.506948:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0263dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555729664:0@lo:400: 00010000:00080000:2.0:1788530103.507030:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e0263f480 x1875409555729536/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530119 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530103.507042:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0263f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875409555729536:0@lo:400: 00000100:00100000:2.0:1788530103.507059:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0263c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555729408:0@lo:400: 00010000:00080000:2.0:1788530103.507074:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e0263d500 x1875409555729920/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530119 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530103.507082:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0263d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875409555729920:0@lo:400: 00000020:01000004:0.0:1788530103.507948:0:9532:0:(tgt_mount.c:201:server_put_mount()) put mount ffff9a9e01aa6000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788530103.507957:0:9532:0:(obd_mount.c:712:lustre_put_lsi()) put ffff9a9e01aa6000 3 00010000:00080000:0.0:1788530103.508015:0:9532:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a9e0223d000@lustre-MDT0001-lwp-OST0001: add connection 192.168.202.141@tcp at head 00000100:00100000:1.0:1788530103.508343:0:9533:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d7b80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9533:1875409555730304:0@lo:901: 00000100:00100000:1.0:1788530103.508447:0:9533:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530103.508499:0:9533:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f09214180 going to sleep for 11 seconds 00000100:00100000:3.0:1788530103.509782:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0263c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875409555729280:12345-0@lo:400: Request processed in 16234us (18049us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530103.509801:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:3.0:1788530103.509862:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788530103.509870:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788530103.509897:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555730304 00000100:00100000:3.0:1788530103.509908:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555730304 00000100:00100000:3.0:1788530103.510330:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788530103.510342:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9533:x1875409555730304:12345-0@lo:901: 00000100:00100000:3.0:1788530103.510498:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9533:x1875409555730304:12345-0@lo:901: Request processed in 158us (2052us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530103.510505:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1788530103.510524:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788530103.510627:0:9533:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e027d7b80 x1875409555730304/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788530119 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530103.510645:0:9533:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d7b80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9533:1875409555730304:0@lo:901: 00010000:00080000:2.0:1788530103.517307:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e0263c700 x1875409555729280/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530119 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530103.517334:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0263c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875409555729280:0@lo:400: 00010000:00010000:0.0:1788530103.520224:0:9532:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:0.0:1788530103.520473:0:9532:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:0.0:1788530103.520527:0:9532:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788530103.520545:0:9532:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xb28d70e125750402 00000100:00080000:0.0:1788530103.520594:0:9532:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788530103.520618:0:9532:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9a9e0223d000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:0.0:1788530103.520669:0:9532:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9e027d9180 x1875409555730432/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788530103.520701:0:9532:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1788530103.520749:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3646:1875409555730432:0@lo:38: 00000100:00100000:3.0:1788530103.520874:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530103.520930:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555730432 00000100:00100000:0.0:1788530103.520943:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555730432 00000100:00100000:0.0:1788530103.520992:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788530103.521003:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3735ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3646:x1875409555730432:12345-0@lo:38: 00010000:00080000:0.0:1788530103.521036:0:8678:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 311 last 0 00000020:00000080:0.0:1788530103.521073:0:8678:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xb28d70e125750409 00000004:00100000:0.0:1788530103.521091:0:8678:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788530103.521131:0:8678:0:(import.c:65:import_set_state_nolock()) ffff9a9f3d655000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788530103.521239:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3735ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875409555730432:12345-0@lo:38: Request processed in 235us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530103.521247:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000040:00080000:0.0:1788530103.521361:0:9532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:0.0:1788530103.521422:0:9516:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:0.0:1788530103.521438:0:9516:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788530103.521454:0:9516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91de00/0xb28d70e1257503d8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257503df expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.521466:0:9516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91de00/0xb28d70e1257503d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257503df expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788530103.521520:0:9516:0:(tgt_mount.c:1239:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788530103.521523:0:9516:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788530103.521524:0:9516:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788530103.521525:0:9516:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:0.0:1788530103.521526:0:9516:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:0.0:1788530103.521527:0:9516:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:0.0:1788530103.521529:0:9516:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788530103.521532:0:9516:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788530103.521534:0:9516:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788530103.521535:0:9516:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788530103.521537:0:9516:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788530103.521541:0:9516:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1788530103.521543:0:9516:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788530103.521545:0:9516:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788530103.521546:0:9516:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788530103.521548:0:9516:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:0.0:1788530103.521549:0:9516:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:0.0:1788530103.521551:0:9516:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:0.0:1788530103.521553:0:9516:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788530103.521554:0:9516:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788530103.521556:0:9516:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788530103.521615:0:9516:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788530103.521618:0:9516:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788530103.521635:0:9516:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788530103.521651:0:9516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027da680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:9516:1875409555730560:0@lo:253: 00000100:00100000:0.0:1788530103.521713:0:9516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530103.521763:0:9516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f06a6b300 going to sleep for 11 seconds 00010000:00080000:3.0:1788530103.522116:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e027d9180 x1875409555730432/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788530113 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530103.522145:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788530103.522158:0:3646:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1788530103.522169:0:3646:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788530103.522175:0:3646:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788530103.522179:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9e0223d000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788530103.522187:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3646:1875409555730432:0@lo:38: 00000100:00100000:1.0:1788530103.524080:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555730560 00000100:00100000:1.0:1788530103.524102:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555730560 00000100:00100000:1.0:1788530103.524206:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788530103.524221:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+20:9516:x1875409555730560:12345-0@lo:253: 20000000:01000000:1.0:1788530103.524283:0:6516:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788530103.524308:0:6516:0:(mgs_nids.c:468:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788530103.541682:0:6516:0:(mgs_nids.c:833:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788530103.541710:0:6516:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1788530103.541836:0:6539:0:(mgs_nids.c:730:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788530103.541863:0:6539:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788530103.541898:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a9f18140200/0xb28d70e125750410 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530103.541926:0:6539:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a9f18140e00/0xb28d70e1257502ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e1257502c7 expref: 20 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530103.541936:0:6539:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a9f18141000/0xb28d70e1257502ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e1257502e3 expref: 20 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530103.541944:0:6539:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a9f18140800/0xb28d70e12575033e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125750337 expref: 20 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530103.541952:0:6539:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a9f3d100e00/0xb28d70e1257503c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e1257503bc expref: 20 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530103.541962:0:6539:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a9f18140200/0xb28d70e125750410 lrc: 7/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530103.542027:0:6539:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a9f3d100e00/0xb28d70e1257503c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb28d70e1257503bc expref: 20 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530103.542046:0:6539:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a9f3d100e00/0xb28d70e1257503c3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb28d70e1257503bc expref: 20 pid: 6516 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530103.542066:0:6539:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0263c700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6539:1875409555730688:0@lo:104: 00000100:00100000:2.0:1788530103.542199:0:6539:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788530103.542292:0:6539:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a9f18140800/0xb28d70e12575033e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb28d70e125750337 expref: 20 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530103.542301:0:6539:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a9f18140800/0xb28d70e12575033e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb28d70e125750337 expref: 20 pid: 6516 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530103.542321:0:6539:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0263c000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6539:1875409555730816:0@lo:104: 00000100:00100000:2.0:1788530103.542354:0:6539:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788530103.542388:0:6539:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a9f18141000/0xb28d70e1257502ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb28d70e1257502e3 expref: 20 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530103.542398:0:6539:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a9f18141000/0xb28d70e1257502ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb28d70e1257502e3 expref: 20 pid: 6516 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530103.542407:0:6539:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0263f480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6539:1875409555730944:0@lo:104: 00010000:00010000:2.0:1788530103.542447:0:6539:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a9f18140e00/0xb28d70e1257502ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb28d70e1257502c7 expref: 20 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530103.542457:0:6539:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a9f18140e00/0xb28d70e1257502ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb28d70e1257502c7 expref: 20 pid: 6517 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530103.542466:0:6539:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0263dc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6539:1875409555731072:0@lo:104: 00000100:00100000:2.0:1788530103.542488:0:6539:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e0273bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788530103.542527:0:6507:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788530103.542548:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530103.542591:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530103.543400:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555730688 00000100:00100000:3.0:1788530103.543425:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555730688 00000100:00100000:3.0:1788530103.543484:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555730816 00000100:00100000:3.0:1788530103.543489:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555730816 00000100:00100000:3.0:1788530103.543506:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555730944 00000100:00100000:3.0:1788530103.543510:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555730944 00000100:00100000:3.0:1788530103.543529:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555731072 00000100:00100000:3.0:1788530103.543533:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555731072 00000100:00100000:3.0:1788530103.543576:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788530103.543593:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0263d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+6:6539:x1875409555730688:12345-0@lo:104: 00010000:00010000:3.0:1788530103.543623:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff9a9e025dc000/0xb28d70e1257503bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e1257503c3 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530103.546471:0:6507:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:2.0:1788530103.546493:0:6507:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:0.0:1788530103.550531:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+20:9516:x1875409555730560:12345-0@lo:253: Request processed in 26303us (28807us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530103.550548:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788530103.552031:0:9516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027da680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:9516:1875409555730560:0@lo:253: 10000000:01000000:2.0:1788530103.552064:0:9516:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788530103.552069:0:9516:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788530103.552071:0:9516:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788530103.552072:0:9516:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788530103.552073:0:9516:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:2.0:1788530103.552092:0:9516:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:2.0:1788530103.552094:0:9516:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:2.0:1788530103.552096:0:9516:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788530103.552098:0:9516:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788530103.552099:0:9516:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788530103.552101:0:9516:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788530103.552103:0:9516:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788530103.552127:0:9516:0:(tgt_mount.c:2823:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1788530103.556516:0:9537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788530103.556544:0:9537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37421450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+6:6539:x1875409555730816:12345-0@lo:104: 00010000:00010000:0.0:1788530103.556608:0:9537:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff9a9f42166600/0xb28d70e125750337 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e12575033e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530103.556689:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788530103.556700:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0263d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+6:6539:x1875409555730688:12345-0@lo:104: Request processed in 13112us (14503us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530103.556710:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:0.0:1788530103.556711:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788530103.556719:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9e025dc000/0xb28d70e1257503bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e1257503c3 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.556729:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9e025dc000 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:0.0:1788530103.556734:0:6512:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9e025dc000/0xb28d70e1257503bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xb28d70e1257503c3 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530103.556743:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00010000:00010000:0.0:1788530103.556746:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9e025dc000/0xb28d70e1257503bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xb28d70e1257503c3 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530103.556755:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0263ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+5:6539:x1875409555730944:12345-0@lo:104: 10000000:00010000:0.0:1788530103.556759:0:6512:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9e025dc000/0xb28d70e1257503bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xb28d70e1257503c3 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788530103.556766:0:6512:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788530103.556769:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91c200/0xb28d70e1257502e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e1257502ea expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.556818:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9e025dc000/0xb28d70e1257503bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e1257503c3 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.556826:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788530103.556838:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788530103.556846:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0263ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+5:6539:x1875409555730944:12345-0@lo:104: Request processed in 96us (14298us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530103.556854:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:0.0:1788530103.556854:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9e025dc000/0xb28d70e1257503bc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e1257503c3 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.556868:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9e025dc000/0xb28d70e1257503bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e1257503c3 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530103.556882:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00010000:00010000:0.0:1788530103.556884:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788530103.556889:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91c200/0xb28d70e1257502e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e1257502ea expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530103.556894:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0263d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+4:6539:x1875409555731072:12345-0@lo:104: 00010000:00010000:0.0:1788530103.556899:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f0c91c200 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:0.0:1788530103.556903:0:6512:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91c200/0xb28d70e1257502e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb28d70e1257502ea expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530103.556907:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91ca00/0xb28d70e1257502c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e1257502ce expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.556909:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91c200/0xb28d70e1257502e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xb28d70e1257502ea expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788530103.556925:0:6512:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91c200/0xb28d70e1257502e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb28d70e1257502ea expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788530103.556930:0:6512:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788530103.556947:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91c200/0xb28d70e1257502e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e1257502ea expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530103.556950:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:0.0:1788530103.556957:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788530103.556960:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0263d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+4:6539:x1875409555731072:12345-0@lo:104: Request processed in 69us (14367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530103.556969:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:0.0:1788530103.556973:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91c200/0xb28d70e1257502e3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e1257502ea expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.556980:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91c200/0xb28d70e1257502e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e1257502ea expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.556992:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788530103.556997:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530103.557002:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91ca00/0xb28d70e1257502c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e1257502ce expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.557008:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f0c91ca00 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:0.0:1788530103.557012:0:6512:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91ca00/0xb28d70e1257502c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb28d70e1257502ce expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.557019:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91ca00/0xb28d70e1257502c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb28d70e1257502ce expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788530103.557025:0:6512:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91ca00/0xb28d70e1257502c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb28d70e1257502ce expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788530103.557030:0:6512:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788530103.557058:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91ca00/0xb28d70e1257502c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e1257502ce expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.557073:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788530103.557079:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91ca00/0xb28d70e1257502c7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e1257502ce expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.557085:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91ca00/0xb28d70e1257502c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e1257502ce expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.557094:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530103.557095:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530103.557097:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788530103.557115:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3648:1875409555731200:0@lo:103: 00000100:00100000:0.0:1788530103.557166:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530103.557217:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555731200 00000100:00100000:0.0:1788530103.557225:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555731200 00010000:00010000:0.0:1788530103.557261:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a9f3d100e00/0xb28d70e1257503c3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e1257503bc expref: 20 pid: 6516 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530103.557288:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788530103.557294:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+20:3648:x1875409555731200:12345-0@lo:103: 00010000:00010000:0.0:1788530103.557305:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788530103.557309:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a9f3d100e00/0xb28d70e1257503c3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e1257503bc expref: 20 pid: 6516 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.557319:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a9f3d100e00/0xb28d70e1257503c3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb28d70e1257503bc expref: 20 pid: 6516 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.557338:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788530103.557361:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+20:3648:x1875409555731200:12345-0@lo:103: Request processed in 68us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530103.557367:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788530103.557399:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3648:1875409555731200:0@lo:103: 00010000:00010000:0.0:1788530103.557423:0:9537:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788530103.557428:0:9537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37421450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+3:6539:x1875409555730816:12345-0@lo:104: Request processed in 897us (15074us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530103.557435:0:9537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:0.0:1788530103.557470:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788530103.557475:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f42166600/0xb28d70e125750337 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e12575033e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.557482:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f42166600 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:0.0:1788530103.557485:0:6511:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f42166600/0xb28d70e125750337 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb28d70e12575033e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.557502:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f42166600/0xb28d70e125750337 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb28d70e12575033e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788530103.557509:0:6511:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f42166600/0xb28d70e125750337 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb28d70e12575033e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788530103.557515:0:6511:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788530103.557528:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9f42166600/0xb28d70e125750337 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e12575033e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.557534:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788530103.557542:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f42166600/0xb28d70e125750337 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e12575033e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.557549:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f42166600/0xb28d70e125750337 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e12575033e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.557673:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530103.557675:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530103.557676:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788530103.557682:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788530103.557690:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3648:1875409555731584:0@lo:103: 00000100:00100000:0.0:1788530103.557715:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530103.557743:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555731584 00000100:00100000:0.0:1788530103.557747:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555731584 00010000:00010000:0.0:1788530103.557761:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a9f18140800/0xb28d70e12575033e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e125750337 expref: 20 pid: 6516 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530103.557783:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788530103.557789:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f396c2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+20:3648:x1875409555731584:12345-0@lo:103: 00010000:00010000:0.0:1788530103.557804:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788530103.557808:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a9f18140800/0xb28d70e12575033e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e125750337 expref: 20 pid: 6516 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.557817:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a9f18140800/0xb28d70e12575033e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb28d70e125750337 expref: 20 pid: 6516 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.557828:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788530103.557855:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f396c2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+20:3648:x1875409555731584:12345-0@lo:103: Request processed in 66us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530103.557862:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788530103.557986:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3648:1875409555731584:0@lo:103: 00000100:00100000:3.0:1788530103.564172:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3649:1875409555731328:0@lo:103: 00000100:00100000:3.0:1788530103.564296:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530103.564388:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3650:1875409555731456:0@lo:103: 00000100:00100000:2.0:1788530103.564471:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788530103.564493:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f3d100e00/0xb28d70e1257503c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb28d70e1257503bc expref: 19 pid: 6516 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530103.564526:0:6539:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0263c700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6539:1875409555730688:0@lo:104: 00010000:00010000:3.0:1788530103.564551:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f18140800/0xb28d70e12575033e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb28d70e125750337 expref: 18 pid: 6516 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530103.564626:0:6539:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0263c000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6539:1875409555730816:0@lo:104: 00000100:00100000:3.0:1788530103.564646:0:6539:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0263f480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6539:1875409555730944:0@lo:104: 00000100:00100000:3.0:1788530103.564658:0:6539:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0263dc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6539:1875409555731072:0@lo:104: 00010000:00010000:3.0:1788530103.564711:0:6539:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a9f18140200/0xb28d70e125750410 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530103.566050:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555731328 00000100:00100000:0.0:1788530103.566074:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555731328 00010000:00010000:0.0:1788530103.566132:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a9f18141000/0xb28d70e1257502ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e1257502e3 expref: 18 pid: 6516 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530103.566169:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555731456 00000100:00100000:0.0:1788530103.566172:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555731456 00010000:00010000:0.0:1788530103.566183:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a9f18140e00/0xb28d70e1257502ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e1257502c7 expref: 19 pid: 6517 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530103.566199:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788530103.566209:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3735c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+19:3649:x1875409555731328:12345-0@lo:103: 00010000:00010000:0.0:1788530103.566227:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788530103.566232:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a9f18141000/0xb28d70e1257502ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e1257502e3 expref: 19 pid: 6516 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.566244:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a9f18141000/0xb28d70e1257502ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb28d70e1257502e3 expref: 19 pid: 6516 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.566282:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f18141000/0xb28d70e1257502ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb28d70e1257502e3 expref: 19 pid: 6516 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.566298:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788530103.566375:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3735c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+18:3649:x1875409555731328:12345-0@lo:103: Request processed in 166us (2089us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530103.566381:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788530103.566399:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788530103.566405:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0263f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+17:3650:x1875409555731456:12345-0@lo:103: 00010000:00010000:0.0:1788530103.566412:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788530103.566417:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a9f18140e00/0xb28d70e1257502ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e1257502c7 expref: 17 pid: 6517 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.566425:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a9f18140e00/0xb28d70e1257502ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb28d70e1257502c7 expref: 17 pid: 6517 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.566433:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f18140e00/0xb28d70e1257502ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb28d70e1257502c7 expref: 17 pid: 6517 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.566445:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a9f18140200/0xb28d70e125750410 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.566453:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f18140200/0xb28d70e125750410 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788530103.566473:0:6509:0:(mgs_nids.c:706:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.024612389s 00010000:00010000:0.0:1788530103.566477:0:6509:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a9f18140200/0xb28d70e125750410 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.566496:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a9f18140200/0xb28d70e125750410 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.566503:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a9f18140200/0xb28d70e125750410 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.566511:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a9f18140200/0xb28d70e125750410 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.566518:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f18140200 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:0.0:1788530103.566524:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a9f18140200/0xb28d70e125750410 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.566531:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a9f18140200/0xb28d70e125750410 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.566548:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a9f18140200/0xb28d70e125750410 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.566583:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788530103.566628:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0263f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+16:3650:x1875409555731456:12345-0@lo:103: Request processed in 224us (2159us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530103.566635:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:0.0:1788530103.566685:0:6539:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a9f18140200/0xb28d70e125750410 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.566695:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a9f18140200/0xb28d70e125750410 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530103.566702:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f18140200/0xb28d70e125750410 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530103.566979:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3649:1875409555731328:0@lo:103: 00000100:00100000:2.0:1788530103.567292:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3650:1875409555731456:0@lo:103: 00080000:10000000:2.0:1788530103.571917:0:9516:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1788530103.572109:0:9516:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1788530103.572316:0:9516:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1788530103.572476:0:9516:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1788530103.572796:0:9516:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1788530103.573037:0:9516:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:0.0:1788530103.578262:0:9516:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1788530103.621774:0:9516:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1788530103.621787:0:9516:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1788530103.621852:0:9516:0:(tgt_mount.c:2543:server_fill_super_common()) Server sb, dev=50 00000080:00000004:3.0:1788530103.621876:0:9516:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:3.0:1788530103.626255:0:9516:0:(tgt_mount.c:2429:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788530103.632291:0:9516:0:(tgt_mount.c:2444:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:0.0:1788530104.512841:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788530104.772891:0:9590:0:(tgt_mount.c:2429:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788530104.773475:0:9590:0:(tgt_mount.c:2444:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788530105.540839:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788530105.920755:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788530105.920782:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3735c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555731712:0@lo:41: 00000100:00100000:3.0:1788530105.920868:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530105.920949:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555731712 00000100:00100000:3.0:1788530105.920959:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555731712 00000100:00100000:3.0:1788530105.921030:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788530105.921040:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3735ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555731712:12345-0@lo:41: 00000004:00000024:3.0:1788530105.921080:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:3.0:1788530105.921128:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3735ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555731712:12345-0@lo:41: Request processed in 88us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530105.921136:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788530105.921339:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3735c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555731712:0@lo:41: 00000100:00100000:2.0:1788530106.434826:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555731840:0@lo:13: 00000100:00100000:2.0:1788530106.434912:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530106.435197:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555731840 00000100:00100000:0.0:1788530106.435211:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555731840 00000100:00100000:0.0:1788530106.435303:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788530106.435317:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0263fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555731840:12345-0@lo:13: 00002000:00000024:0.0:1788530106.435370:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788530106.435433:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0263fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555731840:12345-0@lo:13: Request processed in 119us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530106.435441:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1788530106.435472:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788530106.435890:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e027dad80 x1875409555731840/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530122 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530106.435913:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555731840:0@lo:13: 00000100:00100000:3.0:1788530106.439122:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788530106.439168:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555731968:0@lo:13: 00000100:00100000:3.0:1788530106.439322:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530106.439877:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555731968 00000100:00100000:0.0:1788530106.439889:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555731968 00000100:00100000:0.0:1788530106.439965:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788530106.439979:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3735c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555731968:12345-0@lo:13: 00002000:00000024:0.0:1788530106.440002:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788530106.440055:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3735c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555731968:12345-0@lo:13: Request processed in 77us (734us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530106.440062:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1788530106.440159:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e027d8380 x1875409555731968/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530122 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530106.440187:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555731968:0@lo:13: 00000100:00080000:3.0:1788530106.442158:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788530106.566959:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788530107.456777:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788530107.456852:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3735fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555732096:0@lo:41: 00000100:00100000:2.0:1788530107.456948:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530107.457469:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555732096 00000100:00100000:3.0:1788530107.457480:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555732096 00000100:00100000:3.0:1788530107.457538:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788530107.457556:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0263d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555732096:12345-0@lo:41: 00000004:00000024:3.0:1788530107.457633:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446502400 avail 1300262912 00000100:00100000:3.0:1788530107.457697:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0263d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555732096:12345-0@lo:41: Request processed in 141us (748us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530107.457705:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788530107.457757:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3735fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555732096:0@lo:41: 00010000:00010000:0.0:1788530107.585400:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530108.609397:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788530108.994874:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3735fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3648:1875409555732224:0@lo:400: 00000100:00100000:3.0:1788530108.994976:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530108.995031:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555732736:0@lo:400: 00000100:00100000:3.0:1788530108.995060:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530108.995081:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0335b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555733248:0@lo:400: 00000100:00100000:3.0:1788530108.995105:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530108.995131:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788530108.995137:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875409555732608:0@lo:400: 00000100:00100000:3.0:1788530108.995162:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530108.995180:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03359500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555733120:0@lo:400: 00000100:00100000:3.0:1788530108.995201:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530108.995227:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875409555732352:0@lo:400: 00000100:00100000:3.0:1788530108.995251:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530108.995267:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03359c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875409555732864:0@lo:400: 00000100:00100000:3.0:1788530108.995287:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530108.995303:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03359880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875409555733376:0@lo:400: 00000100:00100000:3.0:1788530108.995324:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530108.995342:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788530108.995347:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555732480:0@lo:400: 00000100:00100000:3.0:1788530108.995376:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530108.995393:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0335aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875409555732992:0@lo:400: 00000100:00100000:3.0:1788530108.995412:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530108.995422:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03358a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875409555733504:0@lo:400: 00000100:00100000:3.0:1788530108.995441:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530108.995471:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555732736 00000100:00100000:3.0:1788530108.995481:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555732736 00000100:00100000:3.0:1788530108.995523:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555732480 00000100:00100000:3.0:1788530108.995526:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555732480 00000100:00100000:3.0:1788530108.995555:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788530108.995588:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0335a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555732736:12345-0@lo:400: 00000100:00100000:3.0:1788530108.995644:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0335a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555732736:12345-0@lo:400: Request processed in 57us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530108.995651:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788530108.995668:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788530108.995674:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0335ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555732480:12345-0@lo:400: 00000100:00100000:3.0:1788530108.995705:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0335ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555732480:12345-0@lo:400: Request processed in 31us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530108.995711:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788530108.995731:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555733248 00000100:00100000:3.0:1788530108.995735:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555733248 00000100:00100000:3.0:1788530108.995766:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555733120 00000100:00100000:3.0:1788530108.995769:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555733120 00000100:00100000:3.0:1788530108.995790:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788530108.995797:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03358380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555733248:12345-0@lo:400: 00000100:00100000:3.0:1788530108.995827:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03358380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555733248:12345-0@lo:400: Request processed in 31us (722us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530108.995843:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788530108.995854:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788530108.995860:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0335b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555733120:12345-0@lo:400: 00000100:00100000:3.0:1788530108.995887:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0335b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555733120:12345-0@lo:400: Request processed in 28us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530108.995894:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788530108.995914:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555732608 00000100:00100000:3.0:1788530108.995917:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555732608 00000100:00100000:3.0:1788530108.995952:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555732352 00000100:00100000:3.0:1788530108.995955:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555732352 00000100:00100000:3.0:1788530108.995966:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555732864 00000100:00100000:3.0:1788530108.995969:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555732864 00000100:00100000:3.0:1788530108.995979:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555733376 00000100:00100000:3.0:1788530108.995981:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555733376 00000100:00100000:3.0:1788530108.995991:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555732992 00000100:00100000:3.0:1788530108.995994:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555732992 00000100:00100000:3.0:1788530108.996005:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555733504 00000100:00100000:3.0:1788530108.996007:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555733504 00000100:00100000:3.0:1788530108.996020:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788530108.996026:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03358e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875409555732608:12345-0@lo:400: 00000100:00100000:3.0:1788530108.996066:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03358e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875409555732608:12345-0@lo:400: Request processed in 40us (902us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530108.996073:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788530108.996087:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788530108.996093:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0335bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875409555732352:12345-0@lo:400: 00000100:00100000:3.0:1788530108.996120:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0335bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875409555732352:12345-0@lo:400: Request processed in 27us (868us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530108.996126:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788530108.996144:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788530108.996150:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03359180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875409555732864:12345-0@lo:400: 00000100:00100000:3.0:1788530108.996176:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03359180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875409555732864:12345-0@lo:400: Request processed in 26us (888us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530108.996182:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788530108.996193:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788530108.996198:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0335a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875409555733376:12345-0@lo:400: 00000100:00100000:3.0:1788530108.996223:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0335a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875409555733376:12345-0@lo:400: Request processed in 25us (897us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530108.996228:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788530108.996239:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788530108.996245:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03359f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875409555732992:12345-0@lo:400: 00000100:00100000:3.0:1788530108.996267:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03359f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875409555732992:12345-0@lo:400: Request processed in 23us (854us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530108.996273:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788530108.996285:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788530108.996291:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03358700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875409555733504:12345-0@lo:400: 00000100:00100000:3.0:1788530108.996313:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03358700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875409555733504:12345-0@lo:400: Request processed in 23us (872us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530108.996319:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:3.0:1788530108.996354:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788530108.996359:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788530108.996361:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788530108.996392:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555732480:0@lo:400: 00010000:00080000:3.0:1788530108.996405:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e0335aa00 x1875409555732992/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530124 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530108.996428:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0335aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875409555732992:0@lo:400: 00010000:00080000:3.0:1788530108.996438:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e03358a80 x1875409555733504/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530124 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530108.996447:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03358a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875409555733504:0@lo:400: 00010000:00080000:3.0:1788530108.996456:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f328e5f80 x1875409555732352/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530124 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530108.996465:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875409555732352:0@lo:400: 00010000:00080000:3.0:1788530108.996475:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e03359c00 x1875409555732864/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530124 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530108.996483:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03359c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875409555732864:0@lo:400: 00010000:00080000:3.0:1788530108.996491:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e03359880 x1875409555733376/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530124 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530108.996498:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03359880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875409555733376:0@lo:400: 00010000:00080000:3.0:1788530108.996538:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f328e7800 x1875409555732608/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530124 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530108.996557:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875409555732608:0@lo:400: 00010000:00080000:3.0:1788530108.996587:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e03359500 x1875409555733120/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788530124 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530108.996595:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03359500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555733120:0@lo:400: 00000100:00100000:3.0:1788530108.996606:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555732736:0@lo:400: 00010000:00080000:3.0:1788530108.996615:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e0335b800 x1875409555733248/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788530124 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530108.996629:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0335b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555733248:0@lo:400: 00000100:00100000:1.0:1788530109.003652:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555732224 00000100:00100000:1.0:1788530109.003668:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555732224 00000100:00100000:1.0:1788530109.003738:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788530109.003749:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+16:3648:x1875409555732224:12345-0@lo:400: 00000100:00100000:1.0:1788530109.004203:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+16:3648:x1875409555732224:12345-0@lo:400: Request processed in 455us (9226us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530109.004211:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788530109.010511:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3735fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3648:1875409555732224:0@lo:400: 00010000:00010000:0.0:1788530109.645428:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530110.657706:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788530111.016764:0:9879:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg241-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1788530111.045241:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555733632:0@lo:41: 00000100:00100000:0.0:1788530111.045323:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530111.045418:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555733632 00000100:00100000:0.0:1788530111.045426:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555733632 00000100:00100000:0.0:1788530111.045490:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788530111.045500:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555733632:12345-0@lo:41: 00000004:00000024:0.0:1788530111.045550:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:0.0:1788530111.045619:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555733632:12345-0@lo:41: Request processed in 119us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530111.045627:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788530111.045680:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555733632:0@lo:41: 10000000:01000000:2.0:1788530111.051042:0:6521:0:(mgc_request.c:715:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788530111.051052:0:6521:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-mdtir-ffff9a9e01aa6000 from 6 10000000:01000000:2.0:1788530111.051058:0:6521:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788530111.051106:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f18141200/0xb28d70e125750417 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530111.051118:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f18141200/0xb28d70e125750417 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530111.051130:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f18141200/0xb28d70e125750417 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530111.051155:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0263dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555733760:0@lo:101: 00000100:00100000:2.0:1788530111.051225:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530111.051311:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e0244ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788530111.059264:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555733760 00000100:00100000:0.0:1788530111.059292:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555733760 00000100:00100000:0.0:1788530111.059556:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788530111.059593:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+16:6521:x1875409555733760:12345-0@lo:101: 00010000:00010000:0.0:1788530111.059617:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530111.059640:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f3d101e00/0xb28d70e12575041e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e125750417 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530111.059672:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f3d101e00/0xb28d70e12575041e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e125750417 expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530111.059686:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f3d101e00/0xb28d70e12575041e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125750417 expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530111.059696:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d101e00, rc 0) 00000100:00100000:0.0:1788530111.059804:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+17:6521:x1875409555733760:12345-0@lo:101: Request processed in 214us (8579us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530111.059813:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788530111.059956:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0263dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555733760:0@lo:101: 00010000:00010000:2.0:1788530111.059990:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f18141200/0xb28d70e125750417 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575041e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530111.060003:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f18141200/0xb28d70e125750417 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e12575041e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530111.060108:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0263dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555733888:0@lo:256: 00000100:00100000:2.0:1788530111.060166:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530111.063934:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e0244ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788530111.064487:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555733888 00000100:00100000:1.0:1788530111.064497:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555733888 00000100:00100000:1.0:1788530111.064556:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788530111.064581:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+17:6521:x1875409555733888:12345-0@lo:256: 20000000:01000000:1.0:1788530111.064608:0:6517:0:(mgs_nids.c:1159:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788530111.064624:0:6517:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788530111.064627:0:6517:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1788530111.064741:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+17:6521:x1875409555733888:12345-0@lo:256: Request processed in 163us (4576us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530111.064749:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788530111.068154:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0263dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555733888:0@lo:256: 10000000:01000000:2.0:1788530111.068207:0:6521:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788530111.068217:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f18141200/0xb28d70e125750417 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575041e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530111.068229:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f18141200/0xb28d70e125750417 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575041e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788530111.068244:0:6521:0:(mgc_request.c:715:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788530111.068246:0:6521:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-client-ffff9a9f33b6f800 from 39 10000000:01000000:2.0:1788530111.068250:0:6521:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788530111.068280:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f18140200/0xb28d70e125750425 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530111.068288:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f18140200/0xb28d70e125750425 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530111.068297:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f18140200/0xb28d70e125750425 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530111.068314:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0263dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555734016:0@lo:101: 00000100:00100000:2.0:1788530111.068365:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530111.071544:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e0244ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788530111.076646:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555734016 00000100:00100000:1.0:1788530111.076666:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555734016 00000100:00100000:1.0:1788530111.076799:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788530111.076810:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+17:6521:x1875409555734016:12345-0@lo:101: 00010000:00010000:1.0:1788530111.076830:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530111.076849:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9e025dd600/0xb28d70e12575042c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e125750425 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530111.076884:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9e025dd600/0xb28d70e12575042c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e125750425 expref: 18 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530111.076896:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9e025dd600/0xb28d70e12575042c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125750425 expref: 18 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530111.076904:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9e025dd600, rc 0) 00000100:00100000:1.0:1788530111.076998:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+18:6521:x1875409555734016:12345-0@lo:101: Request processed in 190us (8632us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530111.077006:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788530111.079685:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0263dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555734016:0@lo:101: 00010000:00010000:2.0:1788530111.079714:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f18140200/0xb28d70e125750425 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575042c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530111.079727:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f18140200/0xb28d70e125750425 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e12575042c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788530111.079932:0:6521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:2.0:1788530111.080288:0:6521:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788530111.080696:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1788530111.080722:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 120 off8536 00000040:00080000:2.0:1788530111.080738:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 168 off8704 00000040:00080000:2.0:1788530111.080752:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8928 00000040:00080000:2.0:1788530111.080767:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9152 00000040:00080000:2.0:1788530111.080781:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 120 off9272 00000040:00080000:2.0:1788530111.080794:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 168 off9440 00000040:00080000:2.0:1788530111.080808:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].8, 224 off9664 00000040:00080000:2.0:1788530111.080823:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].9, 224 off9888 00000040:00080000:2.0:1788530111.080836:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].10, 120 off10008 00000040:00080000:2.0:1788530111.080850:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].11, 224 off10232 00000040:00080000:2.0:1788530111.080864:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].12, 224 off10456 00000040:00080000:2.0:1788530111.080878:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].13, 88 off10544 00000040:00080000:2.0:1788530111.080891:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].14, 128 off10672 00000040:00080000:2.0:1788530111.080906:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].15, 144 off10816 00000040:00080000:2.0:1788530111.080918:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].16, 160 off10976 00000040:00080000:2.0:1788530111.080931:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].17, 224 off11200 00000040:00080000:2.0:1788530111.080945:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].18, 224 off11424 00000040:00080000:2.0:1788530111.080960:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].19, 80 off11504 00000040:00080000:2.0:1788530111.080973:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].20, 224 off11728 00000040:00080000:2.0:1788530111.080984:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].21, 224 off11952 00000040:00080000:2.0:1788530111.080996:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].22, 88 off12040 00000040:00080000:2.0:1788530111.081008:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].23, 128 off12168 00000040:00080000:2.0:1788530111.081022:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].24, 144 off12312 00000040:00080000:2.0:1788530111.081036:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].25, 160 off12472 00000040:00080000:2.0:1788530111.081048:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].26, 224 off12696 00000040:00080000:2.0:1788530111.081062:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].27, 224 off12920 00000040:00080000:2.0:1788530111.081073:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].28, 80 off13000 00000040:00080000:2.0:1788530111.081084:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].29, 224 off13224 00000040:00080000:2.0:1788530111.081108:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].30, 224 off13448 00000040:00080000:2.0:1788530111.081121:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].31, 88 off13536 00000040:00080000:2.0:1788530111.081132:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].32, 128 off13664 00000040:00080000:2.0:1788530111.081145:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].33, 144 off13808 00000040:00080000:2.0:1788530111.081157:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].34, 128 off13936 00000040:00080000:2.0:1788530111.081170:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].35, 224 off14160 00000040:00080000:2.0:1788530111.081186:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].36, 224 off14384 00000040:00080000:2.0:1788530111.081199:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].37, 80 off14464 00000040:00080000:2.0:1788530111.081220:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].38, 224 off14688 00000040:00080000:2.0:1788530111.081227:0:6521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:2.0:1788530111.081347:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0263dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555734144:0@lo:501: 00000100:00100000:2.0:1788530111.082551:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530111.082631:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e0244ecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788530111.083966:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555734144 00000100:00100000:3.0:1788530111.083980:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555734144 00000100:00100000:3.0:1788530111.084105:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788530111.084115:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+18:6521:x1875409555734144:12345-0@lo:501: 00000100:00100000:3.0:1788530111.084278:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+18:6521:x1875409555734144:12345-0@lo:501: Request processed in 164us (1733us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530111.084286:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788530111.085090:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0263dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555734144:0@lo:501: 00000100:00100000:2.0:1788530111.085142:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0263dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555734272:0@lo:503: 00000100:00100000:2.0:1788530111.085189:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530111.085208:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e0244ecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788530111.086133:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555734272 00000100:00100000:3.0:1788530111.086142:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555734272 00000100:00100000:3.0:1788530111.086183:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788530111.086190:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+18:6521:x1875409555734272:12345-0@lo:503: 00000100:00100000:3.0:1788530111.086304:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+18:6521:x1875409555734272:12345-0@lo:503: Request processed in 114us (1114us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530111.086312:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788530111.090790:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0263dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555734272:0@lo:503: 00000040:00080000:0.0:1788530111.091416:0:6521:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788530111.091708:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555734400:0@lo:502: 00000100:00100000:0.0:1788530111.091786:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530111.091829:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f086db9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788530111.094762:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555734400 00000100:00100000:0.0:1788530111.094779:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555734400 00000100:00100000:0.0:1788530111.094860:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788530111.094869:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+18:6521:x1875409555734400:12345-0@lo:502: 00000100:00100000:0.0:1788530111.095093:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+18:6521:x1875409555734400:12345-0@lo:502: Request processed in 224us (3306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530111.095101:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788530111.095184:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555734400:0@lo:502: 00000040:00080000:0.0:1788530111.095453:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1788530111.095486:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 120 off8536 00000040:00080000:0.0:1788530111.095498:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 168 off8704 00000040:00080000:0.0:1788530111.095510:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8928 00000040:00080000:0.0:1788530111.095523:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9152 00000040:00080000:0.0:1788530111.095549:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 120 off9272 00000040:00080000:0.0:1788530111.095589:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 168 off9440 00000040:00080000:0.0:1788530111.095604:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9664 00000040:00080000:0.0:1788530111.095633:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 224 off9888 00000040:00080000:0.0:1788530111.095647:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 120 off10008 00000040:00080000:0.0:1788530111.095677:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10232 00000040:00080000:0.0:1788530111.095691:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 224 off10456 00000040:00080000:0.0:1788530111.095704:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 88 off10544 00000040:00080000:0.0:1788530111.095716:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].14, 128 off10672 00000040:00080000:0.0:1788530111.095729:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].15, 144 off10816 00000040:00080000:0.0:1788530111.095740:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].16, 160 off10976 00000040:00080000:0.0:1788530111.095752:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].17, 224 off11200 00000040:00080000:0.0:1788530111.095775:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].18, 224 off11424 00000040:00080000:0.0:1788530111.095788:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].19, 80 off11504 00000040:00080000:0.0:1788530111.095802:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].20, 224 off11728 00000040:00080000:0.0:1788530111.095814:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].21, 224 off11952 00000040:00080000:0.0:1788530111.095828:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].22, 88 off12040 00000040:00080000:0.0:1788530111.095840:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].23, 128 off12168 00000040:00080000:0.0:1788530111.095853:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].24, 144 off12312 00000040:00080000:0.0:1788530111.095865:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].25, 160 off12472 00000040:00080000:0.0:1788530111.095877:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].26, 224 off12696 00000040:00080000:0.0:1788530111.095902:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].27, 224 off12920 00000040:00080000:0.0:1788530111.095916:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].28, 80 off13000 00000040:00080000:0.0:1788530111.095930:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].29, 224 off13224 00000040:00080000:0.0:1788530111.095943:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].30, 224 off13448 00000040:00080000:0.0:1788530111.095955:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].31, 88 off13536 00000040:00080000:0.0:1788530111.095969:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].32, 128 off13664 00000040:00080000:0.0:1788530111.095981:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].33, 144 off13808 00000040:00080000:0.0:1788530111.095993:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].34, 128 off13936 00000040:00080000:0.0:1788530111.096006:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].35, 224 off14160 00000040:00080000:0.0:1788530111.096020:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].36, 224 off14384 00000040:00080000:0.0:1788530111.096035:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].37, 80 off14464 00000040:00080000:0.0:1788530111.096048:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].38, 224 off14688 00000040:00080000:0.0:1788530111.096061:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].39, 224 off14912 00000040:00080000:0.0:1788530111.096074:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].40, 88 off15000 00000040:00080000:0.0:1788530111.096086:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].41, 128 off15128 00000040:00080000:0.0:1788530111.096099:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].42, 144 off15272 00000040:00080000:0.0:1788530111.096125:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].43, 128 off15400 00000040:00080000:0.0:1788530111.096140:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].44, 224 off15624 00000040:00080000:0.0:1788530111.096153:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].45, 224 off15848 00000040:00080000:0.0:1788530111.096165:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].46, 80 off15928 00000100:00100000:0.0:1788530111.096203:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555734528:0@lo:502: 00000100:00100000:0.0:1788530111.096261:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530111.096299:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f086db9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788530111.096421:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555734528 00000100:00100000:1.0:1788530111.096428:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555734528 00000100:00100000:1.0:1788530111.096469:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788530111.096477:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+18:6521:x1875409555734528:12345-0@lo:502: 00000100:00100000:1.0:1788530111.096610:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+18:6521:x1875409555734528:12345-0@lo:502: Request processed in 134us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530111.096619:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788530111.101112:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555734528:0@lo:502: 00000040:00080000:0.0:1788530111.101208:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].47, 224 off16152 00000040:00080000:0.0:1788530111.101223:0:6521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000040:00080000:0.0:1788530111.108652:0:9884:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 48 count 48 00000020:01000000:0.0:1788530111.108807:0:6521:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1788530111.108822:0:6521:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788530111.108836:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f18140200/0xb28d70e125750425 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575042c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530111.108849:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f18140200/0xb28d70e125750425 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575042c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788530111.108861:0:6521:0:(mgc_request.c:715:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788530111.108864:0:6521:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-mdtir-ffff9a9f33b6f800 from 6 10000000:01000000:0.0:1788530111.108867:0:6521:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788530111.108912:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d101200/0xb28d70e125750433 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530111.108921:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f3d101200/0xb28d70e125750433 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530111.108933:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f3d101200/0xb28d70e125750433 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530111.108965:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555734656:0@lo:101: 00000100:00100000:0.0:1788530111.109071:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530111.109113:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f086db900 going to sleep for 11 seconds 00000100:00100000:1.0:1788530111.109273:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555734656 00000100:00100000:1.0:1788530111.109283:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555734656 00000100:00100000:1.0:1788530111.109345:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788530111.109354:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+18:6521:x1875409555734656:12345-0@lo:101: 00010000:00010000:1.0:1788530111.109367:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530111.109379:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9e025dd400/0xb28d70e12575043a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e125750433 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530111.109406:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9e025dd400/0xb28d70e12575043a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e125750433 expref: 19 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530111.109419:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9e025dd400/0xb28d70e12575043a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125750433 expref: 19 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530111.109430:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9e025dd400, rc 0) 00000100:00100000:1.0:1788530111.109492:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+19:6521:x1875409555734656:12345-0@lo:101: Request processed in 138us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530111.109498:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788530111.109885:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555734656:0@lo:101: 00010000:00010000:0.0:1788530111.109902:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f3d101200/0xb28d70e125750433 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575043a expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530111.109926:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f3d101200/0xb28d70e125750433 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e12575043a expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530111.109978:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555734784:0@lo:256: 00000100:00100000:0.0:1788530111.110016:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530111.110053:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f086db900 going to sleep for 11 seconds 00000100:00100000:1.0:1788530111.110098:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555734784 00000100:00100000:1.0:1788530111.110109:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555734784 00000100:00100000:1.0:1788530111.110146:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788530111.110154:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+19:6521:x1875409555734784:12345-0@lo:256: 20000000:01000000:1.0:1788530111.110171:0:6516:0:(mgs_nids.c:1159:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788530111.110191:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788530111.110194:0:6516:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1788530111.110291:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+19:6521:x1875409555734784:12345-0@lo:256: Request processed in 137us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530111.110299:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788530111.110482:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555734784:0@lo:256: 10000000:01000000:0.0:1788530111.110536:0:6521:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788530111.110546:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d101200/0xb28d70e125750433 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575043a expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530111.110555:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f3d101200/0xb28d70e125750433 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575043a expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788530111.110610:0:6521:0:(mgc_request.c:715:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1788530111.110613:0:6521:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1788530111.110618:0:6521:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788530111.110644:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d101400/0xb28d70e125750441 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530111.110652:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f3d101400/0xb28d70e125750441 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530111.110660:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f3d101400/0xb28d70e125750441 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530111.110673:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555734912:0@lo:101: 00000100:00100000:0.0:1788530111.110712:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530111.110737:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f086db900 going to sleep for 11 seconds 00000100:00100000:1.0:1788530111.110917:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555734912 00000100:00100000:1.0:1788530111.110922:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555734912 00000100:00100000:1.0:1788530111.110965:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788530111.110974:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+19:6521:x1875409555734912:12345-0@lo:101: 00010000:00010000:1.0:1788530111.110985:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530111.110999:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9e025dd200/0xb28d70e125750448 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e125750441 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530111.111019:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9e025dd200/0xb28d70e125750448 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e125750441 expref: 20 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530111.111029:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9e025dd200/0xb28d70e125750448 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125750441 expref: 20 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530111.111038:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9e025dd200, rc 0) 00000100:00100000:1.0:1788530111.111067:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+20:6521:x1875409555734912:12345-0@lo:101: Request processed in 94us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530111.111072:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788530111.111241:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555734912:0@lo:101: 00010000:00010000:0.0:1788530111.111253:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f3d101400/0xb28d70e125750441 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125750448 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530111.111271:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f3d101400/0xb28d70e125750441 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e125750448 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788530111.113433:0:6521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1788530111.113856:0:6521:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788530111.114090:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1788530111.114118:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 128 off8544 00000040:00080000:0.0:1788530111.114132:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 112 off8656 00000040:00080000:0.0:1788530111.114145:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].4, 224 off8880 00000040:00080000:0.0:1788530111.114158:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].5, 224 off9104 00000040:00080000:0.0:1788530111.114171:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].6, 80 off9184 00000040:00080000:0.0:1788530111.114189:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].7, 224 off9408 00000040:00080000:0.0:1788530111.114194:0:6521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1788530111.114291:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555735040:0@lo:501: 00000100:00100000:0.0:1788530111.114360:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530111.114405:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f086db900 going to sleep for 11 seconds 00000100:00100000:1.0:1788530111.114910:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555735040 00000100:00100000:1.0:1788530111.114919:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555735040 00000100:00100000:1.0:1788530111.114975:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788530111.114982:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+20:6521:x1875409555735040:12345-0@lo:501: 00000100:00100000:1.0:1788530111.115109:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+20:6521:x1875409555735040:12345-0@lo:501: Request processed in 127us (748us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530111.115116:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788530111.116661:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555735040:0@lo:501: 00000100:00100000:0.0:1788530111.116727:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555735168:0@lo:503: 00000100:00100000:0.0:1788530111.116991:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530111.117078:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f086db900 going to sleep for 11 seconds 00000100:00100000:1.0:1788530111.119070:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555735168 00000100:00100000:1.0:1788530111.119087:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555735168 00000100:00100000:1.0:1788530111.124454:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1788530111.124611:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+20:6521:x1875409555735168:12345-0@lo:503: 00000100:00100000:1.0:1788530111.124777:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+20:6521:x1875409555735168:12345-0@lo:503: Request processed in 172us (7786us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530111.124785:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788530111.130313:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555735168:0@lo:503: 00000040:00080000:0.0:1788530111.131986:0:6521:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788530111.132121:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555735296:0@lo:502: 00000100:00100000:0.0:1788530111.132215:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530111.132282:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f086db900 going to sleep for 11 seconds 00000100:00100000:2.0:1788530111.133900:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555735296 00000100:00100000:2.0:1788530111.133919:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555735296 00000100:00100000:2.0:1788530111.133998:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788530111.134011:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+20:6521:x1875409555735296:12345-0@lo:502: 00000100:00100000:2.0:1788530111.134186:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+20:6521:x1875409555735296:12345-0@lo:502: Request processed in 178us (1971us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530111.134195:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788530111.134444:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555735296:0@lo:502: 00000040:00080000:0.0:1788530111.134693:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1788530111.134721:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 00000040:00080000:0.0:1788530111.134733:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:0.0:1788530111.134746:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:0.0:1788530111.134757:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:0.0:1788530111.134770:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:0.0:1788530111.134783:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 00000040:00080000:0.0:1788530111.138095:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:0.0:1788530111.138124:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000100:00100000:0.0:1788530111.138181:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555735424:0@lo:502: 00000100:00100000:0.0:1788530111.138285:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530111.138330:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f086db900 going to sleep for 11 seconds 00000100:00100000:3.0:1788530111.138492:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555735424 00000100:00100000:3.0:1788530111.138500:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555735424 00000100:00100000:3.0:1788530111.138579:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788530111.138589:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+20:6521:x1875409555735424:12345-0@lo:502: 00000100:00100000:3.0:1788530111.138706:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+20:6521:x1875409555735424:12345-0@lo:502: Request processed in 117us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530111.138713:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788530111.139712:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555735424:0@lo:502: 00000040:00080000:0.0:1788530111.139815:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 00000040:00080000:0.0:1788530111.139831:0:6521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:2.0:1788530111.151365:0:9886:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788530111.151389:0:9886:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788530111.151392:0:9886:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788530111.151399:0:9886:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788530111.151401:0:9886:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788530111.151426:0:9886:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788530111.151429:0:9886:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788530111.151430:0:9886:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788530111.151433:0:9886:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:3.0:1788530111.151639:0:6521:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:3.0:1788530111.151655:0:6521:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788530111.151666:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d101400/0xb28d70e125750441 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125750448 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530111.151685:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f3d101400/0xb28d70e125750441 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125750448 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788530111.151696:0:6521:0:(mgc_request.c:715:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788530111.151699:0:6521:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-sptlrpc-ffff9a9f33b6f800 from 1 10000000:01000000:3.0:1788530111.151702:0:6521:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788530111.151740:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91c200/0xb28d70e12575044f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530111.151749:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91c200/0xb28d70e12575044f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530111.151760:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91c200/0xb28d70e12575044f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530111.151784:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0335b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555735552:0@lo:101: 00000100:00100000:3.0:1788530111.151861:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530111.161029:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f1f502900 going to sleep for 11 seconds 00000100:00100000:0.0:1788530111.161687:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555735552 00000100:00100000:0.0:1788530111.161697:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555735552 00000100:00100000:0.0:1788530111.162331:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788530111.162344:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+20:6521:x1875409555735552:12345-0@lo:101: 00010000:00010000:0.0:1788530111.162361:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530111.162449:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f3d100e00/0xb28d70e125750456 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e12575044f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530111.162480:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f3d100e00/0xb28d70e125750456 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e12575044f expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530111.162501:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f3d100e00/0xb28d70e125750456 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e12575044f expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530111.162510:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d100e00, rc 0) 00000100:00100000:0.0:1788530111.162630:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+21:6521:x1875409555735552:12345-0@lo:101: Request processed in 289us (10768us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530111.162637:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788530111.163006:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0335b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555735552:0@lo:101: 00010000:00010000:1.0:1788530111.163028:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91c200/0xb28d70e12575044f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125750456 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530111.163040:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91c200/0xb28d70e12575044f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e125750456 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530111.163158:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555735680:0@lo:501: 00000100:00100000:1.0:1788530111.163203:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530111.164109:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f32a49300 going to sleep for 11 seconds 00000100:00100000:3.0:1788530111.164178:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555735680 00000100:00100000:3.0:1788530111.164186:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555735680 00000100:00100000:2.0:1788530111.164483:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788530111.164493:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+21:6521:x1875409555735680:12345-0@lo:501: 00000100:00100000:2.0:1788530111.164637:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+21:6521:x1875409555735680:12345-0@lo:501: Request processed in 144us (1433us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788530111.164645:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788530111.165107:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555735680:0@lo:501: 10000000:01000000:1.0:1788530111.165129:0:6521:0:(mgc_request_server.c:748:mgc_llog_local_copy()) MGC192.168.202.141@tcp: no remote llog for lustre-sptlrpc, check MGS config 00000100:00100000:1.0:1788530111.165187:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555735808:0@lo:501: 00000100:00100000:1.0:1788530111.165220:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530111.165332:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f32a49300 going to sleep for 11 seconds 00000100:00100000:2.0:1788530111.165372:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555735808 00000100:00100000:2.0:1788530111.165377:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555735808 00000100:00100000:2.0:1788530111.165482:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788530111.165490:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+21:6521:x1875409555735808:12345-0@lo:501: 00000100:00100000:2.0:1788530111.165676:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+21:6521:x1875409555735808:12345-0@lo:501: Request processed in 186us (454us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788530111.165684:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788530111.169708:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555735808:0@lo:501: 10000000:01000000:1.0:1788530111.170016:0:6521:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788530111.170030:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91c200/0xb28d70e12575044f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125750456 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530111.170042:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91c200/0xb28d70e12575044f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125750456 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788530111.170054:0:6521:0:(mgc_request.c:715:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788530111.170057:0:6521:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-client-ffff9a9f32bea000 from 39 10000000:01000000:1.0:1788530111.170060:0:6521:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788530111.170099:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9e025dde00/0xb28d70e12575045d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530111.170106:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9e025dde00/0xb28d70e12575045d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530111.170118:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9e025dde00/0xb28d70e12575045d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530111.170140:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555735936:0@lo:101: 00000100:00100000:1.0:1788530111.170212:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530111.170309:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f32a493c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788530111.177515:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555735936 00000100:00100000:3.0:1788530111.177539:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555735936 00000100:00100000:0.0:1788530111.178744:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788530111.178759:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+21:6521:x1875409555735936:12345-0@lo:101: 00010000:00010000:0.0:1788530111.178780:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530111.179330:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f3d101000/0xb28d70e125750464 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e12575045d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530111.179364:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f3d101000/0xb28d70e125750464 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e12575045d expref: 22 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530111.179375:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f3d101000/0xb28d70e125750464 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e12575045d expref: 22 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530111.179454:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d101000, rc 0) 00000100:00100000:0.0:1788530111.179637:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+22:6521:x1875409555735936:12345-0@lo:101: Request processed in 879us (9423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530111.179644:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788530111.183929:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555735936:0@lo:101: 00010000:00010000:2.0:1788530111.183964:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9e025dde00/0xb28d70e12575045d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125750464 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530111.183978:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9e025dde00/0xb28d70e12575045d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e125750464 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788530111.184168:0:6521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 39 count 39 00000040:00080000:2.0:1788530111.185133:0:6521:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788530111.185988:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1788530111.186022:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 120 off8536 00000040:00080000:2.0:1788530111.186037:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 168 off8704 00000040:00080000:2.0:1788530111.186050:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8928 00000040:00080000:2.0:1788530111.186074:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9152 00000040:00080000:2.0:1788530111.186088:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9272 00000040:00080000:2.0:1788530111.186101:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 168 off9440 00000040:00080000:2.0:1788530111.186113:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 224 off9664 00000040:00080000:2.0:1788530111.186128:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:2.0:1788530111.186144:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 120 off10008 00000040:00080000:2.0:1788530111.186158:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 224 off10232 00000040:00080000:2.0:1788530111.186501:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10456 00000040:00080000:2.0:1788530111.186535:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 88 off10544 00000040:00080000:2.0:1788530111.186606:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 128 off10672 00000040:00080000:2.0:1788530111.186621:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 144 off10816 00000040:00080000:2.0:1788530111.186635:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 160 off10976 00000040:00080000:2.0:1788530111.186647:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 224 off11200 00000040:00080000:2.0:1788530111.186660:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11424 00000040:00080000:2.0:1788530111.186671:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 80 off11504 00000040:00080000:2.0:1788530111.186684:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 224 off11728 00000040:00080000:2.0:1788530111.186695:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11952 00000040:00080000:2.0:1788530111.186705:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 88 off12040 00000040:00080000:2.0:1788530111.186717:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 128 off12168 00000040:00080000:2.0:1788530111.186729:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 144 off12312 00000040:00080000:2.0:1788530111.186740:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 160 off12472 00000040:00080000:2.0:1788530111.186752:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 224 off12696 00000040:00080000:2.0:1788530111.186763:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 224 off12920 00000040:00080000:2.0:1788530111.186776:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 80 off13000 00000040:00080000:2.0:1788530111.186857:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 224 off13224 00000040:00080000:2.0:1788530111.186890:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13448 00000040:00080000:2.0:1788530111.186905:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 88 off13536 00000040:00080000:2.0:1788530111.186917:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 128 off13664 00000040:00080000:2.0:1788530111.186929:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 144 off13808 00000040:00080000:2.0:1788530111.186940:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 128 off13936 00000040:00080000:2.0:1788530111.186952:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 224 off14160 00000040:00080000:2.0:1788530111.186965:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 224 off14384 00000040:00080000:2.0:1788530111.186976:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 80 off14464 00000040:00080000:2.0:1788530111.187037:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 224 off14688 00000040:00080000:2.0:1788530111.187046:0:6521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 38 count 39 00000100:00100000:2.0:1788530111.187203:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0263f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555736064:0@lo:501: 00000100:00100000:2.0:1788530111.187535:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530111.187781:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e0244e3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788530111.188096:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555736064 00000100:00100000:1.0:1788530111.188104:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555736064 00000100:00100000:1.0:1788530111.188187:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788530111.188198:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+22:6521:x1875409555736064:12345-0@lo:501: 00000100:00100000:1.0:1788530111.188354:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+22:6521:x1875409555736064:12345-0@lo:501: Request processed in 157us (818us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530111.188361:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1788530111.188540:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0263f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555736064:0@lo:501: 00000100:00100000:3.0:1788530111.188607:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03359500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555736192:0@lo:503: 00000100:00100000:3.0:1788530111.188652:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530111.189321:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f1f502900 going to sleep for 11 seconds 00000100:00100000:1.0:1788530111.189513:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555736192 00000100:00100000:1.0:1788530111.189519:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555736192 00000100:00100000:1.0:1788530111.189556:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788530111.189587:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f396c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+22:6521:x1875409555736192:12345-0@lo:503: 00000100:00100000:1.0:1788530111.189698:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f396c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+22:6521:x1875409555736192:12345-0@lo:503: Request processed in 112us (1045us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530111.189707:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788530111.191956:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03359500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555736192:0@lo:503: 00000040:00080000:3.0:1788530111.193127:0:6521:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788530111.193231:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03359500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555736320:0@lo:502: 00000100:00100000:0.0:1788530111.194071:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530111.194148:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f061a2900 going to sleep for 11 seconds 00000100:00100000:3.0:1788530111.194536:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555736320 00000100:00100000:3.0:1788530111.194546:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555736320 00000100:00100000:3.0:1788530111.194636:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788530111.194647:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f396c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+22:6521:x1875409555736320:12345-0@lo:502: 00000100:00100000:3.0:1788530111.195555:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f396c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+22:6521:x1875409555736320:12345-0@lo:502: Request processed in 905us (1485us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530111.195586:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788530111.199708:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03359500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555736320:0@lo:502: 00000040:00080000:0.0:1788530111.200187:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:0.0:1788530111.200231:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 120 off8536 00000040:00080000:0.0:1788530111.200244:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 168 off8704 00000040:00080000:0.0:1788530111.201499:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8928 00000040:00080000:0.0:1788530111.201544:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9152 00000040:00080000:0.0:1788530111.201619:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9272 00000040:00080000:0.0:1788530111.201636:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 168 off9440 00000040:00080000:0.0:1788530111.201647:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 224 off9664 00000040:00080000:0.0:1788530111.201658:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:0.0:1788530111.201669:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 120 off10008 00000040:00080000:0.0:1788530111.201680:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 224 off10232 00000040:00080000:0.0:1788530111.201691:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10456 00000040:00080000:0.0:1788530111.201719:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 88 off10544 00000040:00080000:0.0:1788530111.201731:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 128 off10672 00000040:00080000:0.0:1788530111.201742:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 144 off10816 00000040:00080000:0.0:1788530111.201752:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 160 off10976 00000040:00080000:0.0:1788530111.201763:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 224 off11200 00000040:00080000:0.0:1788530111.201775:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11424 00000040:00080000:0.0:1788530111.202012:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 80 off11504 00000040:00080000:0.0:1788530111.202034:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 224 off11728 00000040:00080000:0.0:1788530111.202047:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11952 00000040:00080000:0.0:1788530111.202060:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 88 off12040 00000040:00080000:0.0:1788530111.202071:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 128 off12168 00000040:00080000:0.0:1788530111.202084:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 144 off12312 00000040:00080000:0.0:1788530111.202098:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 160 off12472 00000040:00080000:0.0:1788530111.202110:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 224 off12696 00000040:00080000:0.0:1788530111.202123:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 224 off12920 00000040:00080000:0.0:1788530111.202137:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 80 off13000 00000040:00080000:0.0:1788530111.202166:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 224 off13224 00000040:00080000:0.0:1788530111.202182:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13448 00000040:00080000:0.0:1788530111.202197:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 88 off13536 00000040:00080000:0.0:1788530111.202210:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 128 off13664 00000040:00080000:0.0:1788530111.202222:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 144 off13808 00000040:00080000:0.0:1788530111.202234:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 128 off13936 00000040:00080000:0.0:1788530111.202275:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 224 off14160 00000040:00080000:0.0:1788530111.202289:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 224 off14384 00000040:00080000:0.0:1788530111.202303:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 80 off14464 00000040:00080000:0.0:1788530111.202316:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 224 off14688 00000040:00080000:0.0:1788530111.202327:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14912 00000040:00080000:0.0:1788530111.202340:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 88 off15000 00000040:00080000:0.0:1788530111.202353:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 128 off15128 00000040:00080000:0.0:1788530111.202367:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 144 off15272 00000040:00080000:0.0:1788530111.202450:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 128 off15400 00000040:00080000:0.0:1788530111.202470:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 224 off15624 00000040:00080000:0.0:1788530111.202498:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off15848 00000040:00080000:0.0:1788530111.202515:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].46, 80 off15928 00000100:00100000:0.0:1788530111.202615:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555736448:0@lo:502: 00000100:00100000:0.0:1788530111.202700:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530111.202747:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f086db780 going to sleep for 11 seconds 00000100:00100000:1.0:1788530111.202852:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555736448 00000100:00100000:1.0:1788530111.202861:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555736448 00000100:00100000:1.0:1788530111.202909:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1788530111.202917:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f396c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+22:6521:x1875409555736448:12345-0@lo:502: 00000100:00100000:1.0:1788530111.203034:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f396c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+22:6521:x1875409555736448:12345-0@lo:502: Request processed in 117us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530111.203042:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788530111.203202:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555736448:0@lo:502: 00000040:00080000:0.0:1788530111.203248:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].47, 224 off16152 00000040:00080000:0.0:1788530111.203255:0:6521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000040:00080000:2.0:1788530111.207967:0:9890:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 48 count 48 00000020:01000000:3.0:1788530111.208173:0:6521:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:3.0:1788530111.208192:0:6521:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788530111.208208:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9e025dde00/0xb28d70e12575045d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125750464 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530111.208222:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9e025dde00/0xb28d70e12575045d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125750464 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788530111.208238:0:6521:0:(mgc_request.c:715:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788530111.208241:0:6521:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-mdtir-ffff9a9f32bea000 from 6 10000000:01000000:3.0:1788530111.208244:0:6521:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788530111.208482:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91ca00/0xb28d70e12575046b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530111.208493:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91ca00/0xb28d70e12575046b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530111.208507:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91ca00/0xb28d70e12575046b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530111.208585:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03359880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555736576:0@lo:101: 00000100:00100000:3.0:1788530111.208666:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530111.208708:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f061a2900 going to sleep for 11 seconds 00000100:00100000:2.0:1788530111.208939:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555736576 00000100:00100000:2.0:1788530111.208950:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555736576 00000100:00100000:2.0:1788530111.209017:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788530111.209028:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f396c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+22:6521:x1875409555736576:12345-0@lo:101: 00010000:00010000:2.0:1788530111.209046:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530111.209063:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f18141000/0xb28d70e125750472 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e12575046b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530111.209096:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f18141000/0xb28d70e125750472 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e12575046b expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530111.209109:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f18141000/0xb28d70e125750472 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e12575046b expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530111.209119:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f18141000, rc 0) 00000100:00100000:2.0:1788530111.209170:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f396c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+23:6521:x1875409555736576:12345-0@lo:101: Request processed in 143us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530111.209177:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788530111.209372:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03359880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555736576:0@lo:101: 00010000:00010000:3.0:1788530111.209457:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91ca00/0xb28d70e12575046b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125750472 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530111.209469:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91ca00/0xb28d70e12575046b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e125750472 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530111.209540:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03359880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555736704:0@lo:256: 00000100:00100000:0.0:1788530111.214061:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530111.214125:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f061a2900 going to sleep for 11 seconds 00000100:00100000:2.0:1788530111.214200:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555736704 00000100:00100000:2.0:1788530111.214212:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555736704 00000100:00100000:2.0:1788530111.214341:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788530111.214352:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f396c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+23:6521:x1875409555736704:12345-0@lo:256: 20000000:01000000:2.0:1788530111.214443:0:6516:0:(mgs_nids.c:1159:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788530111.214469:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788530111.214473:0:6516:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1788530111.214622:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f396c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+23:6521:x1875409555736704:12345-0@lo:256: Request processed in 272us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530111.214630:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1788530111.214734:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03359880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555736704:0@lo:256: 10000000:01000000:0.0:1788530111.215011:0:6521:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788530111.215025:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91ca00/0xb28d70e12575046b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125750472 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530111.215037:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91ca00/0xb28d70e12575046b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125750472 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788530111.215051:0:6521:0:(mgc_request.c:715:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1788530111.215054:0:6521:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:0.0:1788530111.215063:0:6521:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1788530111.215100:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d101a00/0xb28d70e125750479 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530111.215109:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f3d101a00/0xb28d70e125750479 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530111.215118:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f3d101a00/0xb28d70e125750479 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530111.215136:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555736832:0@lo:101: 00000100:00100000:0.0:1788530111.215173:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530111.215206:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f086db780 going to sleep for 11 seconds 00000100:00100000:1.0:1788530111.215496:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555736832 00000100:00100000:1.0:1788530111.215502:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555736832 00000100:00100000:1.0:1788530111.215595:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1788530111.215604:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f396c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+23:6521:x1875409555736832:12345-0@lo:101: 00010000:00010000:1.0:1788530111.215616:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530111.215631:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9e025dcc00/0xb28d70e125750480 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e125750479 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530111.215655:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9e025dcc00/0xb28d70e125750480 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e125750479 expref: 24 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530111.215666:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9e025dcc00/0xb28d70e125750480 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125750479 expref: 24 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530111.215675:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9e025dcc00, rc 0) 00000100:00100000:1.0:1788530111.215727:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f396c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+24:6521:x1875409555736832:12345-0@lo:101: Request processed in 124us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530111.215734:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788530111.215997:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555736832:0@lo:101: 00010000:00010000:0.0:1788530111.216013:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f3d101a00/0xb28d70e125750479 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125750480 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530111.216024:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f3d101a00/0xb28d70e125750479 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e125750480 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788530111.216216:0:6521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 34 count 34 00000040:00080000:1.0:1788530111.217962:0:6521:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788530111.218178:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:1.0:1788530111.218204:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 136 off8552 00000040:00080000:1.0:1788530111.218217:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 176 off8728 00000040:00080000:1.0:1788530111.218231:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8952 00000040:00080000:1.0:1788530111.221143:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9176 00000040:00080000:1.0:1788530111.221206:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9296 00000040:00080000:1.0:1788530111.221221:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 112 off9408 00000040:00080000:1.0:1788530111.221238:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 160 off9568 00000040:00080000:1.0:1788530111.221344:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9792 00000040:00080000:1.0:1788530111.221362:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10016 00000040:00080000:1.0:1788530111.221537:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 88 off10104 00000040:00080000:1.0:1788530111.221624:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 144 off10248 00000040:00080000:1.0:1788530111.221642:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 152 off10400 00000040:00080000:1.0:1788530111.221656:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 168 off10568 00000040:00080000:1.0:1788530111.221668:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 224 off10792 00000040:00080000:1.0:1788530111.221680:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 224 off11016 00000040:00080000:1.0:1788530111.221692:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 80 off11096 00000040:00080000:1.0:1788530111.221705:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11320 00000040:00080000:1.0:1788530111.221719:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 224 off11544 00000040:00080000:1.0:1788530111.221732:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 160 off11704 00000040:00080000:1.0:1788530111.221745:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11928 00000040:00080000:1.0:1788530111.221757:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 224 off12152 00000040:00080000:1.0:1788530111.221771:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 80 off12232 00000040:00080000:1.0:1788530111.221787:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 224 off12456 00000040:00080000:1.0:1788530111.221893:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 224 off12680 00000040:00080000:1.0:1788530111.221910:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 88 off12768 00000040:00080000:1.0:1788530111.221923:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 144 off12912 00000040:00080000:1.0:1788530111.221938:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 152 off13064 00000040:00080000:1.0:1788530111.221963:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 136 off13200 00000040:00080000:1.0:1788530111.221977:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13424 00000040:00080000:1.0:1788530111.221990:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 224 off13648 00000040:00080000:1.0:1788530111.222005:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 80 off13728 00000040:00080000:1.0:1788530111.222037:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 224 off13952 00000040:00080000:1.0:1788530111.222043:0:6521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 33 count 34 00000100:00100000:1.0:1788530111.222190:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555736960:0@lo:501: 00000100:00100000:1.0:1788530111.223532:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530111.223683:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f32a49540 going to sleep for 11 seconds 00000100:00100000:3.0:1788530111.229020:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555736960 00000100:00100000:3.0:1788530111.229049:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555736960 00000100:00100000:1.0:1788530111.229918:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1788530111.229933:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f396c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+24:6521:x1875409555736960:12345-0@lo:501: 00000100:00100000:1.0:1788530111.230370:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f396c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+24:6521:x1875409555736960:12345-0@lo:501: Request processed in 440us (6849us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530111.230402:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1788530111.233638:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555736960:0@lo:501: 00000100:00100000:3.0:1788530111.233708:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03359c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555737088:0@lo:503: 00000100:00100000:3.0:1788530111.233798:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530111.242198:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f04d82600 going to sleep for 11 seconds 00000100:00100000:2.0:1788530111.246707:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555737088 00000100:00100000:2.0:1788530111.246724:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555737088 00000100:00100000:2.0:1788530111.246832:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1788530111.246844:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f396c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+24:6521:x1875409555737088:12345-0@lo:503: 00000100:00100000:2.0:1788530111.247057:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f396c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+24:6521:x1875409555737088:12345-0@lo:503: Request processed in 215us (13269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530111.247068:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1788530111.247152:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03359c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555737088:0@lo:503: 00000040:00080000:2.0:1788530111.248193:0:6521:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788530111.248832:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0263c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555737216:0@lo:502: 00000100:00100000:2.0:1788530111.248917:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530111.248996:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e0244e600 going to sleep for 11 seconds 00000100:00100000:0.0:1788530111.249392:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555737216 00000100:00100000:0.0:1788530111.249400:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555737216 00000100:00100000:0.0:1788530111.249709:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1788530111.249733:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f396c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+24:6521:x1875409555737216:12345-0@lo:502: 00000100:00100000:0.0:1788530111.249966:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f396c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+24:6521:x1875409555737216:12345-0@lo:502: Request processed in 248us (1048us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530111.249975:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788530111.250195:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0263c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555737216:0@lo:502: 00000040:00080000:2.0:1788530111.250761:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:2.0:1788530111.250901:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 136 off8552 00000040:00080000:2.0:1788530111.250942:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 176 off8728 00000040:00080000:2.0:1788530111.250956:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8952 00000040:00080000:2.0:1788530111.250968:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9176 00000040:00080000:2.0:1788530111.250981:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9296 00000040:00080000:2.0:1788530111.250994:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 112 off9408 00000040:00080000:2.0:1788530111.251027:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 160 off9568 00000040:00080000:2.0:1788530111.251041:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9792 00000040:00080000:2.0:1788530111.251053:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10016 00000040:00080000:2.0:1788530111.251097:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 88 off10104 00000040:00080000:2.0:1788530111.251124:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 144 off10248 00000040:00080000:2.0:1788530111.251155:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 152 off10400 00000040:00080000:2.0:1788530111.251171:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 168 off10568 00000040:00080000:2.0:1788530111.251184:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 224 off10792 00000040:00080000:2.0:1788530111.251195:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 224 off11016 00000040:00080000:2.0:1788530111.251207:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 80 off11096 00000040:00080000:2.0:1788530111.251219:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11320 00000040:00080000:2.0:1788530111.251231:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 224 off11544 00000040:00080000:2.0:1788530111.251243:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 160 off11704 00000040:00080000:2.0:1788530111.252670:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11928 00000040:00080000:2.0:1788530111.252687:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 224 off12152 00000040:00080000:2.0:1788530111.252697:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 80 off12232 00000040:00080000:2.0:1788530111.252729:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 224 off12456 00000040:00080000:2.0:1788530111.252742:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 224 off12680 00000040:00080000:2.0:1788530111.252753:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 88 off12768 00000040:00080000:2.0:1788530111.252763:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 144 off12912 00000040:00080000:2.0:1788530111.252775:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 152 off13064 00000040:00080000:2.0:1788530111.252786:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 136 off13200 00000040:00080000:1.0:1788530111.255928:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13424 00000040:00080000:1.0:1788530111.255975:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 224 off13648 00000040:00080000:1.0:1788530111.255990:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 80 off13728 00000040:00080000:1.0:1788530111.256005:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 224 off13952 00000040:00080000:1.0:1788530111.256033:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 224 off14176 00000040:00080000:1.0:1788530111.256071:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 88 off14264 00000040:00080000:1.0:1788530111.256092:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 144 off14408 00000040:00080000:1.0:1788530111.256165:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 152 off14560 00000040:00080000:1.0:1788530111.256185:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 136 off14696 00000040:00080000:1.0:1788530111.256200:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14920 00000040:00080000:1.0:1788530111.256214:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 224 off15144 00000040:00080000:1.0:1788530111.256227:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 80 off15224 00000100:00100000:1.0:1788530111.257880:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555737344:0@lo:502: 00000100:00100000:1.0:1788530111.257974:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530111.258018:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555737344 00000100:00100000:1.0:1788530111.258031:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555737344 00000100:00100000:1.0:1788530111.258078:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1788530111.258089:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f396c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+24:6521:x1875409555737344:12345-0@lo:502: 00000100:00100000:1.0:1788530111.258213:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f396c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+24:6521:x1875409555737344:12345-0@lo:502: Request processed in 125us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530111.258220:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1788530111.259949:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f32a49300 going to sleep for 11 seconds 00000100:00100000:1.0:1788530111.260007:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555737344:0@lo:502: 00000040:00080000:1.0:1788530111.260142:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 224 off15448 00000040:00080000:1.0:1788530111.260162:0:6521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 42 count 43 00000020:01000000:2.0:1788530111.278719:0:9894:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788530111.278733:0:9894:0:(obd_mount.c:963:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1788530111.278740:0:9894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788530111.278742:0:9894:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788530111.278749:0:9894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788530111.278754:0:9894:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.141@tcp to nid 0x20000c0a8ca8d (192.168.202.141@tcp) 00000020:01000000:2.0:1788530111.278786:0:9894:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1788530111.278789:0:9894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788530111.278806:0:9894:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9a9f33d90000) 00000020:00000080:2.0:1788530111.278834:0:9894:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:2.0:1788530111.278840:0:9894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788530111.278955:0:9894:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:2.0:1788530111.278963:0:9894:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788530111.278974:0:9894:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb28d70e12575048e 00010000:00080000:2.0:1788530111.279017:0:9894:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a9f373f5000@lustre-OST0001-osc-MDT0001: add connection 192.168.202.141@tcp at head 00010000:00010000:2.0:1788530111.279258:0:9894:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:2.0:1788530111.279378:0:9894:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1788530111.279391:0:9894:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1788530111.279590:0:9894:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788530111.279719:0:9894:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788530111.279853:0:9894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1788530111.279947:0:9894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1788530111.287368:0:9896:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788530111.287376:0:9896:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788530111.288176:0:9894:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788530111.288193:0:9894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788530111.288246:0:9894:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788530111.288282:0:9894:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb28d70e125750495 00000100:00080000:2.0:1788530111.288297:0:9894:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788530111.288304:0:9894:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9a9f373f5000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:2.0:1788530111.288348:0:9894:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9e0263c000 x1875409555737472/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788530111.288388:0:9894:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788530111.288463:0:9894:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788530111.288468:0:9894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788530111.288470:0:9894:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788530111.288474:0:9894:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788530111.288478:0:9894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788530111.288480:0:9894:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788530111.288482:0:9894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788530111.288485:0:9894:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788530111.288511:0:9894:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788530111.288514:0:9894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788530111.288516:0:9894:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788530111.288534:0:9894:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 43 count 43 00000100:00100000:0.0:1788530111.288784:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0263c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875409555737472:0@lo:8: 00000100:00100000:0.0:1788530111.288864:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530111.289324:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555737472 00000100:00100000:3.0:1788530111.289333:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555737472 00000100:00100000:3.0:1788530111.289378:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788530111.289386:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3646:x1875409555737472:12345-0@lo:8: 00010000:00080000:3.0:1788530111.289415:0:8438:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 319 last 0 00000020:00000080:3.0:1788530111.289455:0:8438:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb28d70e12575049c 00002000:00100000:3.0:1788530111.289469:0:8438:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9a9e027ab800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a05 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1788530111.289483:0:8438:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:3.0:1788530111.289488:0:8438:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1788530111.289556:0:8438:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788530111.289817:0:8438:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:3.0:1788530111.289845:0:8438:0:(import.c:65:import_set_state_nolock()) ffff9a9e027af800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788530111.289903:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3646:x1875409555737472:12345-0@lo:8: Request processed in 516us (1039us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530111.289911:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1788530111.289959:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e0263c000 x1875409555737472/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788530121 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530111.289969:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788530111.289976:0:3646:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1788530111.289982:0:3646:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788530111.289987:0:3646:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788530111.289989:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9f373f5000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788530111.290000:0:3646:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788530111.290005:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0263c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875409555737472:0@lo:8: 00000100:00100000:3.0:1788530111.290363:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03358a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875409555737600:0@lo:400: 00000100:00100000:3.0:1788530111.290399:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530111.290422:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03359c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875409555738112:0@lo:400: 00000100:00100000:3.0:1788530111.290442:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530111.290458:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875409555738624:0@lo:400: 00000100:00100000:3.0:1788530111.290492:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530111.290517:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788530111.290533:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0335b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555737984:0@lo:400: 00000100:00100000:3.0:1788530111.290557:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530111.290602:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0335b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555738496:0@lo:400: 00000100:00100000:3.0:1788530111.290625:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530111.290652:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0335aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555737728:0@lo:400: 00000100:00100000:3.0:1788530111.290678:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530111.290698:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03359880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875409555738240:0@lo:400: 00000100:00100000:3.0:1788530111.290718:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530111.290735:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875409555738752:0@lo:400: 00000100:00100000:3.0:1788530111.290753:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530111.290765:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788530111.290770:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03358000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875409555737856:0@lo:400: 00000100:00100000:3.0:1788530111.290789:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530111.290799:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03359500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555738368:0@lo:400: 00000100:00100000:3.0:1788530111.290817:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530111.290851:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555737600 00000100:00100000:3.0:1788530111.290856:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555737600 00000100:00100000:3.0:1788530111.290902:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555738112 00000100:00100000:3.0:1788530111.290905:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555738112 00000100:00100000:3.0:1788530111.290926:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555738624 00000100:00100000:3.0:1788530111.290928:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555738624 00000100:00100000:3.0:1788530111.290938:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555738240 00000100:00100000:3.0:1788530111.290941:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555738240 00000100:00100000:3.0:1788530111.290952:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555738752 00000100:00100000:3.0:1788530111.290954:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555738752 00000100:00100000:3.0:1788530111.290964:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555737856 00000100:00100000:3.0:1788530111.290966:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555737856 00000100:00100000:3.0:1788530111.290978:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788530111.290986:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f328e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875409555737600:12345-0@lo:400: 00000100:00100000:3.0:1788530111.291032:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f328e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875409555737600:12345-0@lo:400: Request processed in 46us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530111.291046:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788530111.291063:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788530111.291069:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f328e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875409555738112:12345-0@lo:400: 00000100:00100000:3.0:1788530111.291096:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f328e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875409555738112:12345-0@lo:400: Request processed in 27us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530111.291102:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788530111.291112:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788530111.291118:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875409555738624:12345-0@lo:400: 00000100:00100000:3.0:1788530111.291143:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875409555738624:12345-0@lo:400: Request processed in 25us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530111.291148:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788530111.291157:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788530111.291163:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875409555738240:12345-0@lo:400: 00000100:00100000:3.0:1788530111.291191:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875409555738240:12345-0@lo:400: Request processed in 28us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530111.291196:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788530111.291206:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788530111.291212:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875409555738752:12345-0@lo:400: 00000100:00100000:3.0:1788530111.291235:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875409555738752:12345-0@lo:400: Request processed in 23us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530111.291240:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788530111.291251:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788530111.291256:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875409555737856:12345-0@lo:400: 00000100:00100000:3.0:1788530111.291296:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875409555737856:12345-0@lo:400: Request processed in 39us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530111.291311:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788530111.291343:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555737984 00000100:00100000:3.0:1788530111.291347:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555737984 00000100:00100000:3.0:1788530111.291365:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555737728 00000100:00100000:3.0:1788530111.291368:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555737728 00000100:00100000:3.0:1788530111.291380:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788530111.291386:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555737984:12345-0@lo:400: 00000100:00100000:3.0:1788530111.291418:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555737984:12345-0@lo:400: Request processed in 32us (860us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530111.291425:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788530111.291438:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788530111.291444:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555737728:12345-0@lo:400: 00000100:00100000:3.0:1788530111.291469:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555737728:12345-0@lo:400: Request processed in 26us (791us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530111.291475:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788530111.291493:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555738496 00000100:00100000:3.0:1788530111.291497:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555738496 00000100:00100000:3.0:1788530111.291520:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555738368 00000100:00100000:3.0:1788530111.291537:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555738368 00000100:00100000:3.0:1788530111.291554:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788530111.291590:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555738496:12345-0@lo:400: 00000100:00100000:3.0:1788530111.291622:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555738496:12345-0@lo:400: Request processed in 63us (997us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530111.291628:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788530111.291640:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788530111.291645:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555738368:12345-0@lo:400: 00000100:00100000:3.0:1788530111.291669:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555738368:12345-0@lo:400: Request processed in 25us (851us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530111.291682:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1788530111.291716:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788530111.291722:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788530111.291724:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788530111.291761:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0335b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555737984:0@lo:400: 00010000:00080000:3.0:1788530111.291780:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e0335b800 x1875409555738496/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788530127 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530111.291792:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0335b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555738496:0@lo:400: 00010000:00080000:3.0:1788530111.291803:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e03358a80 x1875409555737600/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530127 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530111.291811:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03358a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875409555737600:0@lo:400: 00010000:00080000:3.0:1788530111.291823:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e03359c00 x1875409555738112/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530127 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530111.291831:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03359c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875409555738112:0@lo:400: 00010000:00080000:3.0:1788530111.291842:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f328e5c00 x1875409555738624/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530127 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530111.291849:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875409555738624:0@lo:400: 00010000:00080000:3.0:1788530111.291904:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e03358000 x1875409555737856/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530127 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530111.291913:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03358000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875409555737856:0@lo:400: 00010000:00080000:3.0:1788530111.291923:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e03359500 x1875409555738368/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788530127 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530111.291930:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03359500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555738368:0@lo:400: 00000100:00100000:3.0:1788530111.291952:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0335aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555737728:0@lo:400: 00010000:00080000:3.0:1788530111.291964:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e03359880 x1875409555738240/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530127 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530111.291972:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03359880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875409555738240:0@lo:400: 00010000:00080000:3.0:1788530111.291984:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f328e7800 x1875409555738752/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530127 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530111.291992:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875409555738752:0@lo:400: 00000100:00100000:0.0:1788530111.292863:0:9897:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d8000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9897:1875409555738880:0@lo:700: 00000100:00100000:0.0:1788530111.292945:0:9897:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530111.292998:0:9897:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f061a2900 going to sleep for 11 seconds 00000020:01000000:1.0:1788530111.298029:0:6521:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:1.0:1788530111.298084:0:6521:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1788530111.298097:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d101a00/0xb28d70e125750479 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125750480 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530111.298109:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f3d101a00/0xb28d70e125750479 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125750480 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788530111.298122:0:6521:0:(mgc_request.c:715:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788530111.298125:0:6521:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-sptlrpc-ffff9a9f32bea000 from 1 10000000:01000000:1.0:1788530111.298128:0:6521:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788530111.298167:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9e025dce00/0xb28d70e1257504a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530111.298174:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9e025dce00/0xb28d70e1257504a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530111.298184:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9e025dce00/0xb28d70e1257504a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530111.298222:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555739008:0@lo:101: 00000100:00100000:1.0:1788530111.298297:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530111.298856:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f32a49300 going to sleep for 11 seconds 00000100:00100000:3.0:1788530111.302665:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555738880 00000100:00100000:3.0:1788530111.302681:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555738880 00000100:00100000:3.0:1788530111.302754:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788530111.302766:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9897:x1875409555738880:12345-0@lo:700: 00000100:00100000:3.0:1788530111.302835:0:8446:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2bbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8446:1875409555739136:0@lo:700: 00000100:00100000:3.0:1788530111.302919:0:8446:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530111.302956:0:8446:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f1f502900 going to sleep for 11 seconds 00000100:00080000:3.0:1788530111.302975:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788530111.302994:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555739136 00000100:00100000:3.0:1788530111.302998:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555739136 00000100:00100000:3.0:1788530111.303026:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788530111.303033:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8446:x1875409555739136:12345-0@lo:700: 00000004:00080000:3.0:1788530111.303898:0:9896:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788530111.303984:0:9896:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 319206422417ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788530111.303993:0:9896:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1788530111.304787:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555739008 00000100:00100000:0.0:1788530111.304804:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555739008 00000100:00100000:0.0:1788530111.304857:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1788530111.304866:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f396c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+24:6521:x1875409555739008:12345-0@lo:101: 00010000:00010000:0.0:1788530111.304881:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530111.304901:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f3d101800/0xb28d70e1257504aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e1257504a3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530111.304927:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f3d101800/0xb28d70e1257504aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e1257504a3 expref: 25 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530111.304937:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f3d101800/0xb28d70e1257504aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e1257504a3 expref: 25 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530111.304946:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d101800, rc 0) 00000100:00100000:0.0:1788530111.305020:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f396c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+25:6521:x1875409555739008:12345-0@lo:101: Request processed in 155us (6723us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530111.305026:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1788530111.305742:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555739008:0@lo:101: 00010000:00010000:0.0:1788530111.305770:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9e025dce00/0xb28d70e1257504a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257504aa expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530111.305785:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9e025dce00/0xb28d70e1257504a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e1257504aa expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530111.305931:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555739264:0@lo:501: 00000100:00100000:0.0:1788530111.305994:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530111.306046:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f06a6bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788530111.306101:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555739264 00000100:00100000:3.0:1788530111.306107:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555739264 00000100:00100000:3.0:1788530111.306156:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1788530111.306167:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f396c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+25:6521:x1875409555739264:12345-0@lo:501: 00000100:00100000:3.0:1788530111.306261:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f396c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+25:6521:x1875409555739264:12345-0@lo:501: Request processed in 94us (266us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788530111.306269:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1788530111.307237:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555739264:0@lo:501: 10000000:01000000:0.0:1788530111.307262:0:6521:0:(mgc_request_server.c:748:mgc_llog_local_copy()) MGC192.168.202.141@tcp: no remote llog for lustre-sptlrpc, check MGS config 00000100:00100000:0.0:1788530111.307320:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555739392:0@lo:501: 00000100:00100000:0.0:1788530111.307364:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530111.307402:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f06a6bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788530111.307484:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555739392 00000100:00100000:3.0:1788530111.307491:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555739392 00000100:00100000:3.0:1788530111.307867:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1788530111.307878:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f396c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+25:6521:x1875409555739392:12345-0@lo:501: 00000100:00100000:3.0:1788530111.307962:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f396c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+25:6521:x1875409555739392:12345-0@lo:501: Request processed in 86us (597us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788530111.307969:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1788530111.308112:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555739392:0@lo:501: 10000000:01000000:0.0:1788530111.308138:0:6521:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788530111.308151:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9e025dce00/0xb28d70e1257504a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257504aa expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530111.308163:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9e025dce00/0xb28d70e1257504a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257504aa expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788530111.308178:0:6521:0:(mgc_request.c:715:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788530111.308181:0:6521:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-client-ffff9a9f0aaed800 from 39 10000000:01000000:0.0:1788530111.308186:0:6521:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788530111.308224:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d100400/0xb28d70e1257504b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530111.308233:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f3d100400/0xb28d70e1257504b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530111.308244:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f3d100400/0xb28d70e1257504b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530111.308271:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555739520:0@lo:101: 00000100:00100000:0.0:1788530111.308303:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530111.308329:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f06a6bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788530111.308346:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555739520 00000100:00100000:0.0:1788530111.308350:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555739520 00000100:00100000:0.0:1788530111.308390:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1788530111.308397:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+25:6521:x1875409555739520:12345-0@lo:101: 00010000:00010000:0.0:1788530111.308406:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530111.308423:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f3d100000/0xb28d70e1257504b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e1257504b1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530111.308452:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f3d100000/0xb28d70e1257504b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e1257504b1 expref: 26 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530111.308466:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f3d100000/0xb28d70e1257504b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e1257504b1 expref: 26 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530111.308477:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d100000, rc 0) 00000100:00100000:0.0:1788530111.308506:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+26:6521:x1875409555739520:12345-0@lo:101: Request processed in 110us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530111.308695:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1788530111.308754:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555739520:0@lo:101: 00010000:00010000:0.0:1788530111.308769:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f3d100400/0xb28d70e1257504b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257504b8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530111.308780:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f3d100400/0xb28d70e1257504b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e1257504b8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530111.308825:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555739648:0@lo:501: 00000100:00100000:0.0:1788530111.308849:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530111.308870:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e033309c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788530111.308882:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555739648 00000100:00100000:0.0:1788530111.308886:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555739648 00000100:00100000:0.0:1788530111.308909:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1788530111.308917:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+26:6521:x1875409555739648:12345-0@lo:501: 00000100:00100000:0.0:1788530111.309056:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+26:6521:x1875409555739648:12345-0@lo:501: Request processed in 139us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530111.309064:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1788530111.309095:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555739648:0@lo:501: 00000100:00100000:0.0:1788530111.309121:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555739776:0@lo:503: 00000100:00100000:0.0:1788530111.309162:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530111.309175:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e033309c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788530111.309185:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555739776 00000100:00100000:0.0:1788530111.309188:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555739776 00000100:00100000:0.0:1788530111.309208:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1788530111.309213:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+26:6521:x1875409555739776:12345-0@lo:503: 00000100:00100000:0.0:1788530111.309292:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+26:6521:x1875409555739776:12345-0@lo:503: Request processed in 78us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530111.309300:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1788530111.309342:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555739776:0@lo:503: 00000100:00100000:0.0:1788530111.313120:0:9899:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:9899:1875409555739904:0@lo:502: 00000100:00100000:0.0:1788530111.313218:0:9899:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530111.313281:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555739904 00000100:00100000:0.0:1788530111.313288:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555739904 00000100:00100000:0.0:1788530111.313332:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1788530111.313341:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+26:9899:x1875409555739904:12345-0@lo:502: 00000100:00100000:0.0:1788530111.313495:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+26:9899:x1875409555739904:12345-0@lo:502: Request processed in 154us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530111.313504:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000004:00080000:3.0:1788530111.315132:0:7454:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 40000000:02000000:3.0:1788530111.317697:0:6530:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000100:00100000:3.0:1788530111.330550:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8446:x1875409555739136:12345-0@lo:700: Request processed in 27507us (27621us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530111.330593:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788530111.330657:0:8446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f3d2bbb80 x1875409555739136/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788530127 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530111.330676:0:8446:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2bbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8446:1875409555739136:0@lo:700: 40000000:02000000:3.0:1788530111.330693:0:8446:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000100:00100000:3.0:1788530111.338556:0:9899:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e03330540 going to sleep for 11 seconds 00000100:00100000:3.0:1788530111.338631:0:9899:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:9899:1875409555739904:0@lo:502: 00000100:00100000:3.0:1788530111.338718:0:9899:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2bbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:9899:1875409555740032:0@lo:502: 00000100:00100000:3.0:1788530111.338825:0:9899:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530111.338865:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555740032 00000100:00100000:3.0:1788530111.338872:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555740032 00000100:00100000:3.0:1788530111.338931:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1788530111.338940:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+26:9899:x1875409555740032:12345-0@lo:502: 00000100:00100000:3.0:1788530111.339080:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+26:9899:x1875409555740032:12345-0@lo:502: Request processed in 141us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530111.339089:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1788530111.339130:0:9899:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f08cd5900 going to sleep for 11 seconds 00000100:00100000:3.0:1788530111.339140:0:9899:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2bbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:9899:1875409555740032:0@lo:502: 00000040:00080000:3.0:1788530111.339159:0:9899:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1788530111.345533:0:6521:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1788530111.345557:0:6521:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788530111.345609:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d100400/0xb28d70e1257504b1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257504b8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530111.345623:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f3d100400/0xb28d70e1257504b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257504b8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788530111.345635:0:6521:0:(mgc_request.c:715:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788530111.345637:0:6521:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-mdtir-ffff9a9f0aaed800 from 6 10000000:01000000:2.0:1788530111.345640:0:6521:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788530111.345690:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f18141600/0xb28d70e1257504bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530111.345699:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f18141600/0xb28d70e1257504bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530111.345711:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f18141600/0xb28d70e1257504bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530111.345738:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0263c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555740160:0@lo:101: 00000100:00100000:2.0:1788530111.345808:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530111.345862:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e0244e600 going to sleep for 11 seconds 00000100:00100000:2.0:1788530111.345894:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555740160 00000100:00100000:2.0:1788530111.345904:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555740160 00000100:00100000:2.0:1788530111.345972:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1788530111.345983:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+26:6521:x1875409555740160:12345-0@lo:101: 00010000:00010000:2.0:1788530111.346007:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530111.346028:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f18141a00/0xb28d70e1257504c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e1257504bf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530111.346070:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f18141a00/0xb28d70e1257504c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e1257504bf expref: 27 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530111.346086:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f18141a00/0xb28d70e1257504c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e1257504bf expref: 27 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530111.346100:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f18141a00, rc 0) 00000100:00100000:2.0:1788530111.346152:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+27:6521:x1875409555740160:12345-0@lo:101: Request processed in 170us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530111.346160:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1788530111.346238:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0263c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555740160:0@lo:101: 00010000:00010000:2.0:1788530111.346257:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f18141600/0xb28d70e1257504bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257504c6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530111.346268:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f18141600/0xb28d70e1257504bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e1257504c6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:3.0:1788530111.346643:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1788530111.346718:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9897:x1875409555738880:12345-0@lo:700: Request processed in 43954us (53773us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530111.346728:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788530111.346752:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0263c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555740288:0@lo:256: 00000100:00100000:2.0:1788530111.346799:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530111.346816:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e0244e600 going to sleep for 11 seconds 00000100:00100000:2.0:1788530111.346830:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555740288 00000100:00100000:2.0:1788530111.346834:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555740288 00000100:00100000:2.0:1788530111.346859:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1788530111.346866:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+27:6521:x1875409555740288:12345-0@lo:256: 20000000:01000000:2.0:1788530111.346882:0:6517:0:(mgs_nids.c:1159:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788530111.346900:0:6517:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788530111.346903:0:6517:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1788530111.346988:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+27:6521:x1875409555740288:12345-0@lo:256: Request processed in 121us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530111.346995:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1788530111.347028:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0263c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555740288:0@lo:256: 10000000:01000000:2.0:1788530111.347076:0:6521:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788530111.347083:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f18141600/0xb28d70e1257504bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257504c6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530111.347092:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f18141600/0xb28d70e1257504bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257504c6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788530111.347101:0:6521:0:(mgc_request.c:715:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788530111.347104:0:6521:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1788530111.347106:0:6521:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788530111.347124:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f18140400/0xb28d70e1257504cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530111.347131:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f18140400/0xb28d70e1257504cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530111.347139:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f18140400/0xb28d70e1257504cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530111.347149:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0263c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555740416:0@lo:101: 00000100:00100000:2.0:1788530111.347172:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530111.347184:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e0244e600 going to sleep for 11 seconds 00000100:00100000:2.0:1788530111.347194:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555740416 00000100:00100000:2.0:1788530111.347197:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555740416 00000100:00100000:2.0:1788530111.347215:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1788530111.347220:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+27:6521:x1875409555740416:12345-0@lo:101: 00010000:00010000:2.0:1788530111.347234:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530111.347245:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f18140e00/0xb28d70e1257504d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e1257504cd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530111.347262:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f18140e00/0xb28d70e1257504d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e1257504cd expref: 28 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530111.347270:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f18140e00/0xb28d70e1257504d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e1257504cd expref: 28 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530111.347278:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f18140e00, rc 0) 00010000:00080000:0.0:1788530111.348594:0:9897:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e027d8000 x1875409555738880/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788530127 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530111.348597:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+28:6521:x1875409555740416:12345-0@lo:101: Request processed in 1374us (1421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530111.348606:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1788530111.348610:0:9897:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d8000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9897:1875409555738880:0@lo:700: 00000100:00100000:2.0:1788530111.348660:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0263c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555740416:0@lo:101: 00010000:00010000:2.0:1788530111.348682:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f18140400/0xb28d70e1257504cd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257504d4 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530111.348692:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f18140400/0xb28d70e1257504cd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e1257504d4 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530111.348729:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0263c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555740544:0@lo:501: 00000100:00100000:2.0:1788530111.348757:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530111.349064:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555740544 00000100:00100000:0.0:1788530111.349072:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555740544 00000100:00100000:0.0:1788530111.349113:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1788530111.349114:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e0244e600 going to sleep for 11 seconds 00000100:00100000:0.0:1788530111.349121:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+28:6521:x1875409555740544:12345-0@lo:501: 00000100:00100000:0.0:1788530111.349272:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+28:6521:x1875409555740544:12345-0@lo:501: Request processed in 151us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530111.349279:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1788530111.349434:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0263c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555740544:0@lo:501: 00000100:00100000:2.0:1788530111.350675:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0263c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555740672:0@lo:503: 00000100:00100000:2.0:1788530111.350740:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530111.350906:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e0244e600 going to sleep for 11 seconds 00000100:00100000:0.0:1788530111.351301:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555740672 00000100:00100000:0.0:1788530111.351309:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555740672 00000100:00100000:0.0:1788530111.351367:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1788530111.351377:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+28:6521:x1875409555740672:12345-0@lo:503: 00000100:00100000:0.0:1788530111.351548:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+28:6521:x1875409555740672:12345-0@lo:503: Request processed in 171us (807us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530111.351556:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1788530111.351645:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0263c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555740672:0@lo:503: 00000100:00100000:2.0:1788530111.354780:0:9902:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0263c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:9902:1875409555740800:0@lo:502: 00000100:00100000:2.0:1788530111.354930:0:9902:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530111.354996:0:9902:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e0244ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1788530111.355040:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555740800 00000100:00100000:0.0:1788530111.355061:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555740800 00000100:00100000:0.0:1788530111.355128:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1788530111.355149:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+28:9902:x1875409555740800:12345-0@lo:502: 00000100:00100000:0.0:1788530111.355366:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+28:9902:x1875409555740800:12345-0@lo:502: Request processed in 219us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530111.355376:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1788530111.355408:0:9902:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0263c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:9902:1875409555740800:0@lo:502: 00000020:01000000:2.0:1788530111.355445:0:9902:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788530111.355454:0:9902:0:(obd_mount.c:963:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1788530111.355477:0:9902:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788530111.355480:0:9902:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788530111.355486:0:9902:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788530111.355492:0:9902:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.141@tcp to nid 0x20000c0a8ca8d (192.168.202.141@tcp) 00000020:01000000:2.0:1788530111.355519:0:9902:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788530111.355530:0:9902:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788530111.355551:0:9902:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9a9f33d91988) 00000020:00000080:2.0:1788530111.355628:0:9902:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:2.0:1788530111.355637:0:9902:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788530111.355744:0:9902:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1788530111.355752:0:9902:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:2.0:1788530111.355761:0:9902:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb28d70e1257504e2 00010000:00080000:2.0:1788530111.355810:0:9902:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a9e010c4000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.141@tcp at head 00010000:00010000:2.0:1788530111.356136:0:9902:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:2.0:1788530111.358926:0:9902:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1788530111.358955:0:9902:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788530111.359175:0:9902:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788530111.360388:0:9902:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788530111.366790:0:9902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1788530111.367014:0:9902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000004:00080000:3.0:1788530111.369579:0:9897:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1788530111.369692:0:9897:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2ba680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9897:1875409555741056:0@lo:7: 00000100:00100000:3.0:1788530111.369758:0:9897:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530111.370005:0:9897:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f08cd59c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788530111.370024:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555740928:0@lo:13: 00000100:00100000:3.0:1788530111.370328:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530111.370377:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555741056 00000100:00100000:3.0:1788530111.370384:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555741056 00000100:00100000:3.0:1788530111.370433:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788530111.370444:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9897:x1875409555741056:12345-0@lo:7: 00000100:00100000:0.0:1788530111.376141:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555740928 00000100:00100000:0.0:1788530111.376163:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555740928 00000100:00100000:0.0:1788530111.376679:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788530111.376693:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3650:x1875409555740928:12345-0@lo:13: 00002000:00000024:0.0:1788530111.376731:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923927040 avail 3692404736 00000100:00100000:0.0:1788530111.377370:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3650:x1875409555740928:12345-0@lo:13: Request processed in 680us (7040us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530111.377379:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00002000:00080000:3.0:1788530111.389089:0:8752:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1788530111.389100:0:8752:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1788530111.389189:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9897:x1875409555741056:12345-0@lo:7: Request processed in 18743us (19427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530111.389213:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1788530111.389486:0:9897:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f3d2ba680 x1875409555741056/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788530127 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530111.389503:0:9897:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2ba680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9897:1875409555741056:0@lo:7: 00000004:00080000:3.0:1788530111.389520:0:9897:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1788530111.389627:0:9897:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2ba680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9897:1875409555741184:0@lo:5: 00000100:00100000:3.0:1788530111.389665:0:9897:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530111.389898:0:9897:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f08cd59c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788530111.390015:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555741184 00000100:00100000:3.0:1788530111.390022:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555741184 00000100:00100000:3.0:1788530111.390100:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788530111.390110:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9897:x1875409555741184:12345-0@lo:5: 00002000:00080000:3.0:1788530111.390134:0:8438:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:3.0:1788530111.390168:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9897:x1875409555741184:12345-0@lo:5: Request processed in 59us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530111.390175:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1788530111.390384:0:9897:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f3d2ba680 x1875409555741184/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788530127 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530111.390395:0:9897:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2ba680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9897:1875409555741184:0@lo:5: 00000004:00080000:3.0:1788530111.390404:0:9897:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00010000:00080000:2.0:1788530111.391123:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f3d2bbb80 x1875409555740928/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530127 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530111.391159:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555740928:0@lo:13: 00000040:00080000:0.0:1788530111.391923:0:9905:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788530111.391931:0:9905:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788530111.400496:0:9902:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788530111.400511:0:9902:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788530111.400587:0:9902:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788530111.400615:0:9902:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb28d70e1257504e9 00000100:00080000:0.0:1788530111.400626:0:9902:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788530111.400632:0:9902:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a9e010c4000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:0.0:1788530111.400668:0:9902:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9e027d8000 x1875409555741312/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788530111.400697:0:9902:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1788530111.400751:0:9902:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788530111.400755:0:9902:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788530111.400757:0:9902:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788530111.400760:0:9902:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788530111.400764:0:9902:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788530111.400774:0:9902:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788530111.400778:0:9902:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788530111.400779:0:9902:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788530111.401072:0:9902:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027daa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:9902:1875409555741440:0@lo:502: 00000100:00100000:0.0:1788530111.401150:0:9902:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530111.401189:0:9902:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e033306c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788530111.401298:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555741440 00000100:00100000:0.0:1788530111.401306:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555741440 00000100:00100000:0.0:1788530111.401348:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1788530111.401358:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+28:9902:x1875409555741440:12345-0@lo:502: 00000100:00100000:0.0:1788530111.401476:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+28:9902:x1875409555741440:12345-0@lo:502: Request processed in 119us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530111.401484:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1788530111.401549:0:9902:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027daa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:9902:1875409555741440:0@lo:502: 00000020:01000000:0.0:1788530111.401596:0:9902:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788530111.401601:0:9902:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788530111.401603:0:9902:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788530111.401606:0:9902:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000020:01000000:0.0:1788530111.401880:0:6521:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:0.0:1788530111.401891:0:6521:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788530111.401900:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f18140400/0xb28d70e1257504cd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257504d4 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530111.401985:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f18140400/0xb28d70e1257504cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257504d4 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788530111.401999:0:6521:0:(mgc_request.c:715:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788530111.402001:0:6521:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-sptlrpc-ffff9a9f0aaed800 from 1 10000000:01000000:0.0:1788530111.402005:0:6521:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788530111.402037:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d101c00/0xb28d70e1257504f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530111.402044:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f3d101c00/0xb28d70e1257504f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530111.402054:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f3d101c00/0xb28d70e1257504f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530111.402067:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027daa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555741568:0@lo:101: 00000100:00100000:0.0:1788530111.402098:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530111.402122:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e033306c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788530111.402135:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555741568 00000100:00100000:0.0:1788530111.402138:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555741568 00000100:00100000:0.0:1788530111.402164:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1788530111.402171:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+28:6521:x1875409555741568:12345-0@lo:101: 00010000:00010000:0.0:1788530111.402179:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530111.402191:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f3d100600/0xb28d70e1257504f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e1257504f0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530111.402372:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875409555741312:0@lo:8: 00000100:00100000:3.0:1788530111.402411:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530111.402445:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555741312 00000100:00100000:3.0:1788530111.402449:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555741312 00000100:00100000:3.0:1788530111.402471:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788530111.402477:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3646:x1875409555741312:12345-0@lo:8: 00010000:00080000:3.0:1788530111.402503:0:8439:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 319 last 0 00000020:00000080:3.0:1788530111.402550:0:8439:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb28d70e1257504fe 00002000:00100000:3.0:1788530111.402578:0:8439:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9a9e027ad800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a05 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1788530111.402583:0:8439:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1788530111.402586:0:8439:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788530111.402660:0:8439:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788530111.402694:0:8439:0:(import.c:65:import_set_state_nolock()) ffff9a9e027a8800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788530111.402736:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3646:x1875409555741312:12345-0@lo:8: Request processed in 258us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530111.402743:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1788530111.402778:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e027d8000 x1875409555741312/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788530121 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1788530111.403007:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f3d100600/0xb28d70e1257504f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e1257504f0 expref: 29 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530111.403018:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f3d100600/0xb28d70e1257504f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e1257504f0 expref: 29 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530111.403026:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d100600, rc 0) 00000100:00100000:0.0:1788530111.403054:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:6521:x1875409555741568:12345-0@lo:101: Request processed in 884us (955us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530111.403060:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1788530111.403104:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027daa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555741568:0@lo:101: 00010000:00010000:0.0:1788530111.403118:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f3d101c00/0xb28d70e1257504f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257504f7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530111.403127:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f3d101c00/0xb28d70e1257504f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e1257504f7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530111.403160:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027daa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555741696:0@lo:501: 00000100:00100000:0.0:1788530111.403182:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530111.403213:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e033306c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788530111.403226:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555741696 00000100:00100000:0.0:1788530111.403229:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555741696 00000100:00100000:3.0:1788530111.403317:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788530111.403326:0:3646:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788530111.403333:0:3646:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788530111.403339:0:3646:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788530111.403341:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9e010c4000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788530111.403359:0:3646:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788530111.403364:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875409555741312:0@lo:8: 00000004:00080000:1.0:1788530111.403617:0:9905:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788530111.404628:0:9905:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 319307065772ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788530111.404640:0:9905:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1788530111.405907:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1788530111.406134:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:6521:x1875409555741696:12345-0@lo:501: 00000100:00100000:1.0:1788530111.408067:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027daa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555741696:0@lo:501: 10000000:01000000:1.0:1788530111.408103:0:6521:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788530111.408115:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d101c00/0xb28d70e1257504f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257504f7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530111.408127:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f3d101c00/0xb28d70e1257504f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257504f7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530111.408338:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:6521:x1875409555741696:12345-0@lo:501: Request processed in 1127us (4059us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788530111.408350:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1788530111.409132:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555741824:0@lo:13: 00000100:00100000:3.0:1788530111.409223:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530111.409452:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555741824 00000100:00100000:1.0:1788530111.409471:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555741824 00000100:00100000:1.0:1788530111.409539:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788530111.409548:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1875409555741824:12345-0@lo:13: 00002000:00000024:1.0:1788530111.409623:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923927040 avail 3692404736 00000100:00100000:1.0:1788530111.414460:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1875409555741824:12345-0@lo:13: Request processed in 4903us (5228us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530111.414477:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1788530111.414536:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1788530111.416486:0:9907:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1788530111.416554:0:9907:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d5c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9907:1875409555741952:0@lo:7: 00000100:00100000:1.0:1788530111.416642:0:9907:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530111.416700:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555741952 00000100:00100000:1.0:1788530111.416707:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555741952 00000100:00100000:1.0:1788530111.416767:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788530111.416776:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:9907:x1875409555741952:12345-0@lo:7: 00010000:00080000:3.0:1788530111.418656:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f3d2b8000 x1875409555741824/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530127 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530111.418956:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555741824:0@lo:13: 00000004:00080000:3.0:1788530111.419181:0:6502:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00080000:1.0:1788530111.433955:0:8438:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1788530111.433971:0:8438:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1788530111.434840:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:9907:x1875409555741952:12345-0@lo:7: Request processed in 18059us (18192us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530111.434855:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788530111.435333:0:9907:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f32a49300 going to sleep for 11 seconds 00010000:00080000:1.0:1788530111.435369:0:9907:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e027d5c00 x1875409555741952/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788530127 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530111.436946:0:9907:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d5c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9907:1875409555741952:0@lo:7: 00000004:00080000:1.0:1788530111.436968:0:9907:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:1.0:1788530111.437027:0:9907:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d5c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9907:1875409555742080:0@lo:5: 00000100:00100000:1.0:1788530111.437094:0:9907:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530111.437151:0:9907:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f17d3e780 going to sleep for 11 seconds 00000100:00100000:3.0:1788530111.437299:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555742080 00000100:00100000:3.0:1788530111.437308:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555742080 00000100:00100000:3.0:1788530111.437376:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788530111.437392:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9907:x1875409555742080:12345-0@lo:5: 00002000:00080000:3.0:1788530111.437430:0:8439:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1788530111.437435:0:8439:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000001:00080000:0.0:1788530111.464066:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:0.0:1788530111.464095:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1788530111.465117:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:9907:x1875409555742080:12345-0@lo:5: Request processed in 27722us (28013us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788530111.465131:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1788530111.465410:0:9907:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e027d5c00 x1875409555742080/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788530127 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530111.465423:0:9907:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1788530111.465430:0:9907:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d5c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9907:1875409555742080:0@lo:5: 00000004:00080000:0.0:1788530111.465446:0:9907:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1788530111.465495:0:9907:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d9500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9907:1875409555742208:0@lo:700: 00000100:00100000:0.0:1788530111.465547:0:9907:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530111.465628:0:9907:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e033300c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788530111.465804:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555742208 00000100:00100000:1.0:1788530111.465812:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555742208 00000100:00100000:1.0:1788530111.465857:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788530111.465866:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9907:x1875409555742208:12345-0@lo:700: 00000100:00100000:3.0:1788530111.493007:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9907:x1875409555742208:12345-0@lo:700: Request processed in 27127us (27446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530111.493026:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788530111.493157:0:9907:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e027d9500 x1875409555742208/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788530127 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530111.493178:0:9907:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d9500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9907:1875409555742208:0@lo:700: 00000004:02000040:0.0:1788530111.496040:0:9907:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:1.0:1788530111.514607:0:9907:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d7800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9907:1875409555742336:0@lo:5: 00000100:00100000:1.0:1788530111.514694:0:9907:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530111.514770:0:9907:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f17d3e900 going to sleep for 11 seconds 00000100:00100000:3.0:1788530111.514811:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555742336 00000100:00100000:3.0:1788530111.514821:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555742336 00000100:00100000:3.0:1788530111.514880:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788530111.514890:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:9907:x1875409555742336:12345-0@lo:5: 00002000:00080000:3.0:1788530111.526447:0:8752:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:3.0:1788530111.526472:0:8752:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:1.0:1788530111.551929:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:9907:x1875409555742336:12345-0@lo:5: Request processed in 37030us (37227us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788530111.551947:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1788530111.552061:0:9907:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e027d7800 x1875409555742336/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788530127 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530111.552084:0:9907:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d7800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9907:1875409555742336:0@lo:5: 00000004:00080000:0.0:1788530111.552107:0:9907:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00000100:00100000:3.0:1788530111.555469:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788530111.555500:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555742464:0@lo:13: 00000100:00100000:3.0:1788530111.555593:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530111.556690:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555742464 00000100:00100000:2.0:1788530111.556705:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555742464 00000100:00100000:2.0:1788530111.556897:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788530111.556912:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555742464:12345-0@lo:13: 00002000:00000024:2.0:1788530111.556952:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788530111.557041:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555742464:12345-0@lo:13: Request processed in 133us (1448us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530111.557712:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555742592:0@lo:13: 00000100:00100000:0.0:1788530111.557767:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530111.561961:0:8440:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:3.0:1788530111.561985:0:8440:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:2.0:1788530111.562271:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788530111.562401:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555742592 00000100:00100000:2.0:1788530111.562410:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555742592 00000100:00100000:2.0:1788530111.562448:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788530111.562458:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555742592:12345-0@lo:13: 00002000:00000024:2.0:1788530111.562484:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788530111.562669:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555742592:12345-0@lo:13: Request processed in 209us (4898us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530111.562680:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1788530111.562741:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f3d2b8000 x1875409555742464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530127 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530111.562767:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555742464:0@lo:13: 00010000:00080000:0.0:1788530111.563987:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e027d9880 x1875409555742592/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530127 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530111.564025:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555742592:0@lo:13: 00010000:00010000:0.0:1788530111.682433:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788530112.299068:0:9943:0:(tgt_mount.c:2429:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788530112.299354:0:9943:0:(tgt_mount.c:2444:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788530112.576983:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555742720:0@lo:41: 00000100:00100000:3.0:1788530112.577076:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530112.577167:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555742720 00000100:00100000:3.0:1788530112.577176:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555742720 00000100:00100000:3.0:1788530112.577235:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788530112.577244:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555742720:12345-0@lo:41: 00000004:00000024:3.0:1788530112.577281:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446469632 avail 1300230144 00000100:00100000:3.0:1788530112.577332:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555742720:12345-0@lo:41: Request processed in 88us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530112.577339:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788530112.577403:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555742720:0@lo:41: 00010000:00010000:1.0:1788530112.706787:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788530113.557392:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:0.0:1788530113.729011:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530114.762314:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530115.779066:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788530115.876471:0:10044:0:(tgt_mount.c:2429:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788530115.878449:0:10044:0:(tgt_mount.c:2444:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788530116.168904:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555742848:0@lo:41: 00000100:00100000:2.0:1788530116.172325:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530116.181645:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555742848 00000100:00100000:2.0:1788530116.181690:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555742848 00000100:00100000:2.0:1788530116.182368:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788530116.182382:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0263c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555742848:12345-0@lo:41: 00000004:00000024:2.0:1788530116.182423:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1788530116.182538:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0263c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555742848:12345-0@lo:41: Request processed in 160us (10220us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530116.182545:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788530116.183259:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555742848:0@lo:41: 00000100:00100000:3.0:1788530116.676142:0:9897:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e7800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9897:1875409555743232:0@lo:5: 00000100:00100000:3.0:1788530116.676238:0:9897:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530116.676301:0:9897:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f32ae9840 going to sleep for 11 seconds 00000100:00100000:3.0:1788530116.676322:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555743104:0@lo:13: 00000100:00100000:3.0:1788530116.676364:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530116.676544:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555742976:0@lo:13: 00000100:00100000:2.0:1788530116.676600:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530116.676640:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555743104 00000100:00100000:2.0:1788530116.676648:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555743104 00000100:00100000:2.0:1788530116.676694:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555742976 00000100:00100000:2.0:1788530116.676698:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555742976 00000100:00100000:2.0:1788530116.676715:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788530116.676724:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03359880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555743104:12345-0@lo:13: 00002000:00000024:2.0:1788530116.676773:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788530116.676824:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03359880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555743104:12345-0@lo:13: Request processed in 101us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530116.676831:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788530116.676848:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788530116.676855:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0263ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555742976:12345-0@lo:13: 00002000:00000024:2.0:1788530116.676883:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788530116.676911:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0263ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555742976:12345-0@lo:13: Request processed in 56us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530116.676916:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1788530116.676969:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f3d2baa00 x1875409555742976/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530132 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530116.677009:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555742976:0@lo:13: 00010000:00080000:2.0:1788530116.677044:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f3d2bbb80 x1875409555743104/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530132 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530116.677056:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555743104:0@lo:13: 00000100:00100000:1.0:1788530116.677482:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555743232 00000100:00100000:1.0:1788530116.677488:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555743232 00000100:00100000:1.0:1788530116.677534:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788530116.677542:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f328e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9897:x1875409555743232:12345-0@lo:5: 00002000:00080000:1.0:1788530116.677598:0:8436:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:3.0:1788530116.677847:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555743360:0@lo:13: 00000100:00100000:3.0:1788530116.677909:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530116.678850:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555743360 00000100:00100000:2.0:1788530116.678857:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555743360 00000100:00100000:2.0:1788530116.678915:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788530116.678925:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0335aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555743360:12345-0@lo:13: 00002000:00000024:2.0:1788530116.679669:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 896 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788530116.679754:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0335aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555743360:12345-0@lo:13: Request processed in 830us (1843us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530116.679764:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1788530116.679906:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e027d6300 x1875409555743360/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530132 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530116.679919:0:3650:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1788530116.679954:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555743360:0@lo:13: 00000100:00100000:2.0:1788530116.680515:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788530116.683008:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03359500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555743488:0@lo:13: 00000100:00100000:2.0:1788530116.683087:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530116.683952:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555743488 00000100:00100000:0.0:1788530116.683970:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555743488 00000100:00100000:0.0:1788530116.684047:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788530116.684059:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0263df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555743488:12345-0@lo:13: 00002000:00000024:0.0:1788530116.684091:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788530116.684163:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0263df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555743488:12345-0@lo:13: Request processed in 107us (1076us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530116.684170:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788530116.684811:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f328e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:9897:x1875409555743232:12345-0@lo:5: Request processed in 7268us (8572us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788530116.684821:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1788530116.684852:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788530116.684857:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788530116.685970:0:9897:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f328e7800 x1875409555743232/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788530132 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530116.685994:0:9897:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e7800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9897:1875409555743232:0@lo:5: 00000004:00080000:0.0:1788530116.686010:0:9897:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1788530116.686060:0:9897:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d9880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9897:1875409555743616:0@lo:900: 00000100:00100000:0.0:1788530116.686110:0:9897:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530116.686146:0:9897:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e03330000 going to sleep for 11 seconds 00000100:00100000:3.0:1788530116.686255:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555743616 00000100:00100000:3.0:1788530116.686262:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555743616 00000100:00100000:3.0:1788530116.686313:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788530116.686322:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9897:x1875409555743616:12345-0@lo:900: 00000100:00100000:3.0:1788530116.686374:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9897:x1875409555743616:12345-0@lo:900: Request processed in 54us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530116.686381:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788530116.686413:0:9897:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e027d9880 x1875409555743616/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788530132 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530116.686422:0:9897:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d9880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9897:1875409555743616:0@lo:900: 00000100:00100000:3.0:1788530116.686873:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875409555744128:0@lo:400: 00000100:00100000:3.0:1788530116.686908:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530116.686941:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788530116.686959:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3647:1875409555743744:0@lo:400: 00000100:00100000:3.0:1788530116.686987:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530116.687010:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875409555744256:0@lo:400: 00000100:00100000:3.0:1788530116.687030:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530116.687057:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555744128 00000100:00100000:3.0:1788530116.687061:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555744128 00000100:00100000:3.0:1788530116.687114:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555744256 00000100:00100000:3.0:1788530116.687117:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555744256 00000100:00100000:3.0:1788530116.687135:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788530116.687142:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03358000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875409555744128:12345-0@lo:400: 00000100:00100000:3.0:1788530116.687177:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03358000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875409555744128:12345-0@lo:400: Request processed in 36us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530116.687185:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788530116.687197:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788530116.687203:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03359c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875409555744256:12345-0@lo:400: 00000100:00100000:3.0:1788530116.687227:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03359c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875409555744256:12345-0@lo:400: Request processed in 24us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530116.687232:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:3.0:1788530116.687256:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788530116.687261:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788530116.687295:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e027dad80 x1875409555744256/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530132 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530116.687307:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875409555744256:0@lo:400: 00010000:00080000:3.0:1788530116.687319:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e027d8380 x1875409555744128/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530132 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530116.687328:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875409555744128:0@lo:400: 00000100:00100000:3.0:1788530116.687359:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555744000:0@lo:400: 00000100:00100000:3.0:1788530116.687390:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530116.687412:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875409555744512:0@lo:400: 00000100:00100000:3.0:1788530116.687432:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530116.687448:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788530116.687454:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875409555743872:0@lo:400: 00000100:00100000:3.0:1788530116.687487:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530116.687502:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875409555744384:0@lo:400: 00000100:00100000:0.0:1788530116.687767:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555744512 00000100:00100000:0.0:1788530116.687772:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555744512 00000100:00100000:0.0:1788530116.687810:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555743872 00000100:00100000:0.0:1788530116.687812:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555743872 00000100:00100000:0.0:1788530116.687826:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788530116.687842:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0335b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875409555744512:12345-0@lo:400: 00000100:00100000:0.0:1788530116.687889:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0335b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875409555744512:12345-0@lo:400: Request processed in 48us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530116.687895:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788530116.687910:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788530116.687916:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0335b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875409555743872:12345-0@lo:400: 00000100:00100000:0.0:1788530116.687939:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0335b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875409555743872:12345-0@lo:400: Request processed in 24us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530116.687944:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788530116.687962:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555743744 00000100:00100000:0.0:1788530116.687965:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555743744 00000100:00100000:0.0:1788530116.687987:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1788530116.687992:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:3647:x1875409555743744:12345-0@lo:400: 00000100:00100000:0.0:1788530116.688021:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:3647:x1875409555743744:12345-0@lo:400: Request processed in 29us (1034us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530116.688026:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1788530116.688226:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788530116.690687:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e027d9f80 x1875409555744512/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530132 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530116.690706:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875409555744512:0@lo:400: 00000100:00100000:0.0:1788530116.691171:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555744384 00000100:00100000:0.0:1788530116.691179:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555744384 00000100:00100000:0.0:1788530116.691242:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788530116.691252:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875409555744384:12345-0@lo:400: 00000100:00100000:0.0:1788530116.691338:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875409555744384:12345-0@lo:400: Request processed in 87us (3111us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530116.691345:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:3.0:1788530116.691459:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e027d8000 x1875409555743872/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530132 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530116.691480:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875409555743872:0@lo:400: 00010000:00080000:3.0:1788530116.691498:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e027d8700 x1875409555744384/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530132 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530116.691505:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875409555744384:0@lo:400: 00000100:00080000:3.0:1788530116.691630:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788530116.691634:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788530116.691674:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3647:1875409555743744:0@lo:400: 00000100:00100000:2.0:1788530116.692985:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555744000 00000100:00100000:2.0:1788530116.692996:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555744000 00000100:00100000:2.0:1788530116.693050:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788530116.693058:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03358a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555744000:12345-0@lo:400: 00000100:00100000:2.0:1788530116.693144:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03358a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555744000:12345-0@lo:400: Request processed in 86us (5752us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530116.693150:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:2.0:1788530116.693197:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e03359500 x1875409555743488/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530132 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530116.693219:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03359500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555743488:0@lo:13: 00000100:00100000:1.0:1788530116.693963:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555744000:0@lo:400: 00010000:00010000:1.0:1788530116.804267:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788530117.180076:0:10092:0:(tgt_mount.c:2429:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788530117.180093:0:10092:0:(tgt_mount.c:2444:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:2.0:1788530117.697732:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555744640:0@lo:41: 00000100:00100000:2.0:1788530117.697817:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530117.698166:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555744640 00000100:00100000:3.0:1788530117.698175:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555744640 00000100:00100000:3.0:1788530117.698235:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788530117.698266:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0263d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555744640:12345-0@lo:41: 00000004:00000024:3.0:1788530117.698297:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446469632 avail 1300230144 00000100:00100000:3.0:1788530117.698345:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0263d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555744640:12345-0@lo:41: Request processed in 82us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530117.698352:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788530117.698527:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555744640:0@lo:41: 00010000:00010000:0.0:1788530117.825046:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788530117.979945:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530117.980073:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531568256 00000100:00100000:2.0:1788530117.980085:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531568256 00000100:00100000:2.0:1788530117.980148:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 207 00000100:00100000:2.0:1788530117.980159:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2398:x1875409531568256:12345-192.168.202.41@tcp:250: 00010000:00080000:2.0:1788530117.980187:0:6518:0:(ldlm_lib.c:1458:target_handle_connect()) MGS: connection from 6f442bcd-b742-4e76-ad7b-709f731358a0@192.168.202.41@tcp t0 exp 0000000000000000 cur 325 last 0 00000020:00000080:2.0:1788530117.980234:0:6518:0:(genops.c:1385:class_connect()) connect: client 6f442bcd-b742-4e76-ad7b-709f731358a0, cookie 0xb28d70e125750505 00000100:00080000:2.0:1788530117.980395:0:6518:0:(import.c:65:import_set_state_nolock()) ffff9a9e0242b800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788530117.980528:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f442bcd-b742-4e76-ad7b-709f731358a0+5:2398:x1875409531568256:12345-192.168.202.41@tcp:250: Request processed in 370us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530117.980542:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 207 00000100:00100000:3.0:1788530117.988471:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530117.989184:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531568384 00000100:00100000:0.0:1788530117.989196:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531568384 00000100:00100000:0.0:1788530117.989264:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 208 00000100:00100000:0.0:1788530117.989276:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f442bcd-b742-4e76-ad7b-709f731358a0+5:6163:x1875409531568384:12345-192.168.202.41@tcp:101: 00010000:00010000:0.0:1788530117.989299:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530117.989318:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f3d36b800/0xb28d70e12575050c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1406819a5506ea expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530117.989350:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f3d36b800/0xb28d70e12575050c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5506ea expref: 6 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530117.989368:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f3d36b800/0xb28d70e12575050c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5506ea expref: 6 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530117.989384:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d36b800, rc 0) 00000100:00100000:0.0:1788530117.989469:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f442bcd-b742-4e76-ad7b-709f731358a0+6:6163:x1875409531568384:12345-192.168.202.41@tcp:101: Request processed in 186us (1012us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530117.989477:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 208 00000100:00100000:1.0:1788530117.994694:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530117.995095:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531568512 00000100:00100000:0.0:1788530117.995107:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531568512 00000100:00100000:0.0:1788530117.995172:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 209 00000100:00100000:0.0:1788530117.995182:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f442bcd-b742-4e76-ad7b-709f731358a0+6:6163:x1875409531568512:12345-192.168.202.41@tcp:501: 00000100:00100000:0.0:1788530117.995331:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f442bcd-b742-4e76-ad7b-709f731358a0+6:6163:x1875409531568512:12345-192.168.202.41@tcp:501: Request processed in 149us (646us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788530117.995359:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 209 00000100:00100000:1.0:1788530118.003538:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530118.003658:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531568640 00000100:00100000:2.0:1788530118.003670:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531568640 00000100:00100000:2.0:1788530118.003746:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 210 00000100:00100000:2.0:1788530118.003758:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f442bcd-b742-4e76-ad7b-709f731358a0+6:6163:x1875409531568640:12345-192.168.202.41@tcp:101: 00010000:00010000:2.0:1788530118.003787:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530118.003814:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f18140800/0xb28d70e125750513 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1406819a5506f1 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530118.003853:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f18140800/0xb28d70e125750513 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5506f1 expref: 7 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530118.003866:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f18140800/0xb28d70e125750513 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5506f1 expref: 7 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530118.003900:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f18140800, rc 0) 00000100:00100000:2.0:1788530118.003982:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f442bcd-b742-4e76-ad7b-709f731358a0+7:6163:x1875409531568640:12345-192.168.202.41@tcp:101: Request processed in 226us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530118.003990:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 210 00000100:00100000:2.0:1788530118.010853:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530118.011008:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531568768 00000100:00100000:0.0:1788530118.011024:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531568768 00000100:00100000:0.0:1788530118.011110:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 211 00000100:00100000:0.0:1788530118.011125:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f442bcd-b742-4e76-ad7b-709f731358a0+7:6163:x1875409531568768:12345-192.168.202.41@tcp:501: 00000100:00100000:0.0:1788530118.011537:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f442bcd-b742-4e76-ad7b-709f731358a0+8:6163:x1875409531568768:12345-192.168.202.41@tcp:501: Request processed in 414us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530118.011545:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 211 00000100:00100000:1.0:1788530118.018888:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530118.021211:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531568896 00000100:00100000:0.0:1788530118.021237:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531568896 00000100:00100000:0.0:1788530118.021324:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 212 00000100:00100000:0.0:1788530118.021336:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f442bcd-b742-4e76-ad7b-709f731358a0+8:6163:x1875409531568896:12345-192.168.202.41@tcp:503: 00000100:00100000:0.0:1788530118.021517:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f442bcd-b742-4e76-ad7b-709f731358a0+8:6163:x1875409531568896:12345-192.168.202.41@tcp:503: Request processed in 183us (2638us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530118.021525:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 212 00000100:00100000:1.0:1788530118.026716:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530118.027089:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531569024 00000100:00100000:0.0:1788530118.027102:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531569024 00000100:00100000:0.0:1788530118.027221:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 213 00000100:00100000:0.0:1788530118.027242:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f442bcd-b742-4e76-ad7b-709f731358a0+8:6183:x1875409531569024:12345-192.168.202.41@tcp:502: 00000100:00100000:0.0:1788530118.027417:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f442bcd-b742-4e76-ad7b-709f731358a0+8:6183:x1875409531569024:12345-192.168.202.41@tcp:502: Request processed in 177us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530118.027425:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 213 00000100:00100000:1.0:1788530118.062024:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530118.062145:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531569152 00000100:00100000:2.0:1788530118.062157:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531569152 00000100:00100000:2.0:1788530118.062307:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 214 00000100:00100000:2.0:1788530118.062319:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f442bcd-b742-4e76-ad7b-709f731358a0+8:6183:x1875409531569152:12345-192.168.202.41@tcp:502: 00000100:00100000:2.0:1788530118.062539:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f442bcd-b742-4e76-ad7b-709f731358a0+8:6183:x1875409531569152:12345-192.168.202.41@tcp:502: Request processed in 222us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530118.062548:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 214 00000100:00100000:1.0:1788530118.075025:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530118.075370:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531569280 00000100:00100000:0.0:1788530118.075390:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531569280 00000100:00100000:0.0:1788530118.075478:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 215 00000100:00100000:0.0:1788530118.075519:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f442bcd-b742-4e76-ad7b-709f731358a0+8:6163:x1875409531569280:12345-192.168.202.41@tcp:101: 00010000:00010000:0.0:1788530118.075550:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530118.075627:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f3d36a400/0xb28d70e12575051a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1406819a550722 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530118.075675:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f3d36a400/0xb28d70e12575051a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550722 expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530118.075696:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f3d36a400/0xb28d70e12575051a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550722 expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530118.075712:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d36a400, rc 0) 00000100:00100000:0.0:1788530118.075798:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f442bcd-b742-4e76-ad7b-709f731358a0+9:6163:x1875409531569280:12345-192.168.202.41@tcp:101: Request processed in 286us (790us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530118.075808:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 215 00000100:00100000:1.0:1788530118.084645:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530118.089503:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531569408 00000100:00100000:0.0:1788530118.089524:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531569408 00000100:00100000:2.0:1788530118.090096:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 216 00000100:00100000:2.0:1788530118.090109:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f442bcd-b742-4e76-ad7b-709f731358a0+9:6163:x1875409531569408:12345-192.168.202.41@tcp:256: 20000000:01000000:2.0:1788530118.090150:0:6517:0:(mgs_nids.c:1159:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788530118.090180:0:6517:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788530118.090185:0:6517:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788530118.090190:0:6517:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788530118.090193:0:6517:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1788530118.090197:0:6517:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:2.0:1788530118.094078:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f442bcd-b742-4e76-ad7b-709f731358a0+9:6163:x1875409531569408:12345-192.168.202.41@tcp:256: Request processed in 3957us (9617us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530118.094097:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 216 00000100:00100000:1.0:1788530118.099826:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530118.100032:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531569536 00000100:00100000:2.0:1788530118.100042:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531569536 00000100:00100000:2.0:1788530118.100117:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 217 00000100:00100000:2.0:1788530118.100128:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f442bcd-b742-4e76-ad7b-709f731358a0+9:6163:x1875409531569536:12345-192.168.202.41@tcp:101: 00010000:00010000:2.0:1788530118.100146:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530118.100165:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f18141800/0xb28d70e125750521 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1406819a550729 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530118.100207:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f18141800/0xb28d70e125750521 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550729 expref: 10 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530118.100221:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f18141800/0xb28d70e125750521 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550729 expref: 10 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530118.100232:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f18141800, rc 0) 00000100:00100000:2.0:1788530118.100290:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f442bcd-b742-4e76-ad7b-709f731358a0+10:6163:x1875409531569536:12345-192.168.202.41@tcp:101: Request processed in 164us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530118.100297:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 217 00000100:00100000:1.0:1788530118.104668:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530118.104953:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531569664 00000100:00100000:2.0:1788530118.104965:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531569664 00000100:00100000:2.0:1788530118.105026:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 218 00000100:00100000:2.0:1788530118.105037:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f442bcd-b742-4e76-ad7b-709f731358a0+10:6163:x1875409531569664:12345-192.168.202.41@tcp:501: 00000100:00100000:2.0:1788530118.105318:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f442bcd-b742-4e76-ad7b-709f731358a0+10:6163:x1875409531569664:12345-192.168.202.41@tcp:501: Request processed in 282us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530118.105326:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 218 00000100:00100000:1.0:1788530118.112518:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530118.112646:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531569792 00000100:00100000:2.0:1788530118.112659:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531569792 00000100:00100000:2.0:1788530118.112788:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 219 00000100:00100000:2.0:1788530118.112799:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f442bcd-b742-4e76-ad7b-709f731358a0+10:6163:x1875409531569792:12345-192.168.202.41@tcp:503: 00000100:00100000:2.0:1788530118.113304:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f442bcd-b742-4e76-ad7b-709f731358a0+10:6163:x1875409531569792:12345-192.168.202.41@tcp:503: Request processed in 502us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530118.113312:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 219 00000100:00100000:1.0:1788530118.121074:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530118.121521:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531569920 00000100:00100000:0.0:1788530118.121535:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531569920 00000100:00100000:0.0:1788530118.121647:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 220 00000100:00100000:0.0:1788530118.121658:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f442bcd-b742-4e76-ad7b-709f731358a0+10:6187:x1875409531569920:12345-192.168.202.41@tcp:502: 00000100:00100000:0.0:1788530118.121838:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f442bcd-b742-4e76-ad7b-709f731358a0+10:6187:x1875409531569920:12345-192.168.202.41@tcp:502: Request processed in 180us (775us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530118.121846:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 220 00000100:00100000:1.0:1788530118.124883:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530118.124984:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531570048 00000100:00100000:2.0:1788530118.124994:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531570048 00000100:00100000:2.0:1788530118.125056:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 221 00000100:00100000:2.0:1788530118.125069:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f442bcd-b742-4e76-ad7b-709f731358a0+10:6187:x1875409531570048:12345-192.168.202.41@tcp:502: 00000100:00100000:2.0:1788530118.125264:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f442bcd-b742-4e76-ad7b-709f731358a0+10:6187:x1875409531570048:12345-192.168.202.41@tcp:502: Request processed in 198us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530118.125273:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 221 00000100:00100000:1.0:1788530118.129272:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530118.129328:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530118.129498:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531570176 00000100:00100000:0.0:1788530118.129513:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531570176 00000100:00100000:0.0:1788530118.129619:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531570432 00000100:00100000:0.0:1788530118.129623:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531570432 00000100:00100000:0.0:1788530118.129664:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 7 00000100:00100000:0.0:1788530118.129673:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2398:x1875409531570176:12345-192.168.202.41@tcp:38: 00010000:00080000:0.0:1788530118.129710:0:6523:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-MDT0000: connection from aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41@192.168.202.41@tcp t0 exp 0000000000000000 cur 326 last 0 00000020:00000080:0.0:1788530118.129778:0:6523:0:(genops.c:1385:class_connect()) connect: client aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41, cookie 0xb28d70e125750528 00000004:00100000:0.0:1788530118.129813:0:6523:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788530118.130071:0:6523:0:(import.c:65:import_set_state_nolock()) ffff9a9f373f7800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788530118.130157:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:2398:x1875409531570176:12345-192.168.202.41@tcp:38: Request processed in 483us (905us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530118.130166:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 7 00000100:00100000:0.0:1788530118.130188:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 8 00000100:00100000:0.0:1788530118.130194:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2398:x1875409531570432:12345-192.168.202.41@tcp:38: 00010000:00080000:0.0:1788530118.130210:0:6523:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-MDT0001: connection from aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41@192.168.202.41@tcp t0 exp 0000000000000000 cur 326 last 0 00000020:00000080:0.0:1788530118.130692:0:6523:0:(genops.c:1385:class_connect()) connect: client aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41, cookie 0xb28d70e12575052f 00000004:00100000:0.0:1788530118.130710:0:6523:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788530118.130899:0:6523:0:(import.c:65:import_set_state_nolock()) ffff9a9f373f2000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788530118.130940:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:2398:x1875409531570432:12345-192.168.202.41@tcp:38: Request processed in 745us (1612us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530118.130948:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 8 00010000:00010000:1.0:1788530118.857412:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788530119.142169:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530119.142208:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530119.142249:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530119.142333:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531570560 00000100:00100000:2.0:1788530119.142346:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531570560 00000100:00100000:2.0:1788530119.142437:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531570688 00000100:00100000:2.0:1788530119.142442:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531570688 00000100:00100000:2.0:1788530119.142477:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531570304 00000100:00100000:2.0:1788530119.142479:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531570304 00000100:00100000:2.0:1788530119.142494:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 9 00000100:00100000:2.0:1788530119.142504:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:0:x1875409531570560:12345-192.168.202.41@tcp:41: 00000004:00000024:2.0:1788530119.142541:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446469632 avail 1300230144 00000100:00100000:2.0:1788530119.142649:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:0:x1875409531570560:12345-192.168.202.41@tcp:41: Request processed in 145us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530119.142656:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 9 00000100:00100000:2.0:1788530119.142676:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 10 00000100:00100000:2.0:1788530119.142682:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+7:6163:x1875409531570688:12345-192.168.202.41@tcp:41: 00000004:00000024:2.0:1788530119.142701:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1788530119.142739:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+7:6163:x1875409531570688:12345-192.168.202.41@tcp:41: Request processed in 57us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530119.142764:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 10 00000100:00100000:2.0:1788530119.142779:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 11 00000100:00100000:2.0:1788530119.142787:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:0:x1875409531570304:12345-192.168.202.41@tcp:41: 00000004:00000024:2.0:1788530119.142799:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1788530119.142820:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:0:x1875409531570304:12345-192.168.202.41@tcp:41: Request processed in 35us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530119.142826:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 11 00000100:00080000:1.0:1788530119.143251:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788530119.143256:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788530119.151210:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530119.151365:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531570816 00000100:00100000:2.0:1788530119.151375:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531570816 00000100:00100000:2.0:1788530119.151462:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 12 00000100:00100000:2.0:1788530119.151473:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:6163:x1875409531570816:12345-192.168.202.41@tcp:40: 00000100:00100000:2.0:1788530119.151592:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:6163:x1875409531570816:12345-192.168.202.41@tcp:40: Request processed in 121us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530119.151614:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 12 00000100:00100000:3.0:1788530119.156487:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530119.157046:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531571328 00000100:00100000:2.0:1788530119.157059:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531571328 00000100:00100000:2.0:1788530119.157128:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 222 00000100:00100000:2.0:1788530119.157138:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f442bcd-b742-4e76-ad7b-709f731358a0+10:2402:x1875409531571328:12345-192.168.202.41@tcp:400: 00000100:00100000:2.0:1788530119.158398:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f442bcd-b742-4e76-ad7b-709f731358a0+10:2402:x1875409531571328:12345-192.168.202.41@tcp:400: Request processed in 1254us (1914us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530119.158409:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 222 00000100:00100000:3.0:1788530119.159498:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530119.159643:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530119.159857:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530119.159885:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531571200 00000100:00100000:3.0:1788530119.159893:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531571200 00000100:00100000:3.0:1788530119.159946:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 4 00000100:00100000:3.0:1788530119.159956:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:6163:x1875409531571200:12345-192.168.202.41@tcp:900: 00000100:00100000:3.0:1788530119.160034:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:6163:x1875409531571200:12345-192.168.202.41@tcp:900: Request processed in 79us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530119.160042:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 4 00000100:00100000:0.0:1788530119.163045:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531570944 00000100:00100000:0.0:1788530119.163066:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531570944 00000100:00100000:0.0:1788530119.163150:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531571072 00000100:00100000:0.0:1788530119.163155:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531571072 00000100:00100000:0.0:1788530119.163211:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 16 00000100:00100000:0.0:1788530119.163225:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2398:x1875409531570944:12345-192.168.202.41@tcp:8: 00010000:00080000:0.0:1788530119.163274:0:8752:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-OST0000: connection from aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41@192.168.202.41@tcp t0 exp 0000000000000000 cur 327 last 0 00000020:00000080:0.0:1788530119.163318:0:8752:0:(genops.c:1385:class_connect()) connect: client aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41, cookie 0xb28d70e125750536 00002000:00100000:0.0:1788530119.163357:0:8752:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41/ffff9a9f373f3000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a05 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788530119.163388:0:8752:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788530119.163697:0:8752:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788530119.164422:0:8752:0:(import.c:65:import_set_state_nolock()) ffff9a9f37410800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788530119.164552:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:2398:x1875409531570944:12345-192.168.202.41@tcp:8: Request processed in 1325us (5057us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530119.164619:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 16 00000100:00100000:0.0:1788530119.164660:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 17 00000100:00100000:0.0:1788530119.164668:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2398:x1875409531571072:12345-192.168.202.41@tcp:8: 00010000:00080000:0.0:1788530119.164700:0:8752:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-OST0001: connection from aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41@192.168.202.41@tcp t0 exp 0000000000000000 cur 327 last 0 00000020:00000080:0.0:1788530119.164937:0:8752:0:(genops.c:1385:class_connect()) connect: client aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41, cookie 0xb28d70e12575053d 00002000:00100000:0.0:1788530119.164949:0:8752:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41/ffff9a9f37415000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a05 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788530119.164967:0:8752:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788530119.165146:0:8752:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788530119.165169:0:8752:0:(import.c:65:import_set_state_nolock()) ffff9a9f37416000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788530119.165211:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:2398:x1875409531571072:12345-192.168.202.41@tcp:8: Request processed in 543us (5568us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530119.165219:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 17 00000100:00100000:0.0:1788530119.171875:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530119.172086:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531571456 00000100:00100000:1.0:1788530119.172101:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531571456 00000100:00100000:1.0:1788530119.172189:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 0 00000100:00100000:1.0:1788530119.172202:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:6163:x1875409531571456:12345-192.168.202.41@tcp:33: 00000004:00080000:1.0:1788530119.192723:0:6526:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 20386us 00000004:00200000:1.0:1788530119.234988:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1788530119.235146:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:6163:x1875409531571456:12345-192.168.202.41@tcp:33: Request processed in 62941us (63283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530119.235156:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 0 00000100:00100000:0.0:1788530119.440131:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530119.445924:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531571584 00000100:00100000:2.0:1788530119.445942:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531571584 00000100:00100000:2.0:1788530119.446068:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 13 00000100:00100000:2.0:1788530119.446083:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:6205:x1875409531571584:12345-192.168.202.41@tcp:101: 00010000:00010000:2.0:1788530119.446122:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530119.446519:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140a00/0xb28d70e125750544 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a55075a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530119.446645:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140000/0xb28d70e12575054b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530119.446663:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140000/0xb28d70e12575054b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530119.446681:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140000/0xb28d70e12575054b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788530119.446755:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788530119.446759:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788530119.446778:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140000/0xb28d70e12575054b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530119.446810:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140a00/0xb28d70e125750544 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a55075a expref: 8 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530119.446833:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140000/0xb28d70e12575054b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a55075a expref: 7 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530119.446844:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a9f2b994f00) 00010000:00010000:2.0:1788530119.446847:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788530119.446851:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f18140000, rc 0) 00000100:00100000:2.0:1788530119.446954:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+7:6205:x1875409531571584:12345-192.168.202.41@tcp:101: Request processed in 874us (6836us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530119.446963:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 13 00010000:00010000:0.0:1788530119.876025:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530120.897804:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788530121.281551:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555744768:0@lo:41: 00000100:00100000:2.0:1788530121.281669:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530121.282013:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555744768 00000100:00100000:3.0:1788530121.282023:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555744768 00000100:00100000:3.0:1788530121.282084:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788530121.282094:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0263f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555744768:12345-0@lo:41: 00000004:00000024:3.0:1788530121.282134:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1788530121.282396:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0263f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555744768:12345-0@lo:41: Request processed in 302us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530121.282404:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788530121.284680:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555744768:0@lo:41: 00000100:00100000:1.0:1788530121.792895:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0263c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555744896:0@lo:13: 00000100:00100000:1.0:1788530121.792990:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530121.793151:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555744896 00000100:00100000:2.0:1788530121.793163:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555744896 00000100:00100000:2.0:1788530121.793236:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788530121.793250:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3649:x1875409555744896:12345-0@lo:13: 00000100:00100000:3.0:1788530121.793257:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555745024:0@lo:13: 00002000:00000024:2.0:1788530121.793284:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1788530121.793379:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788530121.793419:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555745152:0@lo:13: 00000100:00100000:0.0:1788530121.793654:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555745280:0@lo:13: 00000100:00100000:3.0:1788530121.796403:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530121.796633:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3649:x1875409555744896:12345-0@lo:13: Request processed in 3384us (3639us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530121.796650:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788530121.796691:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555745024 00000100:00100000:2.0:1788530121.796702:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555745024 00000100:00100000:2.0:1788530121.796787:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788530121.796817:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555745024:12345-0@lo:13: 00002000:00000024:2.0:1788530121.796859:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788530121.796915:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555745024:12345-0@lo:13: Request processed in 104us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530121.796921:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:2.0:1788530121.796990:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788530121.797003:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875409555745536:0@lo:400: 00000100:00100000:2.0:1788530121.797011:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3649:1875409555745408:0@lo:400: 00000100:00100000:3.0:1788530121.797058:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530121.797084:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875409555746048:0@lo:400: 00000100:00100000:3.0:1788530121.797108:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530121.797131:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37366d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875409555746560:0@lo:400: 00000100:00100000:3.0:1788530121.797159:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788530121.797288:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f3d2a1c00 x1875409555745024/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530137 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530121.797306:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530121.797316:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555745024:0@lo:13: 00000100:00100000:2.0:1788530121.797341:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875409555745920:0@lo:400: 00000100:00100000:3.0:1788530121.797352:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555745536 00000100:00100000:3.0:1788530121.797356:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555745536 00000100:00100000:2.0:1788530121.797365:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530121.797384:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875409555746432:0@lo:400: 00000100:00100000:3.0:1788530121.797400:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555746048 00000100:00100000:3.0:1788530121.797403:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555746048 00000100:00100000:2.0:1788530121.797410:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530121.797436:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555746560 00000100:00100000:3.0:1788530121.797439:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555746560 00010000:00080000:2.0:1788530121.797448:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e0263c000 x1875409555744896/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530137 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530121.797453:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555745920 00000100:00100000:3.0:1788530121.797468:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555745920 00000100:00100000:2.0:1788530121.797480:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0263c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555744896:0@lo:13: 00000100:00100000:3.0:1788530121.797482:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555746432 00000100:00100000:3.0:1788530121.797484:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555746432 00000100:00100000:3.0:1788530121.797495:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788530121.797501:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875409555745536:12345-0@lo:400: 00000100:00100000:2.0:1788530121.797527:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788530121.797536:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875409555746048:12345-0@lo:400: 00000100:00100000:3.0:1788530121.797540:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875409555745536:12345-0@lo:400: Request processed in 39us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530121.797545:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788530121.797577:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788530121.797585:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875409555746560:12345-0@lo:400: 00000100:00100000:2.0:1788530121.797586:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875409555746048:12345-0@lo:400: Request processed in 53us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530121.797591:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788530121.797605:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788530121.797609:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875409555746560:12345-0@lo:400: Request processed in 26us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530121.797611:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0263f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875409555745920:12345-0@lo:400: 00000100:00100000:3.0:1788530121.797621:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788530121.797633:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788530121.797640:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0263dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875409555746432:12345-0@lo:400: 00000100:00100000:2.0:1788530121.797640:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0263f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875409555745920:12345-0@lo:400: Request processed in 29us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530121.797645:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788530121.797666:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0263dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875409555746432:12345-0@lo:400: Request processed in 27us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530121.797670:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875409555745920:0@lo:400: 00000100:00100000:3.0:1788530121.797672:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788530121.797679:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875409555746432:0@lo:400: 00000100:00080000:3.0:1788530121.797686:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788530121.797737:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875409555745536:0@lo:400: 00010000:00080000:2.0:1788530121.797747:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e027d9f80 x1875409555746048/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530137 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530121.797755:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875409555746048:0@lo:400: 00010000:00080000:2.0:1788530121.797768:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f37366d80 x1875409555746560/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530137 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530121.797777:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37366d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875409555746560:0@lo:400: 00000100:00100000:2.0:1788530121.797815:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555745408 00000100:00100000:2.0:1788530121.797819:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555745408 00000100:00100000:2.0:1788530121.797857:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1788530121.797864:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:3649:x1875409555745408:12345-0@lo:400: 00000100:00080000:3.0:1788530121.797893:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788530121.797898:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:3649:x1875409555745408:12345-0@lo:400: Request processed in 36us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530121.797905:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1788530121.797925:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3649:1875409555745408:0@lo:400: 00000100:00100000:1.0:1788530121.798329:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530121.798386:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875409555745664:0@lo:400: 00000100:00100000:1.0:1788530121.798417:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530121.798456:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555746176:0@lo:400: 00000100:00100000:1.0:1788530121.798488:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530121.798514:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555746176 00000100:00100000:1.0:1788530121.798518:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555746176 00000100:00100000:1.0:1788530121.798550:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788530121.798558:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555746176:12345-0@lo:400: 00000100:00100000:1.0:1788530121.798610:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555746176:12345-0@lo:400: Request processed in 53us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530121.798617:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1788530121.798647:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e027d8380 x1875409555746176/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788530137 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530121.798658:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555746176:0@lo:400: 00000100:00100000:1.0:1788530121.798665:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37365f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555746688:0@lo:400: 00000100:00100000:1.0:1788530121.798689:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530121.798711:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555746688 00000100:00100000:1.0:1788530121.798714:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555746688 00000100:00100000:1.0:1788530121.798746:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788530121.798752:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555746688:12345-0@lo:400: 00000100:00100000:1.0:1788530121.798782:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555746688:12345-0@lo:400: Request processed in 30us (93us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530121.798875:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1788530121.798893:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788530121.798911:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f37365f80 x1875409555746688/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788530137 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530121.798920:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37365f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555746688:0@lo:400: 00000100:00100000:2.0:1788530121.801419:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555745152 00000100:00100000:2.0:1788530121.801448:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555745152 00000100:00100000:2.0:1788530121.801541:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788530121.801553:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555745152:12345-0@lo:13: 00002000:00000024:2.0:1788530121.801614:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788530121.801757:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555745152:12345-0@lo:13: Request processed in 186us (3407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530121.801766:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:1.0:1788530121.804093:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e027d4000 x1875409555745152/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530137 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530121.804266:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555745152:0@lo:13: 00000100:00100000:3.0:1788530121.806172:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555745664 00000100:00100000:3.0:1788530121.806201:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555745664 00000100:00100000:3.0:1788530121.806304:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788530121.806316:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875409555745664:12345-0@lo:400: 00000100:00100000:3.0:1788530121.806444:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875409555745664:12345-0@lo:400: Request processed in 130us (8025us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530121.806452:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788530121.807290:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875409555745664:0@lo:400: 00000100:00100000:0.0:1788530121.809405:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530121.809973:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555745792:0@lo:400: 00000100:00100000:0.0:1788530121.810034:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530121.810069:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555746304:0@lo:400: 00000100:00100000:0.0:1788530121.810099:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530121.810328:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555745280 00000100:00100000:2.0:1788530121.810341:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555745280 00000100:00100000:2.0:1788530121.810440:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788530121.810451:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37364700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555745280:12345-0@lo:13: 00002000:00000024:2.0:1788530121.810488:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788530121.810542:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37364700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555745280:12345-0@lo:13: Request processed in 93us (1149us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530121.810550:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:2.0:1788530121.810600:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788530121.811140:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e027dbb80 x1875409555745280/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530137 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530121.811169:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555745280:0@lo:13: 00000100:00100000:1.0:1788530121.811319:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555746304 00000100:00100000:1.0:1788530121.811327:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555746304 00000100:00100000:1.0:1788530121.811392:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788530121.811401:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37367480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555746304:12345-0@lo:400: 00000100:00100000:1.0:1788530121.811484:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37367480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555746304:12345-0@lo:400: Request processed in 85us (1383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530121.811492:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1788530121.811651:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e027dad80 x1875409555746304/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788530137 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530121.811660:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555746304:0@lo:400: 00000100:00100000:3.0:1788530121.811905:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555745792 00000100:00100000:3.0:1788530121.811911:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555745792 00000100:00100000:3.0:1788530121.811952:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788530121.811960:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37364000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555745792:12345-0@lo:400: 00000100:00100000:3.0:1788530121.812023:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37364000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555745792:12345-0@lo:400: Request processed in 64us (1988us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530121.812030:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788530121.812185:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555745792:0@lo:400: 00010000:00010000:0.0:1788530121.922528:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788530122.314998:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41 00000001:00080000:0.0:1788530122.315030:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:1.0:1788530122.411904:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530122.412388:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531571712 00000100:00100000:2.0:1788530122.412398:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531571712 00000100:00100000:2.0:1788530122.412539:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 14 00000100:00100000:2.0:1788530122.412552:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+7:6257:x1875409531571712:12345-192.168.202.41@tcp:41: 00000004:00000024:2.0:1788530122.412630:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1788530122.412727:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+7:6257:x1875409531571712:12345-192.168.202.41@tcp:41: Request processed in 178us (836us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530122.412736:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 14 00000100:00100000:0.0:1788530122.422882:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530122.423112:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531571840 00000100:00100000:3.0:1788530122.423123:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531571840 00000100:00080000:1.0:1788530122.423578:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788530122.423585:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788530122.427872:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 15 00000100:00100000:3.0:1788530122.427900:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37365c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:6257:x1875409531571840:12345-192.168.202.41@tcp:41: 00000004:00000024:3.0:1788530122.428109:0:8678:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446469632 avail 1300230144 00000100:00100000:3.0:1788530122.428325:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37365c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:6257:x1875409531571840:12345-192.168.202.41@tcp:41: Request processed in 437us (5456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530122.428333:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 15 00000100:00100000:0.0:1788530122.432550:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530122.433095:0:9912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531571968 00000100:00100000:3.0:1788530122.433111:0:9912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531571968 00000100:00100000:3.0:1788530122.433195:0:9912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 24 00000100:00100000:3.0:1788530122.433206:0:9912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37366a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:6257:x1875409531571968:12345-192.168.202.41@tcp:13: 00002000:00000024:3.0:1788530122.433232:0:9912:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788530122.433299:0:9912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37366a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:6257:x1875409531571968:12345-192.168.202.41@tcp:13: Request processed in 94us (759us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530122.433307:0:9912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 24 00000100:00080000:1.0:1788530122.434465:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788530122.440210:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530122.440364:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531572096 00000100:00100000:2.0:1788530122.440378:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531572096 00000100:00100000:2.0:1788530122.440467:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 25 00000100:00100000:2.0:1788530122.440482:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37365500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:6257:x1875409531572096:12345-192.168.202.41@tcp:13: 00002000:00000024:2.0:1788530122.440513:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788530122.440630:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37365500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:6257:x1875409531572096:12345-192.168.202.41@tcp:13: Request processed in 153us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530122.440637:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 25 00000100:00080000:1.0:1788530122.440713:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788530122.817147:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555746816:0@lo:41: 00000100:00100000:1.0:1788530122.817244:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530122.817398:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555746816 00000100:00100000:3.0:1788530122.817410:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555746816 00000100:00100000:3.0:1788530122.817485:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788530122.817498:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555746816:12345-0@lo:41: 00000004:00000024:3.0:1788530122.817532:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446469632 avail 1300230144 00000100:00100000:3.0:1788530122.817627:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555746816:12345-0@lo:41: Request processed in 132us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530122.817636:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788530122.817898:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555746816:0@lo:41: 00010000:00010000:1.0:1788530122.946915:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788530123.848250:0:6502:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41 00000001:00100000:2.0:1788530123.854644:0:7454:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41 00010000:00010000:0.0:1788530123.969816:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788530124.284006:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530124.284049:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530124.284082:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530124.284120:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530124.284150:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530124.284180:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531572352 00000100:00100000:0.0:1788530124.284190:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531572352 00000100:00100000:0.0:1788530124.284269:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531572480 00000100:00100000:0.0:1788530124.284283:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531572480 00000100:00100000:0.0:1788530124.284312:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 67 00000100:00100000:0.0:1788530124.284324:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37367800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:2399:x1875409531572352:12345-192.168.202.41@tcp:400: 00000100:00100000:0.0:1788530124.284418:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37367800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:2399:x1875409531572352:12345-192.168.202.41@tcp:400: Request processed in 95us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530124.284425:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 67 00000100:00100000:0.0:1788530124.284441:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 68 00000100:00100000:0.0:1788530124.284447:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37365880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2400:x1875409531572480:12345-192.168.202.41@tcp:400: 00000100:00100000:0.0:1788530124.284470:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37365880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2400:x1875409531572480:12345-192.168.202.41@tcp:400: Request processed in 23us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530124.284475:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 68 00000100:00100000:0.0:1788530124.284491:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531572736 00000100:00100000:0.0:1788530124.284493:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531572736 00000100:00100000:0.0:1788530124.284515:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531572608 00000100:00100000:0.0:1788530124.284517:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531572608 00000100:00100000:0.0:1788530124.284534:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 13 00000100:00100000:0.0:1788530124.284539:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37364a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2400:x1875409531572736:12345-192.168.202.41@tcp:400: 00000100:00100000:0.0:1788530124.284585:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37364a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2400:x1875409531572736:12345-192.168.202.41@tcp:400: Request processed in 21us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530124.284591:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 13 00000100:00100000:0.0:1788530124.284602:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 14 00000100:00100000:0.0:1788530124.284609:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37366300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:2399:x1875409531572608:12345-192.168.202.41@tcp:400: 00000100:00100000:0.0:1788530124.284634:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37366300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:2399:x1875409531572608:12345-192.168.202.41@tcp:400: Request processed in 26us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530124.284640:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 14 00000100:00080000:0.0:1788530124.284792:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788530124.284798:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788530124.284801:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788530124.284804:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788530124.306722:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531572224 00000100:00100000:3.0:1788530124.306745:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531572224 00000100:00100000:3.0:1788530124.306938:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 224 00000100:00100000:3.0:1788530124.306952:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f442bcd-b742-4e76-ad7b-709f731358a0+10:2400:x1875409531572224:12345-192.168.202.41@tcp:400: 00000100:00100000:3.0:1788530124.307044:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f442bcd-b742-4e76-ad7b-709f731358a0+10:2400:x1875409531572224:12345-192.168.202.41@tcp:400: Request processed in 96us (22993us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530124.307072:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 224 00000001:00100000:1.0:1788530124.876019:0:8431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41 00010000:00010000:1.0:1788530124.993166:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530126.023214:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788530126.217176:0:10191:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:3.0:1788530126.400938:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37364380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555746944:0@lo:41: 00000100:00100000:3.0:1788530126.401010:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530126.401122:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555746944 00000100:00100000:0.0:1788530126.401131:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555746944 00000100:00100000:0.0:1788530126.401188:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788530126.401198:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555746944:12345-0@lo:41: 00000004:00000024:0.0:1788530126.401230:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1788530126.401294:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555746944:12345-0@lo:41: Request processed in 85us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530126.401302:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788530126.401347:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37364380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555746944:0@lo:41: 00000100:00100000:0.0:1788530126.913046:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788530126.913164:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555747200:0@lo:13: 00000100:00100000:3.0:1788530126.913234:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530126.913312:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555747200 00000100:00100000:3.0:1788530126.913319:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555747200 00000100:00100000:3.0:1788530126.913373:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788530126.913417:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555747200:12345-0@lo:13: 00002000:00000024:3.0:1788530126.913445:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788530126.913468:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0263c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555747072:0@lo:13: 00000100:00100000:3.0:1788530126.913495:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555747200:12345-0@lo:13: Request processed in 79us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530126.913502:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788530126.913513:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788530126.913684:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788530126.913782:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37364e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3649:1875409555747456:0@lo:400: 00000100:00100000:1.0:1788530126.913823:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530126.913855:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37365180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555747968:0@lo:400: 00000100:00100000:1.0:1788530126.913879:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530126.913901:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37426a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875409555748480:0@lo:400: 00000100:00100000:1.0:1788530126.913926:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530126.913945:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788530126.913951:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37367100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875409555747584:0@lo:400: 00000100:00100000:1.0:1788530126.913971:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530126.913987:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37366680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875409555748096:0@lo:400: 00000100:00100000:1.0:1788530126.914007:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530126.914022:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37425500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875409555748608:0@lo:400: 00000100:00100000:3.0:1788530126.914024:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555747072 00000100:00100000:3.0:1788530126.914029:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555747072 00000100:00100000:1.0:1788530126.914046:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530126.914057:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788530126.914064:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37364380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555747072:12345-0@lo:13: 00000100:00100000:1.0:1788530126.914080:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555747968 00002000:00000024:3.0:1788530126.914082:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788530126.914083:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555747968 00000100:00100000:1.0:1788530126.914112:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788530126.914115:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37364380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555747072:12345-0@lo:13: Request processed in 52us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530126.914118:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d3f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555747968:12345-0@lo:400: 00000100:00100000:3.0:1788530126.914121:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:3.0:1788530126.914136:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788530126.914149:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d3f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555747968:12345-0@lo:400: Request processed in 31us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530126.914155:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788530126.914180:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37367b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875409555747712:0@lo:400: 00000100:00100000:1.0:1788530126.914204:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530126.914434:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37365f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875409555748224:0@lo:400: 00000100:00100000:1.0:1788530126.914468:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530126.914479:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37427800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555748736:0@lo:400: 00000100:00100000:1.0:1788530126.914500:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788530126.914532:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f3d2a2300 x1875409555747200/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530142 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530126.914549:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555747200:0@lo:13: 00000100:00100000:1.0:1788530126.914583:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788530126.914590:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555747328:0@lo:13: 00000100:00100000:1.0:1788530126.914615:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530126.916399:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d3f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555747840:0@lo:13: 00000100:00100000:1.0:1788530126.916458:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530126.916472:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37366d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555748352:0@lo:400: 00000100:00100000:1.0:1788530126.916499:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530126.916588:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555748480 00000100:00100000:1.0:1788530126.916595:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555748480 00000100:00100000:1.0:1788530126.916731:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555747584 00000100:00100000:1.0:1788530126.916734:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555747584 00000100:00100000:1.0:1788530126.916747:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555748096 00000100:00100000:1.0:1788530126.916750:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555748096 00000100:00100000:1.0:1788530126.916762:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555748608 00000100:00100000:1.0:1788530126.916764:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555748608 00000100:00100000:1.0:1788530126.916775:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555747712 00000100:00100000:1.0:1788530126.916778:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555747712 00000100:00100000:1.0:1788530126.916787:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555748224 00000100:00100000:1.0:1788530126.916790:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555748224 00000100:00100000:1.0:1788530126.916806:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788530126.916815:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d3f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875409555748480:12345-0@lo:400: 00000100:00100000:1.0:1788530126.916866:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d3f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875409555748480:12345-0@lo:400: Request processed in 51us (2938us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530126.916885:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788530126.916905:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788530126.916911:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d3fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875409555747584:12345-0@lo:400: 00000100:00100000:1.0:1788530126.916940:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d3fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875409555747584:12345-0@lo:400: Request processed in 29us (2968us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530126.916945:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788530126.916956:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788530126.916961:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d3f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875409555748096:12345-0@lo:400: 00000100:00100000:1.0:1788530126.916985:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d3f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875409555748096:12345-0@lo:400: Request processed in 25us (2977us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530126.916990:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788530126.917000:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788530126.917006:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d3faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875409555748608:12345-0@lo:400: 00000100:00100000:1.0:1788530126.917029:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d3faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875409555748608:12345-0@lo:400: Request processed in 25us (2983us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530126.917035:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788530126.917045:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788530126.917051:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d3f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875409555747712:12345-0@lo:400: 00000100:00100000:1.0:1788530126.917085:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d3f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875409555747712:12345-0@lo:400: Request processed in 34us (2879us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530126.917090:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788530126.917100:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788530126.917106:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d3fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875409555748224:12345-0@lo:400: 00000100:00100000:1.0:1788530126.917132:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d3fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875409555748224:12345-0@lo:400: Request processed in 27us (2663us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530126.917143:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788530126.917191:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37367b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875409555747712:0@lo:400: 00010000:00080000:1.0:1788530126.917203:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f37365f80 x1875409555748224/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530142 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530126.917518:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37365f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875409555748224:0@lo:400: 00000100:00100000:1.0:1788530126.917587:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555748736 00000100:00100000:1.0:1788530126.917591:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555748736 00000100:00100000:1.0:1788530126.917633:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555748352 00000100:00100000:1.0:1788530126.917636:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555748352 00000100:00100000:1.0:1788530126.917735:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788530126.917742:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d3f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555748736:12345-0@lo:400: 00000100:00100000:1.0:1788530126.917783:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d3f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555748736:12345-0@lo:400: Request processed in 41us (3282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530126.917788:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788530126.917801:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788530126.917807:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d3f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555748352:12345-0@lo:400: 00000100:00100000:1.0:1788530126.917835:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d3f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555748352:12345-0@lo:400: Request processed in 28us (1335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530126.917840:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1788530126.917865:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f37366d80 x1875409555748352/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788530142 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530126.917875:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37366d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555748352:0@lo:400: 00010000:00080000:1.0:1788530126.917885:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f37427800 x1875409555748736/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788530142 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530126.917893:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37427800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555748736:0@lo:400: 00000100:00100000:1.0:1788530126.917960:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555747456 00000100:00100000:1.0:1788530126.917965:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555747456 00000100:00100000:1.0:1788530126.917995:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1788530126.918001:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:3649:x1875409555747456:12345-0@lo:400: 00000100:00100000:1.0:1788530126.918034:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:3649:x1875409555747456:12345-0@lo:400: Request processed in 33us (4211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530126.918040:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1788530126.918080:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555747328 00000100:00100000:1.0:1788530126.918084:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555747328 00000100:00100000:1.0:1788530126.918099:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555747840 00000100:00100000:1.0:1788530126.918101:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555747840 00000100:00100000:1.0:1788530126.918111:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788530126.918116:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d3f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555747328:12345-0@lo:13: 00002000:00000024:1.0:1788530126.918129:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788530126.918162:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d3f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555747328:12345-0@lo:13: Request processed in 46us (3546us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530126.918169:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788530126.918180:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788530126.918186:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d3fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555747840:12345-0@lo:13: 00002000:00000024:1.0:1788530126.918196:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788530126.919397:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d3fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555747840:12345-0@lo:13: Request processed in 1204us (2932us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530126.919407:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788530126.919471:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37367100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875409555747584:0@lo:400: 00000100:00100000:1.0:1788530126.919485:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37366680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875409555748096:0@lo:400: 00010000:00080000:1.0:1788530126.919498:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f37425500 x1875409555748608/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530142 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530126.919520:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37425500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875409555748608:0@lo:400: 00000100:00100000:1.0:1788530126.919534:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37426a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875409555748480:0@lo:400: 00000100:00100000:1.0:1788530126.919543:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37364e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3649:1875409555747456:0@lo:400: 00000100:00100000:1.0:1788530126.919552:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37365180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555747968:0@lo:400: 00010000:00080000:1.0:1788530126.919582:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e0263c000 x1875409555747072/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530142 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530126.919590:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967299 gen 2 00000100:00100000:1.0:1788530126.919612:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0263c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555747072:0@lo:13: 00000100:00080000:2.0:1788530126.919776:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788530126.919783:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788530126.919787:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788530126.919789:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788530126.919833:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e027d8700 x1875409555747328/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530142 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530126.919847:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555747328:0@lo:13: 00010000:00080000:2.0:1788530126.919867:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f3d3f9f80 x1875409555747840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530142 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530126.919880:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d3f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555747840:0@lo:13: 00010000:00010000:1.0:1788530127.042801:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788530127.939713:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788530127.939741:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555748864:0@lo:41: 00000100:00100000:3.0:1788530127.939820:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530127.939899:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555748864 00000100:00100000:3.0:1788530127.939926:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555748864 00000100:00100000:3.0:1788530127.939977:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788530127.939986:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555748864:12345-0@lo:41: 00000004:00000024:3.0:1788530127.940021:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446469632 avail 1300230144 00000100:00100000:3.0:1788530127.940064:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555748864:12345-0@lo:41: Request processed in 78us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530127.940072:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788530127.940151:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555748864:0@lo:41: 00010000:00010000:1.0:1788530128.068231:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530129.089617:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788530129.385957:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530129.385988:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530129.386013:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530129.386024:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530129.386038:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530129.386067:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531573376 00000100:00100000:0.0:1788530129.386078:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531573376 00000100:00100000:0.0:1788530129.386130:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531573248 00000100:00100000:0.0:1788530129.386132:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531573248 00000100:00100000:0.0:1788530129.386148:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 17 00000100:00100000:0.0:1788530129.386156:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37424a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2399:x1875409531573376:12345-192.168.202.41@tcp:400: 00000100:00100000:0.0:1788530129.386221:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37424a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2399:x1875409531573376:12345-192.168.202.41@tcp:400: Request processed in 67us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530129.386227:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 17 00000100:00100000:0.0:1788530129.386241:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 18 00000100:00100000:0.0:1788530129.386245:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37424380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2399:x1875409531573248:12345-192.168.202.41@tcp:400: 00000100:00100000:0.0:1788530129.386259:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37424380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2399:x1875409531573248:12345-192.168.202.41@tcp:400: Request processed in 14us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530129.386263:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 18 00000100:00080000:0.0:1788530129.386273:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788530129.386276:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788530129.386458:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531572864 00000100:00100000:1.0:1788530129.386463:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531572864 00000100:00100000:1.0:1788530129.386497:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 226 00000100:00100000:1.0:1788530129.386505:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f442bcd-b742-4e76-ad7b-709f731358a0+10:2399:x1875409531572864:12345-192.168.202.41@tcp:400: 00000100:00100000:1.0:1788530129.386541:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f442bcd-b742-4e76-ad7b-709f731358a0+10:2399:x1875409531572864:12345-192.168.202.41@tcp:400: Request processed in 38us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530129.386548:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 226 00000100:00100000:1.0:1788530129.386606:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531573120 00000100:00100000:1.0:1788530129.386610:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531573120 00000100:00100000:1.0:1788530129.386657:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531572992 00000100:00100000:1.0:1788530129.386660:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531572992 00000100:00100000:1.0:1788530129.386680:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 75 00000100:00100000:1.0:1788530129.386686:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37425880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2399:x1875409531573120:12345-192.168.202.41@tcp:400: 00000100:00100000:1.0:1788530129.386723:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37425880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2399:x1875409531573120:12345-192.168.202.41@tcp:400: Request processed in 37us (733us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530129.386729:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 75 00000100:00100000:1.0:1788530129.386742:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 76 00000100:00100000:1.0:1788530129.386748:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37426300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:2399:x1875409531572992:12345-192.168.202.41@tcp:400: 00000100:00100000:1.0:1788530129.386771:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37426300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:2399:x1875409531572992:12345-192.168.202.41@tcp:400: Request processed in 23us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530129.386777:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 76 00000100:00080000:0.0:1788530129.386925:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788530129.386929:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1788530130.115278:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788530130.850371:0:10340:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcef398f40 20000000:00000080:0.0:1788530130.850398:0:10340:0:(mgs_handler.c:1172:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a9f373af000 uarg=0000000000000000 20000000:01000000:0.0:1788530130.850468:0:10340:0:(mgs_llog.c:2012:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1788530130.850470:0:10340:0:(mgs_llog.c:6075:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1788530130.850473:0:10340:0:(mgs_llog.c:6106:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1788530130.850478:0:10340:0:(mgs_llog.c:4754:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1788530130.850483:0:10340:0:(mgs_llog.c:4187:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1788530130.850599:0:10340:0:(mgs_llog.c:2556:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788530130.850602:0:10340:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788530130.851887:0:10341:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:1.0:1788530130.852551:0:10340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:1.0:1788530130.852636:0:10340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:1.0:1788530130.852655:0:10340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:1.0:1788530130.852666:0:10340:0:(mgs_llog.c:2556:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1788530130.852668:0:10340:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788530130.853490:0:10342:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:2.0:1788530130.853881:0:10340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:2.0:1788530130.853913:0:10340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:2.0:1788530130.853928:0:10340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:2.0:1788530130.853955:0:10340:0:(mgs_llog.c:2556:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1788530130.853958:0:10340:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788530130.854536:0:10343:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:2.0:1788530130.854775:0:10340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:2.0:1788530130.854790:0:10340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:2.0:1788530130.854798:0:10340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:2.0:1788530130.854804:0:10340:0:(mgs_llog.c:2556:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788530130.854806:0:10340:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788530130.855533:0:10344:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:2.0:1788530130.855805:0:10340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:2.0:1788530130.855832:0:10340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:2.0:1788530130.855848:0:10340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:2.0:1788530130.855858:0:10340:0:(mgs_llog.c:2556:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1788530130.855860:0:10340:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788530130.856740:0:10345:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:2.0:1788530130.856964:0:10340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:2.0:1788530130.857255:0:10340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:2.0:1788530130.857514:0:10340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 10000000:01000000:2.0:1788530130.857536:0:10340:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788530130.860631:0:10340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a9f18140a00/0xb28d70e125750552 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530130.860662:0:10340:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a9e025ddc00/0xb28d70e125750399 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125750392 expref: 28 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530130.860670:0:10340:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a9f3d100c00/0xb28d70e1257503a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e1257503a0 expref: 28 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530130.860676:0:10340:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a9f3d100a00/0xb28d70e1257503df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e1257503d8 expref: 28 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530130.860683:0:10340:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a9e025dd600/0xb28d70e12575042c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125750425 expref: 28 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530130.860689:0:10340:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a9e025dd200/0xb28d70e125750448 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125750441 expref: 28 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530130.860720:0:10340:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a9f3d100e00/0xb28d70e125750456 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e12575044f expref: 28 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530130.860726:0:10340:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a9f3d101000/0xb28d70e125750464 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e12575045d expref: 28 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530130.860730:0:10340:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a9e025dcc00/0xb28d70e125750480 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125750479 expref: 28 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530130.860734:0:10340:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a9f3d101800/0xb28d70e1257504aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e1257504a3 expref: 28 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530130.860738:0:10340:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a9f3d100000/0xb28d70e1257504b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e1257504b1 expref: 28 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530130.860741:0:10340:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a9f18140e00/0xb28d70e1257504d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e1257504cd expref: 28 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530130.860745:0:10340:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a9f3d100600/0xb28d70e1257504f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e1257504f0 expref: 28 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530130.860751:0:10340:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a9f3d36b800/0xb28d70e12575050c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5506ea expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530130.860755:0:10340:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a9f18140800/0xb28d70e125750513 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5506f1 expref: 9 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530130.860760:0:10340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a9f18140a00/0xb28d70e125750552 lrc: 17/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530130.860916:0:10340:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a9f18140800/0xb28d70e125750513 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000000000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a5506f1 expref: 9 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530130.860929:0:10340:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a9f18140800/0xb28d70e125750513 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x70000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a5506f1 expref: 9 pid: 6518 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530130.860945:0:10340:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2a0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10340:1875409555748992:192.168.202.41@tcp:104: 00010000:00010000:3.0:1788530130.861245:0:10340:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a9f3d36b800/0xb28d70e12575050c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000000000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a5506ea expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530130.861256:0:10340:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a9f3d36b800/0xb28d70e12575050c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x70000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a5506ea expref: 9 pid: 6516 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530130.861356:0:10340:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2a3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10340:1875409555749120:192.168.202.41@tcp:104: 00010000:00010000:3.0:1788530130.861394:0:10340:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a9f3d100600/0xb28d70e1257504f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb28d70e1257504f0 expref: 28 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530130.861403:0:10340:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a9f3d100600/0xb28d70e1257504f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb28d70e1257504f0 expref: 28 pid: 6517 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530130.861430:0:10340:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2a1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10340:1875409555749248:0@lo:104: 00000100:00100000:3.0:1788530130.861480:0:10340:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788530130.861675:0:10340:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a9f18140e00/0xb28d70e1257504d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb28d70e1257504cd expref: 28 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530130.861684:0:10340:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a9f18140e00/0xb28d70e1257504d4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb28d70e1257504cd expref: 28 pid: 6517 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530130.861692:0:10340:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2a2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10340:1875409555749376:0@lo:104: 00000100:00100000:3.0:1788530130.861718:0:10340:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788530130.870023:0:10340:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a9f3d100000/0xb28d70e1257504b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb28d70e1257504b1 expref: 28 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530130.871529:0:10340:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a9f3d100000/0xb28d70e1257504b8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb28d70e1257504b1 expref: 28 pid: 6517 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530130.871548:0:10340:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2a1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10340:1875409555749504:0@lo:104: 00000100:00100000:3.0:1788530130.871658:0:10340:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530130.871704:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555749248 00000100:00100000:1.0:1788530130.871713:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555749248 00000100:00100000:0.0:1788530130.872906:0:9537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555749376 00000100:00100000:0.0:1788530130.872921:0:9537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555749376 00000100:00100000:0.0:1788530130.872994:0:9537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788530130.873006:0:9537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2a2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+4:10340:x1875409555749248:12345-0@lo:104: 00010000:00010000:0.0:1788530130.873025:0:9537:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff9a9f3d101c00/0xb28d70e1257504f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e1257504f7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530130.873294:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788530130.873308:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+4:10340:x1875409555749376:12345-0@lo:104: 00010000:00010000:2.0:1788530130.873317:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff9a9f18140400/0xb28d70e1257504cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e1257504d4 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530130.873515:0:6506:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 3 min 2 max 56 00000100:00100000:1.0:1788530130.873526:0:6506:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_003' 00000100:00100000:1.0:1788530130.873670:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555749504 00000100:00100000:1.0:1788530130.873675:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555749504 00000100:00100000:1.0:1788530130.873780:0:10346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788530130.873789:0:10346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e035f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+5:10340:x1875409555749504:12345-0@lo:104: 00010000:00010000:1.0:1788530130.873800:0:10346:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff9a9f3d100400/0xb28d70e1257504b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e1257504b8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530130.873918:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788530130.873926:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+5:10340:x1875409555749376:12345-0@lo:104: Request processed in 624us (12206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530130.873933:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:2.0:1788530130.873961:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788530130.873967:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f18140400/0xb28d70e1257504cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e1257504d4 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530130.873975:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f18140400 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:2.0:1788530130.873979:0:6512:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f18140400/0xb28d70e1257504cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x1400400000000 nid: local remote: 0xb28d70e1257504d4 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530130.873989:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f18140400/0xb28d70e1257504cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x1408400000000 nid: local remote: 0xb28d70e1257504d4 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788530130.873997:0:6512:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f18140400/0xb28d70e1257504cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x1409400000000 nid: local remote: 0xb28d70e1257504d4 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788530130.874003:0:6512:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788530130.874067:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9f18140400/0xb28d70e1257504cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e1257504d4 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530130.874083:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788530130.874124:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f18140400/0xb28d70e1257504cd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e1257504d4 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530130.874132:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f18140400/0xb28d70e1257504cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e1257504d4 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530130.874146:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530130.874148:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530130.874149:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788530130.874165:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3649:1875409555749632:0@lo:103: 00000100:00100000:2.0:1788530130.874211:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530130.878274:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555749632 00000100:00100000:2.0:1788530130.878294:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555749632 00010000:00010000:2.0:1788530130.878364:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a9f18140e00/0xb28d70e1257504d4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e1257504cd expref: 29 pid: 6517 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530130.878410:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788530130.878421:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027dad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:3649:x1875409555749632:12345-0@lo:103: 00010000:00010000:2.0:1788530130.878436:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788530130.878443:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a9f18140e00/0xb28d70e1257504d4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e1257504cd expref: 29 pid: 6517 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530130.878455:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a9f18140e00/0xb28d70e1257504d4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb28d70e1257504cd expref: 29 pid: 6517 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530130.878475:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788530130.878582:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027dad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:3649:x1875409555749632:12345-0@lo:103: Request processed in 139us (4348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530130.878590:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788530130.878743:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3649:1875409555749632:0@lo:103: 00010000:00010000:0.0:1788530130.878954:0:9537:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788530130.878962:0:9537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2a2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+4:10340:x1875409555749248:12345-0@lo:104: Request processed in 5958us (17482us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530130.878971:0:9537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:2.0:1788530130.880449:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788530130.880461:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f3d101c00/0xb28d70e1257504f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e1257504f7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530130.880473:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d101c00 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:2.0:1788530130.880477:0:6511:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f3d101c00/0xb28d70e1257504f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1400400000000 nid: local remote: 0xb28d70e1257504f7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530130.880488:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f3d101c00/0xb28d70e1257504f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1408400000000 nid: local remote: 0xb28d70e1257504f7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788530130.880495:0:6511:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f3d101c00/0xb28d70e1257504f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1409400000000 nid: local remote: 0xb28d70e1257504f7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788530130.880500:0:6511:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788530130.880552:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9f3d101c00/0xb28d70e1257504f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e1257504f7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530130.880581:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788530130.880603:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f3d101c00/0xb28d70e1257504f0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e1257504f7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530130.880611:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f3d101c00/0xb28d70e1257504f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e1257504f7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530130.880628:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530130.880630:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530130.880632:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788530130.880657:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3650:1875409555749760:0@lo:103: 00000100:00100000:2.0:1788530130.880725:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530130.880807:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555749760 00000100:00100000:2.0:1788530130.880815:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555749760 00010000:00010000:2.0:1788530130.880851:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a9f3d100600/0xb28d70e1257504f7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e1257504f0 expref: 29 pid: 6517 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530130.880881:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788530130.880891:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:3650:x1875409555749760:12345-0@lo:103: 00010000:00010000:2.0:1788530130.880903:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788530130.880908:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a9f3d100600/0xb28d70e1257504f7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e1257504f0 expref: 29 pid: 6517 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530130.880917:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a9f3d100600/0xb28d70e1257504f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb28d70e1257504f0 expref: 29 pid: 6517 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530130.880934:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788530130.880966:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:3650:x1875409555749760:12345-0@lo:103: Request processed in 76us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530130.880973:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788530130.881012:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3650:1875409555749760:0@lo:103: 00010000:00010000:3.0:1788530130.882670:0:10340:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a9f3d101800/0xb28d70e1257504aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb28d70e1257504a3 expref: 28 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530130.882695:0:10340:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a9f3d101800/0xb28d70e1257504aa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb28d70e1257504a3 expref: 28 pid: 6517 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530130.882716:0:10340:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e035f7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10340:1875409555749888:0@lo:104: 00000100:00100000:3.0:1788530130.882792:0:10340:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788530130.882836:0:10340:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a9e025dcc00/0xb28d70e125750480 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb28d70e125750479 expref: 28 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530130.882866:0:10340:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a9e025dcc00/0xb28d70e125750480 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb28d70e125750479 expref: 28 pid: 6518 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530130.882875:0:10340:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e035f6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10340:1875409555750016:0@lo:104: 00000100:00100000:3.0:1788530130.882906:0:10340:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788530130.882934:0:10340:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a9f3d101000/0xb28d70e125750464 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb28d70e12575045d expref: 28 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530130.882943:0:10340:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a9f3d101000/0xb28d70e125750464 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb28d70e12575045d expref: 28 pid: 6517 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530130.882951:0:10340:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e035f5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10340:1875409555750144:0@lo:104: 00010000:00010000:3.0:1788530130.882978:0:10340:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a9f3d100e00/0xb28d70e125750456 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb28d70e12575044f expref: 28 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530130.882986:0:10340:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a9f3d100e00/0xb28d70e125750456 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb28d70e12575044f expref: 28 pid: 6517 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530130.882993:0:10340:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e035f7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10340:1875409555750272:0@lo:104: 00010000:00010000:3.0:1788530130.883018:0:10340:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a9e025dd200/0xb28d70e125750448 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb28d70e125750441 expref: 28 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530130.883027:0:10340:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a9e025dd200/0xb28d70e125750448 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb28d70e125750441 expref: 28 pid: 6518 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530130.883212:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530130.883439:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530130.883701:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531573504 00000100:00100000:2.0:1788530130.883709:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531573504 00010000:00010000:2.0:1788530130.883745:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a9f18140800/0xb28d70e125750513 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a5506f1 expref: 10 pid: 6518 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530130.883780:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531573632 00000100:00100000:2.0:1788530130.883783:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531573632 00010000:00010000:2.0:1788530130.883798:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a9f3d36b800/0xb28d70e12575050c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a5506ea expref: 11 pid: 6516 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530130.883812:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 32 00000100:00100000:2.0:1788530130.883830:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37424e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f442bcd-b742-4e76-ad7b-709f731358a0+11:2400:x1875409531573504:12345-192.168.202.41@tcp:103: 00010000:00010000:2.0:1788530130.883844:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788530130.883849:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a9f18140800/0xb28d70e125750513 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 18 type: PLN flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a5506f1 expref: 11 pid: 6518 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530130.883986:0:6508:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1788530130.883995:0:6508:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1788530130.884102:0:6506:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788530130.884362:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530130.884393:0:6506:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530130.884403:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555749888 00000100:00100000:1.0:1788530130.884407:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555749888 00000100:00100000:1.0:1788530130.884432:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555750016 00000100:00100000:1.0:1788530130.884436:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555750016 00000100:00100000:1.0:1788530130.884446:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555750144 00000100:00100000:1.0:1788530130.884448:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555750144 00000100:00100000:1.0:1788530130.884456:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555750272 00000100:00100000:1.0:1788530130.884458:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555750272 00000100:00100000:1.0:1788530130.884470:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788530130.884478:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e035f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+7:10340:x1875409555749888:12345-0@lo:104: 00010000:00010000:1.0:1788530130.884492:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff9a9e025dce00/0xb28d70e1257504a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e1257504aa expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530130.884592:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788530130.884599:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e035f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+7:10340:x1875409555749888:12345-0@lo:104: Request processed in 123us (1809us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530130.884717:0:9537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788530130.884728:0:9537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2f3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+7:10340:x1875409555750016:12345-0@lo:104: 00010000:00010000:0.0:1788530130.884741:0:9537:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff9a9f3d101a00/0xb28d70e125750479 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e125750480 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530130.884782:0:9537:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788530130.884787:0:9537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2f3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+7:10340:x1875409555750016:12345-0@lo:104: Request processed in 63us (1882us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530130.884794:0:9537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788530130.884818:0:9537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788530130.884824:0:9537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d3f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+6:10340:x1875409555750144:12345-0@lo:104: 00010000:00010000:0.0:1788530130.884831:0:9537:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff9a9e025dde00/0xb28d70e12575045d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e125750464 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530130.884856:0:9537:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788530130.884860:0:9537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d3f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+6:10340:x1875409555750144:12345-0@lo:104: Request processed in 38us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530130.884865:0:9537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788530130.884884:0:9537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788530130.884890:0:9537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d3fb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+5:10340:x1875409555750272:12345-0@lo:104: 00010000:00010000:0.0:1788530130.884898:0:9537:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91c200/0xb28d70e12575044f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e125750456 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530130.884926:0:9537:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1788530130.884929:0:9537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d3fb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+5:10340:x1875409555750272:12345-0@lo:104: Request processed in 41us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530130.884935:0:9537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788530130.885390:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00010000:1.0:1788530130.885548:0:10346:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1788530130.885555:0:10346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e035f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+3:10340:x1875409555749504:12345-0@lo:104: Request processed in 11768us (13898us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530130.885589:0:10346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788530130.886352:0:10340:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e035f5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10340:1875409555750400:0@lo:104: 00000100:00100000:3.0:1788530130.886398:0:10340:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530130.886585:0:9537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555750400 00000100:00100000:0.0:1788530130.886594:0:9537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555750400 00000100:00100000:0.0:1788530130.886729:0:9537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788530130.886739:0:9537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e035f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+3:10340:x1875409555750400:12345-0@lo:104: 00010000:00010000:0.0:1788530130.886758:0:9537:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff9a9f3d101400/0xb28d70e125750441 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e125750448 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530130.886801:0:9537:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:0.0:1788530130.886806:0:9537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e035f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+3:10340:x1875409555750400:12345-0@lo:104: Request processed in 70us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530130.886812:0:9537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00010000:2.0:1788530130.889754:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a9f18140800/0xb28d70e125750513 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x50000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a5506f1 expref: 11 pid: 6518 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530130.889787:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788530130.889964:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37424e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f442bcd-b742-4e76-ad7b-709f731358a0+11:2400:x1875409531573504:12345-192.168.202.41@tcp:103: Request processed in 6132us (6751us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530130.889977:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 32 00000100:00100000:2.0:1788530130.890058:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 33 00000100:00100000:2.0:1788530130.890082:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37427100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f442bcd-b742-4e76-ad7b-709f731358a0+10:2400:x1875409531573632:12345-192.168.202.41@tcp:103: 00010000:00010000:2.0:1788530130.890111:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788530130.891951:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a9f3d36b800/0xb28d70e12575050c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a5506ea expref: 10 pid: 6516 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530130.891974:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a9f3d36b800/0xb28d70e12575050c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x50000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a5506ea expref: 10 pid: 6516 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530130.892006:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788530130.892106:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37427100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f442bcd-b742-4e76-ad7b-709f731358a0+10:2400:x1875409531573632:12345-192.168.202.41@tcp:103: Request processed in 2023us (8651us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530130.892407:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 33 00010000:00010000:2.0:1788530130.892461:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1788530130.892469:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9e025dce00/0xb28d70e1257504a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e1257504aa expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530130.892497:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9e025dce00 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:2.0:1788530130.892502:0:6511:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9e025dce00/0xb28d70e1257504a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400400000000 nid: local remote: 0xb28d70e1257504aa expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530130.892511:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9e025dce00/0xb28d70e1257504a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1408400000000 nid: local remote: 0xb28d70e1257504aa expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788530130.892517:0:6511:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9e025dce00/0xb28d70e1257504a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1409400000000 nid: local remote: 0xb28d70e1257504aa expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788530130.892523:0:6511:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788530130.892615:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9e025dce00/0xb28d70e1257504a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e1257504aa expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530130.892622:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788530130.892655:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9e025dce00/0xb28d70e1257504a3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e1257504aa expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530130.892662:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9e025dce00/0xb28d70e1257504a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e1257504aa expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530130.892677:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788530130.892680:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f3d101a00/0xb28d70e125750479 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e125750480 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530130.892685:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d101a00 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:2.0:1788530130.892688:0:6511:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f3d101a00/0xb28d70e125750479 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xb28d70e125750480 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530130.892705:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f3d101a00/0xb28d70e125750479 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xb28d70e125750480 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788530130.892711:0:6511:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f3d101a00/0xb28d70e125750479 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xb28d70e125750480 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788530130.892716:0:6511:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788530130.892736:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9f3d101a00/0xb28d70e125750479 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125750480 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530130.892743:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788530130.892748:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f3d101a00/0xb28d70e125750479 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125750480 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530130.892755:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f3d101a00/0xb28d70e125750479 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125750480 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530130.892766:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788530130.892769:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9e025dde00/0xb28d70e12575045d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e125750464 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530130.892774:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9e025dde00 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:2.0:1788530130.892776:0:6511:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9e025dde00/0xb28d70e12575045d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xb28d70e125750464 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530130.892783:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9e025dde00/0xb28d70e12575045d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xb28d70e125750464 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788530130.892790:0:6511:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9e025dde00/0xb28d70e12575045d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xb28d70e125750464 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788530130.892802:0:6511:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788530130.892819:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9e025dde00/0xb28d70e12575045d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125750464 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530130.892825:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788530130.892863:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9e025dde00/0xb28d70e12575045d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125750464 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530130.892871:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9e025dde00/0xb28d70e12575045d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125750464 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530130.892881:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788530130.892884:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91c200/0xb28d70e12575044f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e125750456 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530130.892890:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f0c91c200 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:2.0:1788530130.892893:0:6511:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91c200/0xb28d70e12575044f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xb28d70e125750456 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530130.892899:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91c200/0xb28d70e12575044f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xb28d70e125750456 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788530130.892905:0:6511:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91c200/0xb28d70e12575044f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xb28d70e125750456 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788530130.892911:0:6511:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788530130.892940:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91c200/0xb28d70e12575044f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125750456 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530130.892946:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788530130.892959:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91c200/0xb28d70e12575044f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125750456 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530130.892965:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91c200/0xb28d70e12575044f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125750456 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530130.892976:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788530130.892981:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f3d100400/0xb28d70e1257504b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e1257504b8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530130.892987:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d100400 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:2.0:1788530130.892989:0:6511:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f3d100400/0xb28d70e1257504b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xb28d70e1257504b8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530130.892996:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f3d100400/0xb28d70e1257504b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xb28d70e1257504b8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788530130.893002:0:6511:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f3d100400/0xb28d70e1257504b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xb28d70e1257504b8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788530130.893008:0:6511:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788530130.893022:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9f3d100400/0xb28d70e1257504b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e1257504b8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530130.893028:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788530130.893634:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3648:1875409555750656:0@lo:103: 00000100:00100000:0.0:1788530130.893728:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530130.893782:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788530130.893790:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3648:1875409555750528:0@lo:103: 00000100:00100000:0.0:1788530130.893812:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530130.893833:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555750656 00000100:00100000:0.0:1788530130.893841:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555750656 00010000:00010000:0.0:1788530130.893874:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a9e025dcc00/0xb28d70e125750480 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e125750479 expref: 29 pid: 6518 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530130.893904:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555750528 00000100:00100000:0.0:1788530130.893907:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555750528 00010000:00010000:0.0:1788530130.893918:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a9f3d101800/0xb28d70e1257504aa lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e1257504a3 expref: 30 pid: 6517 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530130.893931:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788530130.893939:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f396c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+30:3648:x1875409555750656:12345-0@lo:103: 00010000:00010000:0.0:1788530130.893953:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788530130.893958:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a9e025dcc00/0xb28d70e125750480 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e125750479 expref: 30 pid: 6518 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530130.893968:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a9e025dcc00/0xb28d70e125750480 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb28d70e125750479 expref: 30 pid: 6518 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530130.893992:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788530130.894028:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f396c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+30:3648:x1875409555750656:12345-0@lo:103: Request processed in 89us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530130.894047:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788530130.894090:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788530130.894097:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37427b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:3648:x1875409555750528:12345-0@lo:103: 00010000:00010000:0.0:1788530130.894105:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788530130.894110:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a9f3d101800/0xb28d70e1257504aa lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e1257504a3 expref: 29 pid: 6517 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530130.894238:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a9f3d101800/0xb28d70e1257504aa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb28d70e1257504a3 expref: 29 pid: 6517 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530130.894249:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788530130.894363:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37427b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:3648:x1875409555750528:12345-0@lo:103: Request processed in 266us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530130.894371:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788530130.894410:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3648:1875409555750528:0@lo:103: 00000100:00100000:0.0:1788530130.894419:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3648:1875409555750656:0@lo:103: 00000100:00100000:3.0:1788530130.895638:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3649:1875409555750784:0@lo:103: 00000100:00100000:3.0:1788530130.895707:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530130.895749:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788530130.895756:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3649:1875409555750912:0@lo:103: 00000100:00100000:3.0:1788530130.895780:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530130.895808:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555750784 00000100:00100000:3.0:1788530130.895816:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555750784 00010000:00010000:3.0:1788530130.895844:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a9f3d101000/0xb28d70e125750464 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e12575045d expref: 29 pid: 6517 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530130.895864:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555750912 00000100:00100000:3.0:1788530130.895867:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555750912 00010000:00010000:3.0:1788530130.895878:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a9f3d100e00/0xb28d70e125750456 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e12575044f expref: 30 pid: 6517 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530130.895891:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788530130.895900:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e035f6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+30:3649:x1875409555750784:12345-0@lo:103: 00010000:00010000:3.0:1788530130.895912:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788530130.895917:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a9f3d101000/0xb28d70e125750464 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e12575045d expref: 30 pid: 6517 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530130.895927:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a9f3d101000/0xb28d70e125750464 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb28d70e12575045d expref: 30 pid: 6517 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530130.895944:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788530130.895975:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e035f6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+30:3649:x1875409555750784:12345-0@lo:103: Request processed in 77us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530130.895983:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788530130.895999:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788530130.896006:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e035f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:3649:x1875409555750912:12345-0@lo:103: 00010000:00010000:3.0:1788530130.896023:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788530130.896028:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a9f3d100e00/0xb28d70e125750456 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e12575044f expref: 29 pid: 6517 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530130.896036:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a9f3d100e00/0xb28d70e125750456 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb28d70e12575044f expref: 29 pid: 6517 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530130.896046:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788530130.896069:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e035f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:3649:x1875409555750912:12345-0@lo:103: Request processed in 63us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530130.896091:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788530130.896354:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3649:1875409555750912:0@lo:103: 00000100:00100000:3.0:1788530130.896364:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3649:1875409555750784:0@lo:103: 00010000:00010000:3.0:1788530130.896389:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788530130.896432:0:10340:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a9e025dd600/0xb28d70e12575042c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb28d70e125750425 expref: 28 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530130.896446:0:10340:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a9e025dd600/0xb28d70e12575042c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb28d70e125750425 expref: 28 pid: 6517 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530130.896457:0:10340:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e035f4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10340:1875409555751168:0@lo:104: 00000100:00100000:3.0:1788530130.896487:0:10340:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788530130.896515:0:10340:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a9f3d100a00/0xb28d70e1257503df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb28d70e1257503d8 expref: 28 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530130.896523:0:10340:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a9f3d100a00/0xb28d70e1257503df lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb28d70e1257503d8 expref: 28 pid: 6517 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530130.896531:0:10340:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e035f7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10340:1875409555751296:0@lo:104: 00000100:00100000:3.0:1788530130.896605:0:10340:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788530130.896628:0:10340:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a9f3d100c00/0xb28d70e1257503a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb28d70e1257503a0 expref: 28 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530130.896637:0:10340:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a9f3d100c00/0xb28d70e1257503a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb28d70e1257503a0 expref: 28 pid: 6517 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530130.896646:0:10340:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e035f6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10340:1875409555751424:0@lo:104: 00000100:00100000:3.0:1788530130.896667:0:10340:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788530130.896692:0:10340:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a9e025ddc00/0xb28d70e125750399 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb28d70e125750392 expref: 28 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530130.896702:0:10340:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a9e025ddc00/0xb28d70e125750399 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb28d70e125750392 expref: 28 pid: 6516 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530130.896709:0:10340:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e035f5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10340:1875409555751552:0@lo:104: 00000100:00100000:3.0:1788530130.896733:0:10340:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530130.896755:0:10340:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e0327ce40 going to sleep for 11 seconds 00010000:00010000:3.0:1788530130.896771:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f18140800/0xb28d70e125750513 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x44801400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a5506f1 expref: 9 pid: 6518 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530130.896785:0:10340:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2a0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10340:1875409555748992:192.168.202.41@tcp:104: 00010000:00010000:3.0:1788530130.896796:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f3d36b800/0xb28d70e12575050c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x44801400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a5506ea expref: 8 pid: 6516 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530130.896804:0:10340:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2a3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10340:1875409555749120:192.168.202.41@tcp:104: 00010000:00010000:3.0:1788530130.896813:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f3d100600/0xb28d70e1257504f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb28d70e1257504f0 expref: 28 pid: 6517 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530130.896832:0:10340:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2a1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10340:1875409555749248:0@lo:104: 00010000:00010000:3.0:1788530130.896845:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f18140e00/0xb28d70e1257504d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb28d70e1257504cd expref: 27 pid: 6517 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530130.896852:0:10340:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2a2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10340:1875409555749376:0@lo:104: 00000100:00100000:3.0:1788530130.896859:0:10340:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2a1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10340:1875409555749504:0@lo:104: 00010000:00010000:3.0:1788530130.896867:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f3d101800/0xb28d70e1257504aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb28d70e1257504a3 expref: 26 pid: 6517 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530130.896875:0:10340:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e035f7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10340:1875409555749888:0@lo:104: 00010000:00010000:3.0:1788530130.896884:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9e025dcc00/0xb28d70e125750480 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb28d70e125750479 expref: 25 pid: 6518 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530130.896891:0:10340:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e035f6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10340:1875409555750016:0@lo:104: 00010000:00010000:3.0:1788530130.896901:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f3d101000/0xb28d70e125750464 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb28d70e12575045d expref: 24 pid: 6517 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530130.896909:0:10340:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e035f5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10340:1875409555750144:0@lo:104: 00010000:00010000:3.0:1788530130.896918:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f3d100e00/0xb28d70e125750456 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb28d70e12575044f expref: 23 pid: 6517 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530130.896925:0:10340:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e035f7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10340:1875409555750272:0@lo:104: 00000100:00100000:3.0:1788530130.896934:0:10340:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e035f5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10340:1875409555750400:0@lo:104: 00010000:00010000:2.0:1788530130.897044:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f3d100400/0xb28d70e1257504b1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e1257504b8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530130.897053:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f3d100400/0xb28d70e1257504b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e1257504b8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530130.897088:0:6507:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788530130.897107:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555751168 00000100:00100000:2.0:1788530130.897403:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555751168 00000100:00100000:2.0:1788530130.897442:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555751296 00000100:00100000:2.0:1788530130.897446:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555751296 00000100:00100000:2.0:1788530130.897456:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555751424 00000100:00100000:2.0:1788530130.897458:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555751424 00000100:00100000:2.0:1788530130.897469:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555751552 00000100:00100000:2.0:1788530130.897471:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555751552 00000100:00100000:2.0:1788530130.897484:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788530130.897491:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e035f7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+6:10340:x1875409555751168:12345-0@lo:104: 00010000:00010000:2.0:1788530130.897503:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff9a9f18140200/0xb28d70e125750425 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e12575042c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530130.897554:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788530130.897584:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e035f7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+6:10340:x1875409555751168:12345-0@lo:104: Request processed in 69us (1073us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530130.897593:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788530130.897619:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788530130.897626:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e035f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+5:10340:x1875409555751296:12345-0@lo:104: 00010000:00010000:2.0:1788530130.897634:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91de00/0xb28d70e1257503d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e1257503df expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530130.897663:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788530130.897668:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e035f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+5:10340:x1875409555751296:12345-0@lo:104: Request processed in 44us (1064us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530130.897675:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788530130.897687:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788530130.897693:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e035f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+4:10340:x1875409555751424:12345-0@lo:104: 00010000:00010000:2.0:1788530130.897701:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91c800/0xb28d70e1257503a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e1257503a7 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530130.897738:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788530130.897742:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e035f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+4:10340:x1875409555751424:12345-0@lo:104: Request processed in 51us (1075us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530130.897748:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788530130.897762:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788530130.897768:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3738ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+3:10340:x1875409555751552:12345-0@lo:104: 00010000:00010000:2.0:1788530130.897776:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d400/0xb28d70e125750392 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e125750399 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530130.897801:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788530130.897806:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3738ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+3:10340:x1875409555751552:12345-0@lo:104: Request processed in 39us (1072us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530130.897811:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:2.0:1788530130.897854:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788530130.897860:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f18140200/0xb28d70e125750425 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e12575042c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530130.897867:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f18140200 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:2.0:1788530130.897872:0:6511:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f18140200/0xb28d70e125750425 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xb28d70e12575042c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530130.897883:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f18140200/0xb28d70e125750425 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xb28d70e12575042c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788530130.897892:0:6511:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f18140200/0xb28d70e125750425 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xb28d70e12575042c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788530130.897898:0:6511:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788530130.897948:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9f18140200/0xb28d70e125750425 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e12575042c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530130.897956:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788530130.897965:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f18140200/0xb28d70e125750425 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e12575042c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530130.897970:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f18140200/0xb28d70e125750425 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e12575042c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530130.897983:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788530130.897987:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91de00/0xb28d70e1257503d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e1257503df expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530130.897992:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f0c91de00 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:2.0:1788530130.897994:0:6511:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91de00/0xb28d70e1257503d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xb28d70e1257503df expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530130.898000:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91de00/0xb28d70e1257503d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xb28d70e1257503df expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788530130.898006:0:6511:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91de00/0xb28d70e1257503d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xb28d70e1257503df expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788530130.898011:0:6511:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788530130.898023:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91de00/0xb28d70e1257503d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e1257503df expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530130.898028:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788530130.898050:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91de00/0xb28d70e1257503d8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e1257503df expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530130.898068:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91de00/0xb28d70e1257503d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e1257503df expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530130.898105:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3649:1875409555751808:0@lo:103: 00000100:00100000:0.0:1788530130.899666:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3648:1875409555751680:0@lo:103: 00000100:00100000:0.0:1788530130.899731:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530130.899784:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788530130.899792:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3648:1875409555751040:0@lo:103: 00000100:00100000:0.0:1788530130.899813:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530130.899839:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555751680 00000100:00100000:0.0:1788530130.899847:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555751680 00010000:00010000:0.0:1788530130.899883:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a9e025dd600/0xb28d70e12575042c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e125750425 expref: 23 pid: 6517 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530130.899903:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555751040 00000100:00100000:0.0:1788530130.899906:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555751040 00010000:00010000:0.0:1788530130.899918:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a9f3d100000/0xb28d70e1257504b8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e1257504b1 expref: 24 pid: 6517 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530130.899932:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788530130.899940:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37424e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+24:3648:x1875409555751680:12345-0@lo:103: 00010000:00010000:0.0:1788530130.899956:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788530130.899962:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a9e025dd600/0xb28d70e12575042c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e125750425 expref: 24 pid: 6517 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530130.899972:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a9e025dd600/0xb28d70e12575042c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb28d70e125750425 expref: 24 pid: 6517 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530130.900012:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788530130.900062:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37424e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+24:3648:x1875409555751680:12345-0@lo:103: Request processed in 122us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530130.900078:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788530130.900099:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788530130.900106:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37427100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+23:3648:x1875409555751040:12345-0@lo:103: 00010000:00010000:3.0:1788530130.900513:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9e025dd600/0xb28d70e12575042c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb28d70e125750425 expref: 23 pid: 6517 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530130.900542:0:10340:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e035f4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10340:1875409555751168:0@lo:104: 00000100:00100000:3.0:1788530130.900574:0:10340:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e035f7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10340:1875409555751296:0@lo:104: 00000100:00100000:3.0:1788530130.900588:0:10340:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e035f6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10340:1875409555751424:0@lo:104: 00000100:00100000:3.0:1788530130.900597:0:10340:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e035f5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10340:1875409555751552:0@lo:104: 00010000:00010000:3.0:1788530130.900655:0:10340:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a9f18140a00/0xb28d70e125750552 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530130.900726:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788530130.900733:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a9f3d100000/0xb28d70e1257504b8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e1257504b1 expref: 22 pid: 6517 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530130.900743:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a9f3d100000/0xb28d70e1257504b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb28d70e1257504b1 expref: 22 pid: 6517 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530130.900756:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f3d100000/0xb28d70e1257504b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb28d70e1257504b1 expref: 22 pid: 6517 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530130.900768:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788530130.900798:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37427100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+21:3648:x1875409555751040:12345-0@lo:103: Request processed in 693us (984us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530130.900806:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788530130.900836:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3648:1875409555751040:0@lo:103: 00000100:00100000:0.0:1788530130.900844:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3648:1875409555751680:0@lo:103: 00000100:00100000:2.0:1788530130.901030:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530130.901364:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555751808 00000100:00100000:0.0:1788530130.901371:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555751808 00010000:00010000:0.0:1788530130.901396:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a9f3d100a00/0xb28d70e1257503df lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e1257503d8 expref: 21 pid: 6517 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530130.901446:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788530130.901454:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+21:3649:x1875409555751808:12345-0@lo:103: 00010000:00010000:0.0:1788530130.901465:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788530130.901470:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a9f3d100a00/0xb28d70e1257503df lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e1257503d8 expref: 21 pid: 6517 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530130.901479:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a9f3d100a00/0xb28d70e1257503df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb28d70e1257503d8 expref: 21 pid: 6517 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530130.901491:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f3d100a00/0xb28d70e1257503df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb28d70e1257503d8 expref: 21 pid: 6517 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530130.901501:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788530130.901528:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+20:3649:x1875409555751808:12345-0@lo:103: Request processed in 76us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530130.901535:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788530130.901707:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3649:1875409555751808:0@lo:103: 00010000:00010000:2.0:1788530130.901731:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788530130.901738:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91c800/0xb28d70e1257503a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e1257503a7 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530130.901746:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f0c91c800 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:2.0:1788530130.901751:0:6511:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91c800/0xb28d70e1257503a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb28d70e1257503a7 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530130.901760:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91c800/0xb28d70e1257503a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb28d70e1257503a7 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788530130.901768:0:6511:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91c800/0xb28d70e1257503a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb28d70e1257503a7 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788530130.901774:0:6511:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788530130.901808:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91c800/0xb28d70e1257503a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e1257503a7 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530130.901816:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788530130.901831:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91c800/0xb28d70e1257503a0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e1257503a7 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530130.901850:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91c800/0xb28d70e1257503a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e1257503a7 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530130.901870:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3650:1875409555751936:0@lo:103: 00000100:00100000:2.0:1788530130.901901:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530130.901928:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555751936 00000100:00100000:2.0:1788530130.901932:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555751936 00010000:00010000:2.0:1788530130.901947:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a9f3d100c00/0xb28d70e1257503a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e1257503a0 expref: 20 pid: 6517 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530130.901960:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788530130.901966:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f396c1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+20:3650:x1875409555751936:12345-0@lo:103: 00010000:00010000:2.0:1788530130.901973:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788530130.901978:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a9f3d100c00/0xb28d70e1257503a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e1257503a0 expref: 20 pid: 6517 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530130.901986:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a9f3d100c00/0xb28d70e1257503a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb28d70e1257503a0 expref: 20 pid: 6517 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530130.901996:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f3d100c00/0xb28d70e1257503a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb28d70e1257503a0 expref: 20 pid: 6517 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530130.902006:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788530130.902030:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f396c1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+19:3650:x1875409555751936:12345-0@lo:103: Request processed in 64us (129us total) trans 0 rc 0/0 00010000:00010000:1.0:1788530130.904396:0:10348:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788530130.904410:0:10348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d400/0xb28d70e125750392 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e125750399 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530130.904422:0:10348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f0c91d400 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:1.0:1788530130.904435:0:10348:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d400/0xb28d70e125750392 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb28d70e125750399 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530130.904446:0:10348:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d400/0xb28d70e125750392 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb28d70e125750399 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788530130.904453:0:10348:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d400/0xb28d70e125750392 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb28d70e125750399 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788530130.904459:0:10348:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788530130.904516:0:10348:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d400/0xb28d70e125750392 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125750399 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530130.904523:0:10348:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788530130.904545:0:10348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d400/0xb28d70e125750392 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125750399 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530130.904552:0:10348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d400/0xb28d70e125750392 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125750399 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530130.904712:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788530130.904810:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3650:1875409555751936:0@lo:103: 00010000:00010000:2.0:1788530130.904846:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530130.904849:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530130.904851:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530130.905045:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f3d101400/0xb28d70e125750441 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e125750448 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530130.905054:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d101400 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:0.0:1788530130.905058:0:6512:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f3d101400/0xb28d70e125750441 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb28d70e125750448 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530130.905066:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f3d101400/0xb28d70e125750441 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb28d70e125750448 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788530130.905080:0:6512:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f3d101400/0xb28d70e125750441 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb28d70e125750448 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788530130.905098:0:6512:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788530130.905469:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9f3d101400/0xb28d70e125750441 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125750448 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530130.905477:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788530130.905485:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f3d101400/0xb28d70e125750441 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125750448 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530130.905492:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f3d101400/0xb28d70e125750441 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125750448 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530130.905511:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530130.905513:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530130.905515:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788530130.905741:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37425180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3648:1875409555752192:0@lo:103: 00000100:00100000:3.0:1788530130.905828:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530130.906094:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555752192 00000100:00100000:0.0:1788530130.906103:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555752192 00010000:00010000:0.0:1788530130.906149:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a9e025dd200/0xb28d70e125750448 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e125750441 expref: 19 pid: 6518 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530130.906183:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788530130.906193:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e035f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+19:3648:x1875409555752192:12345-0@lo:103: 00010000:00010000:0.0:1788530130.906211:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788530130.906217:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a9e025dd200/0xb28d70e125750448 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e125750441 expref: 19 pid: 6518 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530130.906229:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a9e025dd200/0xb28d70e125750448 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb28d70e125750441 expref: 19 pid: 6518 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530130.906249:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9e025dd200/0xb28d70e125750448 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb28d70e125750441 expref: 19 pid: 6518 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530130.906285:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788530130.906324:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e035f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+18:3648:x1875409555752192:12345-0@lo:103: Request processed in 131us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530130.906332:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788530130.906585:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d3fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3647:1875409555752064:0@lo:103: 00000100:00100000:1.0:1788530130.906632:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788530130.906679:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530130.906682:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530130.906684:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788530130.906805:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555752064 00000100:00100000:2.0:1788530130.906811:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555752064 00010000:00010000:2.0:1788530130.906831:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a9e025ddc00/0xb28d70e125750399 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e125750392 expref: 18 pid: 6516 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530130.906852:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788530130.906859:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d3f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+18:3647:x1875409555752064:12345-0@lo:103: 00010000:00010000:2.0:1788530130.906867:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788530130.906871:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a9e025ddc00/0xb28d70e125750399 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e125750392 expref: 18 pid: 6516 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530130.906881:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a9e025ddc00/0xb28d70e125750399 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb28d70e125750392 expref: 18 pid: 6516 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530130.906893:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9e025ddc00/0xb28d70e125750399 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb28d70e125750392 expref: 18 pid: 6516 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530130.906905:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a9f18140a00/0xb28d70e125750552 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530130.906915:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f18140a00/0xb28d70e125750552 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530130.906933:0:6509:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a9f18140a00/0xb28d70e125750552 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530130.906941:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a9f18140a00/0xb28d70e125750552 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530130.906961:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a9f18140a00/0xb28d70e125750552 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530130.906968:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a9f18140a00/0xb28d70e125750552 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530130.906976:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f18140a00 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:2.0:1788530130.906981:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a9f18140a00/0xb28d70e125750552 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530130.906990:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a9f18140a00/0xb28d70e125750552 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530130.907006:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a9f18140a00/0xb28d70e125750552 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530130.907017:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788530130.907058:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d3f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+17:3647:x1875409555752064:12345-0@lo:103: Request processed in 200us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530130.907065:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788530130.907235:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d3fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3647:1875409555752064:0@lo:103: 00000100:00100000:3.0:1788530130.907851:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37425180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3648:1875409555752192:0@lo:103: 00010000:00010000:3.0:1788530130.907884:0:10340:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a9f18140a00/0xb28d70e125750552 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530130.907894:0:10340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a9f18140a00/0xb28d70e125750552 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530130.907901:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f18140a00/0xb28d70e125750552 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530131.141822:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788530131.520783:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37426680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555752320:0@lo:41: 00000100:00100000:2.0:1788530131.520922:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530131.522747:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555752320 00000100:00100000:3.0:1788530131.522764:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555752320 00000100:00100000:3.0:1788530131.522856:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788530131.522867:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555752320:12345-0@lo:41: 00000004:00000024:3.0:1788530131.522915:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788530131.530294:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555752320:12345-0@lo:41: Request processed in 7414us (9358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530131.530329:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788530131.541982:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37426680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555752320:0@lo:41: 00000100:00100000:0.0:1788530131.880022:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530131.880261:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531573760 00000100:00100000:2.0:1788530131.880291:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531573760 00000100:00100000:2.0:1788530131.880385:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 227 00000100:00100000:2.0:1788530131.880397:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f442bcd-b742-4e76-ad7b-709f731358a0+8:6178:x1875409531573760:12345-192.168.202.41@tcp:101: 00010000:00010000:2.0:1788530131.880422:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530131.880472:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f18140200/0xb28d70e125750559 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1406819a550761 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530131.880513:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f18140200/0xb28d70e125750559 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550761 expref: 9 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530131.880528:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f18140200/0xb28d70e125750559 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550761 expref: 9 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530131.880541:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f18140200, rc 0) 00000100:00100000:2.0:1788530131.880694:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f442bcd-b742-4e76-ad7b-709f731358a0+9:6178:x1875409531573760:12345-192.168.202.41@tcp:101: Request processed in 299us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530131.880703:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 227 00000100:00100000:1.0:1788530131.892856:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530131.892925:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531573888 00000100:00100000:0.0:1788530131.892937:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531573888 00000100:00100000:0.0:1788530131.893402:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 228 00000100:00100000:0.0:1788530131.893414:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f442bcd-b742-4e76-ad7b-709f731358a0+9:6178:x1875409531573888:12345-192.168.202.41@tcp:501: 00000100:00100000:0.0:1788530131.893615:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f442bcd-b742-4e76-ad7b-709f731358a0+9:6178:x1875409531573888:12345-192.168.202.41@tcp:501: Request processed in 203us (770us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530131.893623:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 228 00000100:00100000:3.0:1788530131.905276:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530131.914879:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531574016 00000100:00100000:2.0:1788530131.914915:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531574016 00000100:00100000:0.0:1788530131.915474:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 229 00000100:00100000:0.0:1788530131.915491:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f442bcd-b742-4e76-ad7b-709f731358a0+9:6178:x1875409531574016:12345-192.168.202.41@tcp:503: 00000100:00100000:0.0:1788530131.915710:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f442bcd-b742-4e76-ad7b-709f731358a0+9:6178:x1875409531574016:12345-192.168.202.41@tcp:503: Request processed in 223us (10447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530131.915719:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 229 00000100:00100000:1.0:1788530131.926000:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530131.926490:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531574144 00000100:00100000:3.0:1788530131.926502:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531574144 00000100:00100000:3.0:1788530131.926552:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 230 00000100:00100000:3.0:1788530131.926613:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f442bcd-b742-4e76-ad7b-709f731358a0+9:6652:x1875409531574144:12345-192.168.202.41@tcp:502: 00000100:00100000:3.0:1788530131.926845:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f442bcd-b742-4e76-ad7b-709f731358a0+9:6652:x1875409531574144:12345-192.168.202.41@tcp:502: Request processed in 282us (877us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530131.926855:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 230 00000100:00100000:3.0:1788530131.937376:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530131.937485:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531574272 00000100:00100000:2.0:1788530131.937495:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531574272 00000100:00100000:2.0:1788530131.937557:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 231 00000100:00100000:2.0:1788530131.937613:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f442bcd-b742-4e76-ad7b-709f731358a0+9:6652:x1875409531574272:12345-192.168.202.41@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788530131.937770:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f442bcd-b742-4e76-ad7b-709f731358a0+9:6652:x1875409531574272:12345-192.168.202.41@tcp:502:llog_process_th.0 Request processed in 159us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530131.937779:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 231 00000100:00100000:1.0:1788530131.944071:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530131.944506:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531574400 00000100:00100000:3.0:1788530131.944518:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531574400 00000100:00100000:3.0:1788530131.944625:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 232 00000100:00100000:3.0:1788530131.944637:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f442bcd-b742-4e76-ad7b-709f731358a0+9:6178:x1875409531574400:12345-192.168.202.41@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788530131.944658:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788530131.944684:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f0c91da00/0xb28d70e125750560 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1406819a550768 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530131.944726:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f0c91da00/0xb28d70e125750560 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550768 expref: 10 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530131.944742:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f0c91da00/0xb28d70e125750560 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550768 expref: 10 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530131.944753:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f0c91da00, rc 0) 00000100:00100000:3.0:1788530131.944850:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f442bcd-b742-4e76-ad7b-709f731358a0+10:6178:x1875409531574400:12345-192.168.202.41@tcp:101:ll_cfg_requeue.0 Request processed in 214us (803us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530131.944882:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 232 00000100:00100000:1.0:1788530131.954081:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530131.954364:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531574528 00000100:00100000:0.0:1788530131.954374:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531574528 00000100:00100000:0.0:1788530131.954486:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 233 00000100:00100000:0.0:1788530131.954501:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f442bcd-b742-4e76-ad7b-709f731358a0+10:6178:x1875409531574528:12345-192.168.202.41@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788530131.954709:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f442bcd-b742-4e76-ad7b-709f731358a0+10:6178:x1875409531574528:12345-192.168.202.41@tcp:501:ll_cfg_requeue.0 Request processed in 209us (637us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788530131.954718:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 233 00000100:00100000:3.0:1788530132.033347:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788530132.033373:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37426d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555752576:0@lo:13: 00000100:00100000:3.0:1788530132.033449:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530132.033523:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555752448:0@lo:13: 00000100:00100000:3.0:1788530132.033546:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530132.037589:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555752576 00000100:00100000:0.0:1788530132.037677:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555752576 00000100:00100000:0.0:1788530132.037848:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555752448 00000100:00100000:0.0:1788530132.037854:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555752448 00000100:00100000:0.0:1788530132.037885:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788530132.037900:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e035f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555752576:12345-0@lo:13: 00002000:00000024:0.0:1788530132.037949:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788530132.038524:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e035f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555752576:12345-0@lo:13: Request processed in 626us (5072us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530132.038533:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788530132.038557:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788530132.038606:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e035f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555752448:12345-0@lo:13: 00002000:00000024:0.0:1788530132.038629:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788530132.038662:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e035f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555752448:12345-0@lo:13: Request processed in 70us (5115us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530132.038668:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1788530132.038692:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788530132.038696:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788530132.038952:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e027d8000 x1875409555752448/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530148 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530132.039002:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555752448:0@lo:13: 00000100:00100000:3.0:1788530132.039439:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e035f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875409555752960:0@lo:400: 00000100:00100000:3.0:1788530132.039490:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530132.039517:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e035f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555753472:0@lo:400: 00000100:00100000:3.0:1788530132.039543:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530132.039587:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788530132.039671:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e035f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875409555752832:0@lo:400: 00000100:00100000:3.0:1788530132.039702:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530132.039800:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e035f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875409555753344:0@lo:400: 00000100:00100000:3.0:1788530132.039827:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530132.039847:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e035f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555753856:0@lo:400: 00000100:00100000:3.0:1788530132.039869:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530132.039916:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555752960 00000100:00100000:3.0:1788530132.039923:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555752960 00000100:00100000:3.0:1788530132.040006:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555752832 00000100:00100000:3.0:1788530132.040010:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555752832 00000100:00100000:3.0:1788530132.040024:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555753344 00010000:00080000:0.0:1788530132.040229:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f37426d80 x1875409555752576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530148 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530132.040252:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37426d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555752576:0@lo:13: 00000100:00100000:0.0:1788530132.040273:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e035f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3648:1875409555752704:0@lo:400: 00000100:00100000:0.0:1788530132.040307:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530132.040353:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e035f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875409555753216:0@lo:400: 00000100:00100000:0.0:1788530132.040375:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530132.040386:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e035f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875409555753728:0@lo:400: 00000100:00100000:0.0:1788530132.040425:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530132.040439:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788530132.040445:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e035f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555753088:0@lo:400: 00000100:00100000:0.0:1788530132.040470:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530132.040488:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e035f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875409555753600:0@lo:400: 00000100:00100000:0.0:1788530132.040506:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530132.040526:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555753472 00000100:00100000:0.0:1788530132.040529:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555753472 00000100:00100000:0.0:1788530132.040577:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555753856 00000100:00100000:0.0:1788530132.040581:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555753856 00000100:00100000:3.0:1788530132.041520:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555753344 00000100:00100000:3.0:1788530132.041574:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555753216 00000100:00100000:3.0:1788530132.041578:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555753216 00000100:00100000:3.0:1788530132.041607:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555753728 00000100:00100000:3.0:1788530132.041611:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555753728 00000100:00100000:3.0:1788530132.041624:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555753600 00000100:00100000:3.0:1788530132.041627:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555753600 00000100:00100000:3.0:1788530132.041645:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788530132.041654:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e035f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875409555752960:12345-0@lo:400: 00000100:00100000:0.0:1788530132.041837:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788530132.041847:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e035f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555753472:12345-0@lo:400: 00000100:00100000:3.0:1788530132.041984:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e035f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875409555752960:12345-0@lo:400: Request processed in 331us (2494us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530132.041991:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788530132.042010:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788530132.042016:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e035f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875409555752832:12345-0@lo:400: 00000100:00100000:1.0:1788530132.042138:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788530132.042148:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e035f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875409555753344:12345-0@lo:400: 00000100:00100000:3.0:1788530132.043169:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e035f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875409555752832:12345-0@lo:400: Request processed in 945us (3258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530132.043181:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788530132.043209:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788530132.043219:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37426d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875409555753216:12345-0@lo:400: 00000100:00100000:3.0:1788530132.043274:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37426d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875409555753216:12345-0@lo:400: Request processed in 58us (2898us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530132.043279:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788530132.043292:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788530132.043300:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37425f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875409555753728:12345-0@lo:400: 00000100:00100000:3.0:1788530132.043344:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37425f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875409555753728:12345-0@lo:400: Request processed in 45us (2918us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530132.043349:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788530132.043362:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788530132.043389:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37424000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875409555753600:12345-0@lo:400: 00000100:00100000:3.0:1788530132.043421:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37424000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875409555753600:12345-0@lo:400: Request processed in 34us (2914us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530132.043426:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788530132.043501:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e035f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875409555752832:0@lo:400: 00000100:00100000:0.0:1788530132.043581:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e035f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555753472:12345-0@lo:400: Request processed in 1733us (4034us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530132.043591:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788530132.043702:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788530132.043711:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e035f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555753856:12345-0@lo:400: 00000100:00100000:0.0:1788530132.043832:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e035f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555753856:12345-0@lo:400: Request processed in 124us (3962us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530132.043839:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:0.0:1788530132.043868:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788530132.043874:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788530132.043878:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788530132.043881:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788530132.044459:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788530132.044478:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555753984:0@lo:13: 00000100:00100000:2.0:1788530132.044528:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530132.044851:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e035f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875409555753344:12345-0@lo:400: Request processed in 2700us (5019us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530132.044862:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788530132.044943:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d3fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555754112:0@lo:13: 00000100:00100000:0.0:1788530132.045546:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555753984 00000100:00100000:0.0:1788530132.045555:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555753984 00000100:00100000:2.0:1788530132.045831:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555752704 00000100:00100000:2.0:1788530132.045839:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555752704 00000100:00100000:2.0:1788530132.045920:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1788530132.045930:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+17:3648:x1875409555752704:12345-0@lo:400: 00000100:00100000:0.0:1788530132.046591:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788530132.046614:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555753984:12345-0@lo:13: 00002000:00000024:0.0:1788530132.046648:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00010000:00080000:3.0:1788530132.046870:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e035f7480 x1875409555753344/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530148 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530132.046892:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e035f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875409555753344:0@lo:400: 00010000:00080000:3.0:1788530132.046912:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e035f4a80 x1875409555753856/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788530148 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530132.046921:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e035f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555753856:0@lo:400: 00000100:00100000:3.0:1788530132.046938:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e035f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875409555752960:0@lo:400: 00010000:00080000:3.0:1788530132.046953:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e035f4700 x1875409555753472/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788530148 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530132.046961:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e035f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555753472:0@lo:400: 00000100:00100000:3.0:1788530132.047388:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e035f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875409555753600:0@lo:400: 00000100:00100000:3.0:1788530132.047405:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e035f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875409555753216:0@lo:400: 00010000:00080000:3.0:1788530132.047418:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e035f4380 x1875409555753728/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530148 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530132.047427:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e035f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875409555753728:0@lo:400: 00000100:00100000:3.0:1788530132.047472:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555753088 00000100:00100000:3.0:1788530132.047481:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555753088 00000100:00100000:3.0:1788530132.047536:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788530132.047543:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37424700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555753088:12345-0@lo:400: 00000100:00100000:3.0:1788530132.047761:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37424700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555753088:12345-0@lo:400: Request processed in 217us (7289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530132.047770:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788530132.047814:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e035f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555753088:0@lo:400: 00000100:00100000:1.0:1788530132.048372:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530132.048576:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555754112 00000100:00100000:3.0:1788530132.048582:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555754112 00000100:00100000:3.0:1788530132.048634:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788530132.048643:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d3fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555754112:12345-0@lo:13: 00002000:00000024:3.0:1788530132.048664:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788530132.048727:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d3fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555754112:12345-0@lo:13: Request processed in 74us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530132.048734:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:1.0:1788530132.048817:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f3d3fbb80 x1875409555754112/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530148 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530132.048837:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d3fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555754112:0@lo:13: 00000100:00100000:2.0:1788530132.049346:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+17:3648:x1875409555752704:12345-0@lo:400: Request processed in 3417us (9036us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530132.049356:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1788530132.049448:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e035f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3648:1875409555752704:0@lo:400: 00000100:00100000:0.0:1788530132.049589:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555753984:12345-0@lo:13: Request processed in 2977us (5059us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530132.049662:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:2.0:1788530132.049807:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e027d8000 x1875409555753984/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530148 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530132.049826:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555753984:0@lo:13: 00010000:00010000:0.0:1788530132.169748:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788530132.544721:0:6521:0:(mgc_request.c:715:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788530132.544727:0:6521:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-client-ffff9a9e01aa6000 from 48 10000000:01000000:3.0:1788530132.544731:0:6521:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788530132.544770:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d000/0xb28d70e125750567 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530132.544778:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d000/0xb28d70e125750567 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530132.544787:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d000/0xb28d70e125750567 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530132.544806:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e035f4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555754240:0@lo:101: 00000100:00100000:3.0:1788530132.544868:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530132.545596:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e0327ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1788530132.546994:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555754240 00000100:00100000:0.0:1788530132.547006:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555754240 00000100:00100000:0.0:1788530132.547065:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1788530132.547075:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+17:6521:x1875409555754240:12345-0@lo:101: 00010000:00010000:0.0:1788530132.547095:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530132.547114:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f3d36a000/0xb28d70e12575056e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e125750567 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530132.547141:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f3d36a000/0xb28d70e12575056e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e125750567 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530132.547150:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f3d36a000/0xb28d70e12575056e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125750567 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530132.547157:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d36a000, rc 0) 00000100:00100000:0.0:1788530132.547214:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+18:6521:x1875409555754240:12345-0@lo:101: Request processed in 142us (2346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530132.547219:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1788530132.547774:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e035f4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555754240:0@lo:101: 00010000:00010000:3.0:1788530132.547790:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d000/0xb28d70e125750567 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575056e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530132.547798:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d000/0xb28d70e125750567 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e12575056e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788530132.547941:0:6521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:3.0:1788530132.549798:0:6521:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788530132.550001:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1788530132.550023:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 120 off8536 00000040:00080000:3.0:1788530132.550031:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 168 off8704 00000040:00080000:3.0:1788530132.550038:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8928 00000040:00080000:3.0:1788530132.550046:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9152 00000040:00080000:3.0:1788530132.550053:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 120 off9272 00000040:00080000:3.0:1788530132.550059:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 168 off9440 00000040:00080000:3.0:1788530132.550068:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].8, 224 off9664 00000040:00080000:3.0:1788530132.550081:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].9, 224 off9888 00000040:00080000:3.0:1788530132.550093:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].10, 120 off10008 00000040:00080000:3.0:1788530132.550108:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].11, 224 off10232 00000040:00080000:3.0:1788530132.550121:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].12, 224 off10456 00000040:00080000:3.0:1788530132.550133:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].13, 88 off10544 00000040:00080000:3.0:1788530132.550146:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].14, 128 off10672 00000040:00080000:3.0:1788530132.550159:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].15, 144 off10816 00000040:00080000:3.0:1788530132.550172:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].16, 160 off10976 00000040:00080000:3.0:1788530132.550179:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].17, 224 off11200 00000040:00080000:3.0:1788530132.550187:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].18, 224 off11424 00000040:00080000:3.0:1788530132.550195:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].19, 80 off11504 00000040:00080000:3.0:1788530132.550203:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].20, 224 off11728 00000040:00080000:3.0:1788530132.550217:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].21, 224 off11952 00000040:00080000:3.0:1788530132.551438:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].22, 88 off12040 00000040:00080000:3.0:1788530132.551486:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].23, 128 off12168 00000040:00080000:3.0:1788530132.551504:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].24, 144 off12312 00000040:00080000:3.0:1788530132.551516:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].25, 160 off12472 00000040:00080000:3.0:1788530132.551526:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].26, 224 off12696 00000040:00080000:3.0:1788530132.551536:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].27, 224 off12920 00000040:00080000:3.0:1788530132.551546:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].28, 80 off13000 00000040:00080000:3.0:1788530132.551554:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].29, 224 off13224 00000040:00080000:3.0:1788530132.551577:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].30, 224 off13448 00000040:00080000:3.0:1788530132.551585:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].31, 88 off13536 00000040:00080000:3.0:1788530132.551592:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].32, 128 off13664 00000040:00080000:3.0:1788530132.551600:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].33, 144 off13808 00000040:00080000:3.0:1788530132.551608:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].34, 128 off13936 00000040:00080000:3.0:1788530132.551615:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].35, 224 off14160 00000040:00080000:3.0:1788530132.551623:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].36, 224 off14384 00000040:00080000:3.0:1788530132.551630:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].37, 80 off14464 00000040:00080000:3.0:1788530132.551637:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].38, 224 off14688 00000040:00080000:3.0:1788530132.551644:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].39, 224 off14912 00000040:00080000:3.0:1788530132.551651:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].40, 88 off15000 00000040:00080000:3.0:1788530132.551660:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].41, 128 off15128 00000040:00080000:3.0:1788530132.551667:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].42, 144 off15272 00000040:00080000:3.0:1788530132.551675:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].43, 128 off15400 00000040:00080000:3.0:1788530132.551682:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].44, 224 off15624 00000040:00080000:3.0:1788530132.551690:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].45, 224 off15848 00000040:00080000:3.0:1788530132.551697:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].46, 80 off15928 00000040:00080000:3.0:1788530132.551739:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].47, 224 off16152 00000040:00080000:3.0:1788530132.551744:0:6521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:3.0:1788530132.551858:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e035f4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555754368:0@lo:501: 00000100:00100000:3.0:1788530132.551933:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530132.551978:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e0327ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1788530132.552261:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555754368 00000100:00100000:0.0:1788530132.552271:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555754368 00000100:00100000:0.0:1788530132.552357:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1788530132.552367:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+18:6521:x1875409555754368:12345-0@lo:501: 00000100:00100000:0.0:1788530132.552504:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+18:6521:x1875409555754368:12345-0@lo:501: Request processed in 137us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530132.552520:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1788530132.555450:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e035f4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555754368:0@lo:501: 00000100:00100000:3.0:1788530132.555533:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e035f4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555754496:0@lo:503: 00000100:00100000:3.0:1788530132.556730:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530132.556790:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e0327ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1788530132.557136:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555754496 00000100:00100000:0.0:1788530132.557146:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555754496 00000100:00100000:0.0:1788530132.557209:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1788530132.557220:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+18:6521:x1875409555754496:12345-0@lo:503: 00000100:00100000:0.0:1788530132.557370:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+18:6521:x1875409555754496:12345-0@lo:503: Request processed in 151us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530132.557378:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1788530132.557415:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e035f4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555754496:0@lo:503: 00000040:00080000:3.0:1788530132.558556:0:6521:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788530132.558689:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e035f4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555754624:0@lo:502: 00000100:00100000:3.0:1788530132.558766:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530132.558806:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e0327ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1788530132.558824:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555754624 00000100:00100000:0.0:1788530132.558833:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555754624 00000100:00100000:0.0:1788530132.558880:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1788530132.558889:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+18:6521:x1875409555754624:12345-0@lo:502: 00000100:00100000:0.0:1788530132.560283:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+18:6521:x1875409555754624:12345-0@lo:502: Request processed in 1388us (1510us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530132.560295:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1788530132.560959:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e035f4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555754624:0@lo:502: 00000040:00080000:3.0:1788530132.561208:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1788530132.561264:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 120 off8536 00000040:00080000:3.0:1788530132.561281:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 168 off8704 00000040:00080000:3.0:1788530132.561298:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8928 00000040:00080000:3.0:1788530132.561314:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9152 00000040:00080000:3.0:1788530132.561341:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 120 off9272 00000040:00080000:3.0:1788530132.561357:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 168 off9440 00000040:00080000:3.0:1788530132.561370:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9664 00000040:00080000:3.0:1788530132.561382:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 224 off9888 00000040:00080000:3.0:1788530132.561394:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 120 off10008 00000040:00080000:3.0:1788530132.561406:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10232 00000040:00080000:3.0:1788530132.561417:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 224 off10456 00000040:00080000:3.0:1788530132.561428:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 88 off10544 00000040:00080000:3.0:1788530132.561456:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].14, 128 off10672 00000040:00080000:3.0:1788530132.561470:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].15, 144 off10816 00000040:00080000:3.0:1788530132.561480:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].16, 160 off10976 00000040:00080000:3.0:1788530132.561491:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].17, 224 off11200 00000040:00080000:3.0:1788530132.561502:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].18, 224 off11424 00000040:00080000:3.0:1788530132.561513:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].19, 80 off11504 00000040:00080000:3.0:1788530132.561523:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].20, 224 off11728 00000040:00080000:3.0:1788530132.561542:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].21, 224 off11952 00000040:00080000:3.0:1788530132.561553:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].22, 88 off12040 00000040:00080000:3.0:1788530132.561588:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].23, 128 off12168 00000040:00080000:3.0:1788530132.561600:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].24, 144 off12312 00000040:00080000:3.0:1788530132.561612:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].25, 160 off12472 00000040:00080000:3.0:1788530132.561622:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].26, 224 off12696 00000040:00080000:3.0:1788530132.561635:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].27, 224 off12920 00000040:00080000:3.0:1788530132.561661:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].28, 80 off13000 00000040:00080000:3.0:1788530132.561673:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].29, 224 off13224 00000040:00080000:3.0:1788530132.561697:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].30, 224 off13448 00000040:00080000:3.0:1788530132.561710:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].31, 88 off13536 00000040:00080000:3.0:1788530132.561722:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].32, 128 off13664 00000040:00080000:3.0:1788530132.561734:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].33, 144 off13808 00000040:00080000:3.0:1788530132.561746:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].34, 128 off13936 00000040:00080000:3.0:1788530132.561757:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].35, 224 off14160 00000040:00080000:3.0:1788530132.561769:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].36, 224 off14384 00000040:00080000:3.0:1788530132.561781:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].37, 80 off14464 00000040:00080000:3.0:1788530132.561793:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].38, 224 off14688 00000040:00080000:3.0:1788530132.561804:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].39, 224 off14912 00000040:00080000:3.0:1788530132.561815:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].40, 88 off15000 00000040:00080000:3.0:1788530132.561827:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].41, 128 off15128 00000040:00080000:3.0:1788530132.561838:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].42, 144 off15272 00000040:00080000:3.0:1788530132.561850:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].43, 128 off15400 00000040:00080000:3.0:1788530132.561865:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].44, 224 off15624 00000040:00080000:3.0:1788530132.561878:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].45, 224 off15848 00000040:00080000:3.0:1788530132.561905:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].46, 80 off15928 00000040:00080000:3.0:1788530132.561921:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].47, 224 off16152 00000040:00080000:3.0:1788530132.561934:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].48, 232 off16384 00000100:00100000:3.0:1788530132.561989:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e035f4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555754752:0@lo:502: 00000100:00100000:3.0:1788530132.562067:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530132.562123:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e0327ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1788530132.563202:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555754752 00000100:00100000:0.0:1788530132.563213:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555754752 00000100:00100000:0.0:1788530132.563289:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1788530132.563298:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+18:6521:x1875409555754752:12345-0@lo:502: 00000100:00100000:0.0:1788530132.563485:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+18:6521:x1875409555754752:12345-0@lo:502: Request processed in 187us (1418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530132.563494:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1788530132.564467:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e035f4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555754752:0@lo:502: 00000040:00080000:2.0:1788530132.564731:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].49, 224 off16608 00000040:00080000:2.0:1788530132.564763:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].50, 120 off16728 00000100:00100000:2.0:1788530132.564800:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555754880:0@lo:502: 00000100:00100000:2.0:1788530132.564864:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530132.564911:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f18143c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788530132.565520:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555754880 00000100:00100000:3.0:1788530132.565535:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555754880 00000100:00100000:3.0:1788530132.565599:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1788530132.565619:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+18:6521:x1875409555754880:12345-0@lo:502: 00000100:00100000:3.0:1788530132.565758:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+18:6521:x1875409555754880:12345-0@lo:502: Request processed in 141us (893us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530132.565767:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1788530132.567276:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555754880:0@lo:502: 00000040:00080000:2.0:1788530132.567393:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].51, 224 off16952 00000040:00080000:2.0:1788530132.567410:0:6521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000040:00080000:3.0:1788530132.571673:0:10368:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 52 count 51 00000020:01000000:0.0:1788530132.573638:0:6521:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1788530132.573663:0:6521:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788530132.573676:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d000/0xb28d70e125750567 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575056e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530132.573703:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d000/0xb28d70e125750567 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575056e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788530132.573719:0:6521:0:(mgc_request.c:715:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1788530132.573722:0:6521:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1788530132.573725:0:6521:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788530132.573774:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36bc00/0xb28d70e125750575 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530132.573784:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36bc00/0xb28d70e125750575 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530132.573800:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36bc00/0xb28d70e125750575 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530132.573836:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37427480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555755008:0@lo:101: 00000100:00100000:0.0:1788530132.573926:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530132.573987:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e0328a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788530132.584851:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555755008 00000100:00100000:3.0:1788530132.584878:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555755008 00000100:00100000:3.0:1788530132.585096:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1788530132.585111:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+18:6521:x1875409555755008:12345-0@lo:101: 00010000:00010000:3.0:1788530132.585138:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788530132.585165:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f0c91d200/0xb28d70e12575057c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e125750575 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530132.585206:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f0c91d200/0xb28d70e12575057c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e125750575 expref: 19 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530132.585236:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f0c91d200/0xb28d70e12575057c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125750575 expref: 19 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530132.585248:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f0c91d200, rc 0) 00000100:00100000:3.0:1788530132.585375:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+19:6521:x1875409555755008:12345-0@lo:101: Request processed in 267us (11448us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530132.585383:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1788530132.587374:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37427480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555755008:0@lo:101: 00010000:00010000:2.0:1788530132.587401:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36bc00/0xb28d70e125750575 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575057c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530132.587414:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36bc00/0xb28d70e125750575 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e12575057c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788530132.587609:0:6521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1788530132.587852:0:6521:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788530132.588182:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1788530132.588207:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 128 off8544 00000040:00080000:2.0:1788530132.588227:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 112 off8656 00000040:00080000:2.0:1788530132.588239:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].4, 224 off8880 00000040:00080000:2.0:1788530132.588250:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].5, 224 off9104 00000040:00080000:2.0:1788530132.588261:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].6, 80 off9184 00000040:00080000:2.0:1788530132.588294:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].7, 224 off9408 00000040:00080000:2.0:1788530132.588300:0:6521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1788530132.588382:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555755136:0@lo:501: 00000100:00100000:2.0:1788530132.588441:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530132.588492:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f18143c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788530132.590442:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555755136 00000100:00100000:0.0:1788530132.590480:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555755136 00000100:00100000:0.0:1788530132.590578:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1788530132.590592:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+19:6521:x1875409555755136:12345-0@lo:501: 00000100:00100000:0.0:1788530132.590824:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+19:6521:x1875409555755136:12345-0@lo:501: Request processed in 234us (2381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530132.590834:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1788530132.593960:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555755136:0@lo:501: 00000100:00100000:3.0:1788530132.594055:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e035f5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555755264:0@lo:503: 00000100:00100000:3.0:1788530132.594143:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530132.594713:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e0327c180 going to sleep for 11 seconds 00000100:00100000:1.0:1788530132.599011:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555755264 00000100:00100000:1.0:1788530132.599030:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555755264 00000100:00100000:1.0:1788530132.599096:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1788530132.599106:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f396c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+19:6521:x1875409555755264:12345-0@lo:503: 00000100:00100000:1.0:1788530132.599550:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f396c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+19:6521:x1875409555755264:12345-0@lo:503: Request processed in 443us (5405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530132.599581:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1788530132.599847:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e035f5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555755264:0@lo:503: 00000040:00080000:3.0:1788530132.600556:0:6521:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788530132.600844:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e035f5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555755392:0@lo:502: 00000100:00100000:3.0:1788530132.600991:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530132.601079:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e0327c180 going to sleep for 11 seconds 00000100:00100000:1.0:1788530132.601117:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555755392 00000100:00100000:1.0:1788530132.601125:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555755392 00000100:00100000:1.0:1788530132.601200:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1788530132.601210:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f396c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+19:6521:x1875409555755392:12345-0@lo:502: 00000100:00100000:1.0:1788530132.601347:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f396c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+19:6521:x1875409555755392:12345-0@lo:502: Request processed in 137us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530132.601354:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1788530132.601617:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e035f5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555755392:0@lo:502: 00000040:00080000:3.0:1788530132.601870:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1788530132.601924:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 00000040:00080000:3.0:1788530132.601940:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:3.0:1788530132.601954:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:3.0:1788530132.601992:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:3.0:1788530132.602007:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:3.0:1788530132.602020:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 00000040:00080000:3.0:1788530132.602033:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:3.0:1788530132.602044:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 120 off9752 00000100:00100000:3.0:1788530132.602081:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e035f5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555755520:0@lo:502: 00000100:00100000:3.0:1788530132.602138:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530132.602188:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e0327c180 going to sleep for 11 seconds 00000100:00100000:0.0:1788530132.602611:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555755520 00000100:00100000:0.0:1788530132.602622:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555755520 00000100:00100000:0.0:1788530132.602665:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1788530132.602686:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f396c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+19:6521:x1875409555755520:12345-0@lo:502: 00000100:00100000:0.0:1788530132.602830:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f396c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+19:6521:x1875409555755520:12345-0@lo:502: Request processed in 147us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530132.602840:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1788530132.602905:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e035f5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555755520:0@lo:502: 00000040:00080000:0.0:1788530132.602995:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9976 00000040:00080000:0.0:1788530132.603011:0:6521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:0.0:1788530132.607758:0:10370:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788530132.607774:0:10370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788530132.607777:0:10370:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788530132.607785:0:10370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788530132.607797:0:10370:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788530132.607799:0:10370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788530132.607801:0:10370:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788530132.607804:0:10370:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:0.0:1788530132.607858:0:6521:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1788530132.607872:0:6521:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788530132.607883:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36bc00/0xb28d70e125750575 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575057c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530132.607895:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36bc00/0xb28d70e125750575 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575057c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788530132.607906:0:6521:0:(mgc_request.c:715:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788530132.607909:0:6521:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-sptlrpc-ffff9a9e01aa6000 from 1 10000000:01000000:0.0:1788530132.607912:0:6521:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788530132.607950:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36a600/0xb28d70e125750583 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530132.607959:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36a600/0xb28d70e125750583 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530132.607994:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36a600/0xb28d70e125750583 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530132.608020:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37425c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555755648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788530132.608108:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530132.608154:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e0328a600 going to sleep for 11 seconds 00000100:00100000:0.0:1788530132.608180:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555755648 00000100:00100000:0.0:1788530132.608187:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555755648 00000100:00100000:0.0:1788530132.608228:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1788530132.608238:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f396c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+19:6521:x1875409555755648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788530132.608251:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530132.608266:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f3d36a800/0xb28d70e12575058a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e125750583 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530132.608292:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f3d36a800/0xb28d70e12575058a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e125750583 expref: 20 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530132.608303:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f3d36a800/0xb28d70e12575058a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125750583 expref: 20 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530132.608314:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d36a800, rc 0) 00000100:00100000:0.0:1788530132.608367:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f396c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+20:6521:x1875409555755648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530132.608375:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1788530132.608430:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37425c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555755648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788530132.608445:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36a600/0xb28d70e125750583 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575058a expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530132.608461:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36a600/0xb28d70e125750583 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e12575058a expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530132.608548:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37425c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555755776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788530132.608614:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530132.608648:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e0328a600 going to sleep for 11 seconds 00000100:00100000:0.0:1788530132.608661:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555755776 00000100:00100000:0.0:1788530132.608664:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555755776 00000100:00100000:0.0:1788530132.608684:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1788530132.608691:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f396c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+20:6521:x1875409555755776:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788530132.608771:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f396c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+20:6521:x1875409555755776:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 81us (156us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788530132.608780:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1788530132.608813:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37425c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555755776:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1788530132.608826:0:6521:0:(mgc_request_server.c:748:mgc_llog_local_copy()) MGC192.168.202.141@tcp: no remote llog for lustre-sptlrpc, check MGS config 00000100:00100000:0.0:1788530132.608857:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37425c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555755904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788530132.608883:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530132.608900:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e0328a600 going to sleep for 11 seconds 00000100:00100000:0.0:1788530132.608914:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555755904 00000100:00100000:0.0:1788530132.608918:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555755904 00000100:00100000:0.0:1788530132.608939:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1788530132.608945:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f396c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+20:6521:x1875409555755904:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788530132.608996:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f396c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+20:6521:x1875409555755904:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 50us (112us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788530132.609014:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1788530132.609044:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37425c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555755904:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1788530132.609065:0:6521:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788530132.609073:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36a600/0xb28d70e125750583 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575058a expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530132.609082:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36a600/0xb28d70e125750583 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575058a expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788530132.609094:0:6521:0:(mgc_request.c:715:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788530132.609098:0:6521:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-client-ffff9a9f33b6f800 from 48 10000000:01000000:0.0:1788530132.609101:0:6521:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788530132.609119:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b600/0xb28d70e125750591 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530132.609127:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b600/0xb28d70e125750591 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530132.609135:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b600/0xb28d70e125750591 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530132.609149:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37425c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555756032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788530132.609176:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530132.609191:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e0328a600 going to sleep for 11 seconds 00000100:00100000:0.0:1788530132.609203:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555756032 00000100:00100000:0.0:1788530132.609206:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555756032 00000100:00100000:0.0:1788530132.609225:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1788530132.609231:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f396c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+20:6521:x1875409555756032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788530132.609246:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530132.609257:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f3d36ba00/0xb28d70e125750598 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e125750591 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530132.609276:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f3d36ba00/0xb28d70e125750598 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e125750591 expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530132.609286:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f3d36ba00/0xb28d70e125750598 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125750591 expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530132.609295:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d36ba00, rc 0) 00000100:00100000:0.0:1788530132.609347:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f396c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+21:6521:x1875409555756032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530132.609354:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1788530132.609389:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37425c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555756032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788530132.609402:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b600/0xb28d70e125750591 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125750598 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530132.609411:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b600/0xb28d70e125750591 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e125750598 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788530132.609589:0:6521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 48 count 48 00000040:00080000:0.0:1788530132.609892:0:6521:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788530132.610099:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1788530132.610126:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1788530132.610142:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1788530132.610157:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1788530132.610172:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1788530132.610186:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1788530132.610214:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1788530132.610231:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1788530132.610247:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1788530132.610259:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1788530132.610286:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1788530132.611768:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1788530132.611799:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1788530132.611812:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1788530132.611831:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1788530132.611843:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1788530132.611856:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1788530132.611868:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1788530132.611879:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1788530132.611890:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1788530132.611902:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1788530132.611913:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1788530132.611925:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1788530132.611940:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1788530132.611953:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:0.0:1788530132.612824:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:0.0:1788530132.612911:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:0.0:1788530132.612926:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:0.0:1788530132.612942:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:0.0:1788530132.612955:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:0.0:1788530132.613643:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:0.0:1788530132.613680:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:0.0:1788530132.613697:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:0.0:1788530132.613713:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:0.0:1788530132.613881:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:0.0:1788530132.613902:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:0.0:1788530132.613916:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:0.0:1788530132.613932:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:0.0:1788530132.613947:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:0.0:1788530132.614660:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:0.0:1788530132.614685:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:0.0:1788530132.614700:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:0.0:1788530132.614737:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:0.0:1788530132.614754:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:0.0:1788530132.614769:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:0.0:1788530132.614783:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:0.0:1788530132.614815:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:0.0:1788530132.614822:0:6521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 47 count 48 00000100:00100000:0.0:1788530132.614950:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37425c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555756160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788530132.615304:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530132.615408:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e0328a600 going to sleep for 11 seconds 00000100:00100000:2.0:1788530132.617368:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555756160 00000100:00100000:2.0:1788530132.617383:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555756160 00000100:00100000:2.0:1788530132.617455:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1788530132.617466:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f396c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+21:6521:x1875409555756160:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788530132.617933:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f396c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+21:6521:x1875409555756160:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 467us (2628us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530132.617944:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1788530132.618067:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37425c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555756160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788530132.618132:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37425c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555756288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788530132.618184:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530132.618222:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e0328a600 going to sleep for 11 seconds 00000100:00100000:1.0:1788530132.618310:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555756288 00000100:00100000:1.0:1788530132.618316:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555756288 00000100:00100000:1.0:1788530132.618373:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1788530132.618381:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f396c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+21:6521:x1875409555756288:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788530132.618499:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f396c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+21:6521:x1875409555756288:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 119us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530132.618507:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1788530132.618637:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37425c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555756288:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788530132.619074:0:6521:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788530132.619168:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555756416:0@lo:502:ll_cfg_requeue.0 00000100:00100000:2.0:1788530132.619220:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530132.619262:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f18143d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788530132.619270:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555756416 00000100:00100000:3.0:1788530132.619278:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555756416 00000100:00100000:3.0:1788530132.619342:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1788530132.619351:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f396c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+21:6521:x1875409555756416:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:3.0:1788530132.619479:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f396c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+21:6521:x1875409555756416:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 129us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530132.619486:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1788530132.623724:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555756416:0@lo:502:ll_cfg_requeue.0 00000040:00080000:3.0:1788530132.624107:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1788530132.624148:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1788530132.624162:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1788530132.624174:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1788530132.624186:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1788530132.624199:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1788530132.624212:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1788530132.627738:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1788530132.627804:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1788530132.627818:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1788530132.627833:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1788530132.627869:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1788530132.627884:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1788530132.627897:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1788530132.627911:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1788530132.627924:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1788530132.627937:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1788530132.628028:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1788530132.628043:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1788530132.628056:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1788530132.628069:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1788530132.628082:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1788530132.628096:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1788530132.628112:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1788530132.628127:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:3.0:1788530132.628140:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:3.0:1788530132.628155:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:3.0:1788530132.628180:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:3.0:1788530132.628196:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:3.0:1788530132.628209:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:3.0:1788530132.628222:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:3.0:1788530132.628246:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:3.0:1788530132.628259:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:3.0:1788530132.628273:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:3.0:1788530132.628286:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:3.0:1788530132.628299:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:3.0:1788530132.628314:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:3.0:1788530132.628341:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:3.0:1788530132.628361:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:3.0:1788530132.628376:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:3.0:1788530132.628389:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:3.0:1788530132.628403:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:3.0:1788530132.628416:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:3.0:1788530132.628441:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:3.0:1788530132.628456:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:3.0:1788530132.628469:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:3.0:1788530132.628482:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:3.0:1788530132.628495:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:3.0:1788530132.628556:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e035f4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555756544:0@lo:502:ll_cfg_requeue.0 00000100:00100000:3.0:1788530132.628701:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530132.628758:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555756544 00000100:00100000:3.0:1788530132.628760:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e0327c000 going to sleep for 11 seconds 00000100:00100000:2.0:1788530132.628770:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555756544 00000100:00100000:2.0:1788530132.628843:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1788530132.628855:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f396c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+21:6521:x1875409555756544:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:3.0:1788530132.632648:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f396c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+21:6521:x1875409555756544:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 3770us (3923us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530132.632668:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1788530132.634331:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e035f4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555756544:0@lo:502:ll_cfg_requeue.0 00000040:00080000:2.0:1788530132.634627:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:2.0:1788530132.634662:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:2.0:1788530132.634703:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555756672:0@lo:502:ll_cfg_requeue.0 00000100:00100000:2.0:1788530132.634785:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530132.634830:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f18143780 going to sleep for 11 seconds 00000100:00100000:3.0:1788530132.634850:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555756672 00000100:00100000:3.0:1788530132.634858:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555756672 00000100:00100000:3.0:1788530132.634912:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1788530132.634921:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f396c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+21:6521:x1875409555756672:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:3.0:1788530132.635110:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f396c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+21:6521:x1875409555756672:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 189us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530132.635117:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1788530132.636256:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555756672:0@lo:502:ll_cfg_requeue.0 00000040:00080000:2.0:1788530132.636354:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:2.0:1788530132.636369:0:6521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000040:00080000:0.0:1788530132.644612:0:10372:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:2.0:1788530132.649345:0:6521:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1788530132.649369:0:6521:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788530132.649384:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b600/0xb28d70e125750591 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125750598 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530132.649398:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b600/0xb28d70e125750591 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125750598 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788530132.649414:0:6521:0:(mgc_request.c:715:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1788530132.649417:0:6521:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1788530132.649420:0:6521:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788530132.649466:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f18140400/0xb28d70e12575059f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530132.649474:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f18140400/0xb28d70e12575059f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530132.649487:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f18140400/0xb28d70e12575059f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530132.649519:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555756800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788530132.649624:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530132.649673:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f18143780 going to sleep for 11 seconds 00000100:00100000:1.0:1788530132.649971:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555756800 00000100:00100000:1.0:1788530132.649981:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555756800 00000100:00100000:1.0:1788530132.650048:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1788530132.650057:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f396c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+21:6521:x1875409555756800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788530132.650071:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530132.650085:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9e025dda00/0xb28d70e1257505a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e12575059f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530132.650108:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9e025dda00/0xb28d70e1257505a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e12575059f expref: 22 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530132.650118:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9e025dda00/0xb28d70e1257505a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e12575059f expref: 22 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530132.650127:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9e025dda00, rc 0) 00000100:00100000:1.0:1788530132.650166:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f396c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+22:6521:x1875409555756800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530132.650174:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1788530132.651021:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555756800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788530132.651053:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f18140400/0xb28d70e12575059f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257505a6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530132.651064:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f18140400/0xb28d70e12575059f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e1257505a6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788530132.651253:0:6521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:2.0:1788530132.651542:0:6521:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788530132.651765:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1788530132.651790:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:2.0:1788530132.651805:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:2.0:1788530132.651819:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:2.0:1788530132.651831:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:2.0:1788530132.651844:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:2.0:1788530132.651856:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:2.0:1788530132.651868:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:2.0:1788530132.651895:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:2.0:1788530132.651915:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:2.0:1788530132.651921:0:6521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 11 00000100:00100000:2.0:1788530132.651983:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555756928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788530132.652030:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530132.652069:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f18143780 going to sleep for 11 seconds 00000100:00100000:3.0:1788530132.652652:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555756928 00000100:00100000:3.0:1788530132.652661:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555756928 00000100:00100000:3.0:1788530132.652859:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1788530132.652869:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+22:6521:x1875409555756928:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788530132.653038:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+22:6521:x1875409555756928:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 169us (1006us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530132.653046:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1788530132.653926:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555756928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788530132.654001:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555757056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788530132.654068:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530132.654142:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f18143780 going to sleep for 11 seconds 00000100:00100000:1.0:1788530132.655865:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555757056 00000100:00100000:1.0:1788530132.655880:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555757056 00000100:00100000:1.0:1788530132.655950:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1788530132.655960:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+22:6521:x1875409555757056:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788530132.656123:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+22:6521:x1875409555757056:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 164us (2054us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530132.656137:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1788530132.656484:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555757056:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788530132.656970:0:6521:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788530132.657191:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555757184:0@lo:502:ll_cfg_requeue.0 00000100:00100000:2.0:1788530132.657396:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530132.657497:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f18143780 going to sleep for 11 seconds 00000100:00100000:3.0:1788530132.661380:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555757184 00000100:00100000:3.0:1788530132.661397:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555757184 00000100:00100000:3.0:1788530132.662242:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1788530132.662261:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+22:6521:x1875409555757184:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:3.0:1788530132.662484:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+22:6521:x1875409555757184:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 229us (5087us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530132.662492:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1788530132.662605:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555757184:0@lo:502:ll_cfg_requeue.0 00000040:00080000:0.0:1788530132.662876:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:0.0:1788530132.662921:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:0.0:1788530132.662940:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:0.0:1788530132.662956:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:0.0:1788530132.662992:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:0.0:1788530132.663012:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:0.0:1788530132.663028:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:0.0:1788530132.663046:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:0.0:1788530132.663064:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:0.0:1788530132.663078:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:0.0:1788530132.663373:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:0.0:1788530132.663407:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:0.0:1788530132.663456:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37425c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555757312:0@lo:502:ll_cfg_requeue.0 00000100:00100000:0.0:1788530132.663519:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530132.671600:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555757312 00000100:00100000:2.0:1788530132.671617:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555757312 00000100:00100000:2.0:1788530132.671695:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1788530132.671706:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+22:6521:x1875409555757312:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:2.0:1788530132.671907:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+22:6521:x1875409555757312:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 202us (8386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530132.671916:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1788530132.672861:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e03639000 going to sleep for 11 seconds 00000100:00100000:2.0:1788530132.672902:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37425c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555757312:0@lo:502:ll_cfg_requeue.0 00000040:00080000:2.0:1788530132.672998:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:2.0:1788530132.673013:0:6521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:0.0:1788530132.677985:0:10375:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788530132.677997:0:10375:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788530132.677999:0:10375:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788530132.678005:0:10375:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788530132.678016:0:10375:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788530132.678019:0:10375:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788530132.678020:0:10375:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788530132.678023:0:10375:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:2.0:1788530132.678314:0:6521:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1788530132.678339:0:6521:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788530132.678350:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f18140400/0xb28d70e12575059f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257505a6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530132.678363:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f18140400/0xb28d70e12575059f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257505a6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788530132.678374:0:6521:0:(mgc_request.c:715:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788530132.678377:0:6521:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-sptlrpc-ffff9a9f33b6f800 from 1 10000000:01000000:2.0:1788530132.678380:0:6521:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788530132.678417:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f18140600/0xb28d70e1257505ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530132.678426:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f18140600/0xb28d70e1257505ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530132.678461:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f18140600/0xb28d70e1257505ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530132.678487:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027da300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555757440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788530132.678603:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530132.678652:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f181433c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788530132.678839:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555757440 00000100:00100000:1.0:1788530132.678847:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555757440 00000100:00100000:1.0:1788530132.678902:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1788530132.678913:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+22:6521:x1875409555757440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788530132.678927:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530132.678943:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9e025dd800/0xb28d70e1257505b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e1257505ad expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530132.678972:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9e025dd800/0xb28d70e1257505b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e1257505ad expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530132.678982:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9e025dd800/0xb28d70e1257505b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e1257505ad expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530132.678991:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9e025dd800, rc 0) 00000100:00100000:1.0:1788530132.679044:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+23:6521:x1875409555757440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530132.679051:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1788530132.679361:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027da300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555757440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788530132.679377:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f18140600/0xb28d70e1257505ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257505b4 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530132.679387:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f18140600/0xb28d70e1257505ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e1257505b4 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530132.679526:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37427480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555757568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788530132.679587:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530132.679616:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e03639c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788530132.679677:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555757568 00000100:00100000:1.0:1788530132.679682:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555757568 00000100:00100000:1.0:1788530132.679719:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1788530132.679727:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+23:6521:x1875409555757568:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788530132.679785:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+23:6521:x1875409555757568:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 59us (224us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788530132.679793:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1788530132.679857:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37427480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555757568:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1788530132.679871:0:6521:0:(mgc_request_server.c:748:mgc_llog_local_copy()) MGC192.168.202.141@tcp: no remote llog for lustre-sptlrpc, check MGS config 00000100:00100000:0.0:1788530132.679902:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37427480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555757696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788530132.679925:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530132.680024:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e03639c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788530132.684774:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555757696 00000100:00100000:2.0:1788530132.684789:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555757696 00000100:00100000:2.0:1788530132.685377:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1788530132.685390:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+23:6521:x1875409555757696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788530132.685590:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+23:6521:x1875409555757696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 203us (5663us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788530132.685599:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1788530132.688670:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37427480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555757696:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1788530132.688728:0:6521:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788530132.688743:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f18140600/0xb28d70e1257505ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257505b4 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530132.688754:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f18140600/0xb28d70e1257505ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257505b4 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788530132.688767:0:6521:0:(mgc_request.c:715:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788530132.688769:0:6521:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-client-ffff9a9f32bea000 from 48 10000000:01000000:3.0:1788530132.688773:0:6521:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788530132.688808:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91cc00/0xb28d70e1257505bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530132.688832:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91cc00/0xb28d70e1257505bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530132.688846:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91cc00/0xb28d70e1257505bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530132.688873:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e035f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555757824:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788530132.688954:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530132.689000:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e0327c840 going to sleep for 11 seconds 00000100:00100000:3.0:1788530132.689031:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555757824 00000100:00100000:3.0:1788530132.689039:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555757824 00000100:00100000:3.0:1788530132.689086:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788530132.689095:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+23:6521:x1875409555757824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788530132.689108:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788530132.689121:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f0c91d400/0xb28d70e1257505c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e1257505bb expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530132.689145:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f0c91d400/0xb28d70e1257505c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e1257505bb expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530132.689155:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f0c91d400/0xb28d70e1257505c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e1257505bb expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530132.689165:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f0c91d400, rc 0) 00000100:00100000:3.0:1788530132.689199:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+24:6521:x1875409555757824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530132.689207:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788530132.690400:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e035f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555757824:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788530132.690421:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91cc00/0xb28d70e1257505bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257505c2 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530132.690441:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91cc00/0xb28d70e1257505bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e1257505c2 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788530132.690653:0:6521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 48 count 48 00000040:00080000:3.0:1788530132.690952:0:6521:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788530132.691154:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:3.0:1788530132.691179:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:3.0:1788530132.691195:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:3.0:1788530132.691207:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:3.0:1788530132.691219:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:3.0:1788530132.691233:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:3.0:1788530132.691256:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:3.0:1788530132.691270:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:3.0:1788530132.691283:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:3.0:1788530132.691297:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:3.0:1788530132.691311:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:3.0:1788530132.691338:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:3.0:1788530132.691354:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:3.0:1788530132.691369:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:3.0:1788530132.691383:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:3.0:1788530132.691412:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:3.0:1788530132.691427:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:3.0:1788530132.691440:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:3.0:1788530132.691452:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:3.0:1788530132.691466:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:3.0:1788530132.691482:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:3.0:1788530132.691494:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:3.0:1788530132.691516:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:3.0:1788530132.691531:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:3.0:1788530132.691544:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:3.0:1788530132.691584:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:3.0:1788530132.691603:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:3.0:1788530132.691617:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:3.0:1788530132.691628:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:3.0:1788530132.691642:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:3.0:1788530132.691657:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:3.0:1788530132.691684:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:3.0:1788530132.691702:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:3.0:1788530132.691714:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:3.0:1788530132.691726:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:3.0:1788530132.691739:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:3.0:1788530132.691751:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:3.0:1788530132.691762:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:3.0:1788530132.691774:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:3.0:1788530132.691788:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:3.0:1788530132.691800:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:3.0:1788530132.691812:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:3.0:1788530132.691824:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:3.0:1788530132.691837:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:3.0:1788530132.691851:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:3.0:1788530132.691864:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:3.0:1788530132.691887:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:3.0:1788530132.691893:0:6521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 47 count 48 00000100:00100000:3.0:1788530132.692000:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e035f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555757952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788530132.692061:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530132.692107:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e0327c840 going to sleep for 11 seconds 00000100:00100000:3.0:1788530132.692132:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555757952 00000100:00100000:3.0:1788530132.692139:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555757952 00000100:00100000:3.0:1788530132.692173:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1788530132.692190:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+24:6521:x1875409555757952:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788530132.692307:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+24:6521:x1875409555757952:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 119us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530132.692315:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1788530132.692370:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e035f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555757952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788530132.692402:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e035f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555758080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788530132.692440:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530132.692452:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e0327c840 going to sleep for 11 seconds 00000100:00100000:3.0:1788530132.692463:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555758080 00000100:00100000:3.0:1788530132.692466:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555758080 00000100:00100000:3.0:1788530132.692483:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1788530132.692488:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+24:6521:x1875409555758080:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788530132.692580:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+24:6521:x1875409555758080:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 68us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530132.692588:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1788530132.692622:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e035f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555758080:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788530132.693001:0:6521:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788530132.693078:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e035f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555758208:0@lo:502:ll_cfg_requeue.0 00000100:00100000:3.0:1788530132.693114:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530132.693131:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e0327c840 going to sleep for 11 seconds 00000100:00100000:3.0:1788530132.693147:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555758208 00000100:00100000:3.0:1788530132.693150:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555758208 00000100:00100000:3.0:1788530132.693169:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1788530132.693175:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+24:6521:x1875409555758208:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:3.0:1788530132.693249:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+24:6521:x1875409555758208:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 73us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530132.693261:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1788530132.693297:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e035f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555758208:0@lo:502:ll_cfg_requeue.0 00000040:00080000:3.0:1788530132.697631:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:3.0:1788530132.697693:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:3.0:1788530132.697710:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:3.0:1788530132.697724:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:3.0:1788530132.697738:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:3.0:1788530132.697750:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:3.0:1788530132.697763:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:3.0:1788530132.697776:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:3.0:1788530132.697791:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:3.0:1788530132.697804:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:3.0:1788530132.697817:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:3.0:1788530132.697831:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:3.0:1788530132.697843:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:3.0:1788530132.697855:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:3.0:1788530132.697892:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:3.0:1788530132.697910:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:3.0:1788530132.697922:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:3.0:1788530132.697934:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:3.0:1788530132.697946:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:3.0:1788530132.697961:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:3.0:1788530132.697974:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:3.0:1788530132.697987:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:3.0:1788530132.698000:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:3.0:1788530132.698013:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:3.0:1788530132.698028:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:3.0:1788530132.698042:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:3.0:1788530132.698057:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:3.0:1788530132.698071:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:3.0:1788530132.698096:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:3.0:1788530132.698111:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:3.0:1788530132.698136:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:3.0:1788530132.698151:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:3.0:1788530132.698166:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:3.0:1788530132.698180:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:3.0:1788530132.698196:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:3.0:1788530132.698209:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:3.0:1788530132.698381:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:3.0:1788530132.698401:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:3.0:1788530132.698415:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:3.0:1788530132.698496:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:3.0:1788530132.698520:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:3.0:1788530132.698536:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:3.0:1788530132.698553:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:3.0:1788530132.698641:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:3.0:1788530132.698658:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:3.0:1788530132.698671:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:3.0:1788530132.698699:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:3.0:1788530132.698712:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:3.0:1788530132.698770:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e035f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555758336:0@lo:502:ll_cfg_requeue.0 00000100:00100000:3.0:1788530132.698857:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530132.698936:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e0327c840 going to sleep for 11 seconds 00000100:00100000:1.0:1788530132.699453:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555758336 00000100:00100000:1.0:1788530132.699469:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555758336 00000100:00100000:1.0:1788530132.699538:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1788530132.699551:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+24:6521:x1875409555758336:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788530132.699723:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+24:6521:x1875409555758336:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 174us (866us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530132.699731:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1788530132.701148:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e035f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555758336:0@lo:502:ll_cfg_requeue.0 00000040:00080000:3.0:1788530132.701615:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:3.0:1788530132.701646:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:3.0:1788530132.701688:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e035f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555758464:0@lo:502:ll_cfg_requeue.0 00000100:00100000:3.0:1788530132.701772:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530132.701811:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e0327c840 going to sleep for 11 seconds 00000100:00100000:1.0:1788530132.701915:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555758464 00000100:00100000:1.0:1788530132.701922:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555758464 00000100:00100000:1.0:1788530132.701972:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1788530132.701981:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+24:6521:x1875409555758464:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788530132.702089:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+24:6521:x1875409555758464:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 109us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530132.702097:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1788530132.702345:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e035f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555758464:0@lo:502:ll_cfg_requeue.0 00000040:00080000:3.0:1788530132.702398:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:3.0:1788530132.702408:0:6521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000040:00080000:3.0:1788530132.703219:0:10377:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000020:01000000:1.0:1788530132.704414:0:6521:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1788530132.704442:0:6521:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788530132.704455:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91cc00/0xb28d70e1257505bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257505c2 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530132.704469:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91cc00/0xb28d70e1257505bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257505c2 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788530132.704488:0:6521:0:(mgc_request.c:715:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1788530132.704491:0:6521:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:1.0:1788530132.704494:0:6521:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1788530132.704539:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9e025dc400/0xb28d70e1257505c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530132.704546:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9e025dc400/0xb28d70e1257505c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530132.704592:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9e025dc400/0xb28d70e1257505c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530132.704617:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d3fbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555758592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788530132.704682:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530132.704730:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e0244e900 going to sleep for 11 seconds 00000100:00100000:3.0:1788530132.704841:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555758592 00000100:00100000:3.0:1788530132.704849:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555758592 00000100:00100000:3.0:1788530132.704896:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1788530132.704906:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+24:6521:x1875409555758592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788530132.704921:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788530132.704933:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f0c91c800/0xb28d70e1257505d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e1257505c9 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530132.704959:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f0c91c800/0xb28d70e1257505d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e1257505c9 expref: 25 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530132.704969:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f0c91c800/0xb28d70e1257505d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e1257505c9 expref: 25 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530132.704978:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f0c91c800, rc 0) 00000100:00100000:3.0:1788530132.705020:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+25:6521:x1875409555758592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530132.705027:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1788530132.705106:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d3fbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555758592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788530132.705118:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9e025dc400/0xb28d70e1257505c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257505d0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530132.705128:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9e025dc400/0xb28d70e1257505c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e1257505d0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788530132.705368:0:6521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 43 count 43 00000040:00080000:1.0:1788530132.705751:0:6521:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788530132.705961:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].1, 224 off8416 00000040:00080000:1.0:1788530132.705986:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].2, 136 off8552 00000040:00080000:1.0:1788530132.706000:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].3, 176 off8728 00000040:00080000:1.0:1788530132.706013:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].4, 224 off8952 00000040:00080000:1.0:1788530132.706026:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].5, 224 off9176 00000040:00080000:1.0:1788530132.706038:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].6, 120 off9296 00000040:00080000:1.0:1788530132.706050:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].7, 112 off9408 00000040:00080000:1.0:1788530132.706063:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].8, 160 off9568 00000040:00080000:1.0:1788530132.706076:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].9, 224 off9792 00000040:00080000:1.0:1788530132.706088:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].10, 224 off10016 00000040:00080000:1.0:1788530132.706101:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].11, 88 off10104 00000040:00080000:1.0:1788530132.706113:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].12, 144 off10248 00000040:00080000:1.0:1788530132.706125:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].13, 152 off10400 00000040:00080000:1.0:1788530132.706147:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].14, 168 off10568 00000040:00080000:1.0:1788530132.706159:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].15, 224 off10792 00000040:00080000:1.0:1788530132.706184:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].16, 224 off11016 00000040:00080000:1.0:1788530132.706198:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].17, 80 off11096 00000040:00080000:1.0:1788530132.706212:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].18, 224 off11320 00000040:00080000:1.0:1788530132.706633:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].19, 224 off11544 00000040:00080000:1.0:1788530132.706655:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].20, 160 off11704 00000040:00080000:1.0:1788530132.706668:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].21, 224 off11928 00000040:00080000:1.0:1788530132.706682:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].22, 224 off12152 00000040:00080000:1.0:1788530132.706696:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].23, 80 off12232 00000040:00080000:1.0:1788530132.706711:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].24, 224 off12456 00000040:00080000:1.0:1788530132.706723:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].25, 224 off12680 00000040:00080000:1.0:1788530132.706735:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].26, 88 off12768 00000040:00080000:1.0:1788530132.706747:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].27, 144 off12912 00000040:00080000:1.0:1788530132.706760:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].28, 152 off13064 00000040:00080000:1.0:1788530132.706773:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].29, 136 off13200 00000040:00080000:1.0:1788530132.706787:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].30, 224 off13424 00000040:00080000:1.0:1788530132.706801:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].31, 224 off13648 00000040:00080000:1.0:1788530132.706828:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].32, 80 off13728 00000040:00080000:1.0:1788530132.706844:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].33, 224 off13952 00000040:00080000:1.0:1788530132.706858:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].34, 224 off14176 00000040:00080000:1.0:1788530132.706872:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].35, 88 off14264 00000040:00080000:1.0:1788530132.706883:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].36, 144 off14408 00000040:00080000:1.0:1788530132.706895:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].37, 152 off14560 00000040:00080000:1.0:1788530132.706908:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].38, 136 off14696 00000040:00080000:1.0:1788530132.706921:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].39, 224 off14920 00000040:00080000:1.0:1788530132.706933:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].40, 224 off15144 00000040:00080000:1.0:1788530132.706946:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].41, 80 off15224 00000040:00080000:1.0:1788530132.706967:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].42, 224 off15448 00000040:00080000:1.0:1788530132.706972:0:6521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 42 count 43 00000100:00100000:1.0:1788530132.707072:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d3fbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555758720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788530132.707135:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530132.707721:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e0244e900 going to sleep for 11 seconds 00000100:00100000:3.0:1788530132.707850:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555758720 00000100:00100000:3.0:1788530132.707859:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555758720 00000100:00100000:2.0:1788530132.708749:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1788530132.708761:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+25:6521:x1875409555758720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788530132.708929:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+25:6521:x1875409555758720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 171us (1793us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530132.708937:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1788530132.709084:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d3fbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555758720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788530132.709132:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d3fbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555758848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788530132.709186:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530132.709314:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e0244e900 going to sleep for 11 seconds 00000100:00100000:0.0:1788530132.712389:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555758848 00000100:00100000:0.0:1788530132.712403:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555758848 00000100:00100000:1.0:1788530132.715911:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1788530132.715932:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+25:6521:x1875409555758848:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788530132.716149:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+25:6521:x1875409555758848:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 221us (6962us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530132.716158:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1788530132.716293:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d3fbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555758848:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788530132.718146:0:6521:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788530132.718371:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37426680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555758976:0@lo:502:ll_cfg_requeue.0 00000100:00100000:0.0:1788530132.718513:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530132.723647:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e036399c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788530132.724540:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555758976 00000100:00100000:2.0:1788530132.724555:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555758976 00000100:00100000:2.0:1788530132.724639:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1788530132.724648:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+25:6521:x1875409555758976:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:2.0:1788530132.724859:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+25:6521:x1875409555758976:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 211us (6346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530132.724869:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1788530132.729651:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37426680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555758976:0@lo:502:ll_cfg_requeue.0 00000040:00080000:0.0:1788530132.729955:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].1, 224 off8416 00000040:00080000:0.0:1788530132.729993:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].2, 136 off8552 00000040:00080000:0.0:1788530132.730007:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].3, 176 off8728 00000040:00080000:0.0:1788530132.730019:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].4, 224 off8952 00000040:00080000:0.0:1788530132.730030:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].5, 224 off9176 00000040:00080000:0.0:1788530132.730043:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].6, 120 off9296 00000040:00080000:0.0:1788530132.731949:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].7, 112 off9408 00000040:00080000:0.0:1788530132.732055:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].8, 160 off9568 00000040:00080000:0.0:1788530132.732647:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].9, 224 off9792 00000040:00080000:0.0:1788530132.732664:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].10, 224 off10016 00000040:00080000:0.0:1788530132.732679:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].11, 88 off10104 00000040:00080000:0.0:1788530132.732693:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].12, 144 off10248 00000040:00080000:0.0:1788530132.732706:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].13, 152 off10400 00000040:00080000:0.0:1788530132.732719:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].14, 168 off10568 00000040:00080000:0.0:1788530132.732733:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].15, 224 off10792 00000040:00080000:0.0:1788530132.732771:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].16, 224 off11016 00000040:00080000:0.0:1788530132.732785:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].17, 80 off11096 00000040:00080000:0.0:1788530132.732799:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].18, 224 off11320 00000040:00080000:0.0:1788530132.732812:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].19, 224 off11544 00000040:00080000:0.0:1788530132.732825:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].20, 160 off11704 00000040:00080000:0.0:1788530132.732839:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].21, 224 off11928 00000040:00080000:0.0:1788530132.732852:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].22, 224 off12152 00000040:00080000:0.0:1788530132.732864:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].23, 80 off12232 00000040:00080000:0.0:1788530132.732879:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].24, 224 off12456 00000040:00080000:0.0:1788530132.732902:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].25, 224 off12680 00000040:00080000:0.0:1788530132.732915:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].26, 88 off12768 00000040:00080000:0.0:1788530132.732928:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].27, 144 off12912 00000040:00080000:0.0:1788530132.732941:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].28, 152 off13064 00000040:00080000:0.0:1788530132.732954:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].29, 136 off13200 00000040:00080000:0.0:1788530132.732966:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].30, 224 off13424 00000040:00080000:0.0:1788530132.732978:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].31, 224 off13648 00000040:00080000:0.0:1788530132.733003:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].32, 80 off13728 00000040:00080000:0.0:1788530132.733018:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].33, 224 off13952 00000040:00080000:0.0:1788530132.733031:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].34, 224 off14176 00000040:00080000:0.0:1788530132.733043:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].35, 88 off14264 00000040:00080000:0.0:1788530132.733068:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].36, 144 off14408 00000040:00080000:0.0:1788530132.733086:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].37, 152 off14560 00000040:00080000:0.0:1788530132.733101:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].38, 136 off14696 00000040:00080000:0.0:1788530132.733114:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].39, 224 off14920 00000040:00080000:0.0:1788530132.733127:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].40, 224 off15144 00000040:00080000:0.0:1788530132.733139:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].41, 80 off15224 00000040:00080000:0.0:1788530132.733153:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].42, 224 off15448 00000040:00080000:0.0:1788530132.733166:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].43, 224 off15672 00000040:00080000:0.0:1788530132.733192:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].44, 120 off15792 00000100:00100000:0.0:1788530132.733646:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37426680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555759104:0@lo:502:ll_cfg_requeue.0 00000100:00100000:0.0:1788530132.733739:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530132.733793:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e036399c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788530132.733976:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555759104 00000100:00100000:1.0:1788530132.733986:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555759104 00000100:00100000:1.0:1788530132.734077:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1788530132.734088:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+25:6521:x1875409555759104:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788530132.734424:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+25:6521:x1875409555759104:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 336us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530132.734496:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1788530132.734702:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37426680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555759104:0@lo:502:ll_cfg_requeue.0 00000040:00080000:0.0:1788530132.734790:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].45, 224 off16016 00000040:00080000:0.0:1788530132.734804:0:6521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:3.0:1788530132.741535:0:10378:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788530132.741556:0:10378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788530132.741682:0:10378:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788530132.741857:0:10378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788530132.741876:0:10378:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788530132.741880:0:10378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788530132.741882:0:10378:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788530132.741909:0:10378:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x14:0x0] index 46 count 46 00000020:01000000:1.0:1788530132.748587:0:6521:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:1.0:1788530132.748620:0:6521:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1788530132.748634:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9e025dc400/0xb28d70e1257505c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257505d0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530132.748658:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9e025dc400/0xb28d70e1257505c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257505d0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788530132.748770:0:6521:0:(mgc_request.c:715:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788530132.748775:0:6521:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-sptlrpc-ffff9a9f32bea000 from 1 10000000:01000000:1.0:1788530132.748788:0:6521:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788530132.748829:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9e025dc000/0xb28d70e1257505d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530132.748837:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9e025dc000/0xb28d70e1257505d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530132.748851:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9e025dc000/0xb28d70e1257505d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530132.748883:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d3fad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555759232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788530132.748973:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530132.749027:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555759232 00000100:00100000:1.0:1788530132.749039:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555759232 00000100:00100000:1.0:1788530132.750479:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1788530132.750500:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+25:6521:x1875409555759232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788530132.750526:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530132.750551:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9e025dc200/0xb28d70e1257505de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e1257505d7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530132.750611:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9e025dc200/0xb28d70e1257505de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e1257505d7 expref: 26 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530132.750623:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9e025dc200/0xb28d70e1257505de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e1257505d7 expref: 26 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530132.750631:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9e025dc200, rc 0) 00000100:00100000:1.0:1788530132.750705:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+26:6521:x1875409555759232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 212us (1732us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530132.750711:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1788530132.750780:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e0244e900 going to sleep for 11 seconds 00000100:00100000:1.0:1788530132.750809:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d3fad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555759232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788530132.750829:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9e025dc000/0xb28d70e1257505d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257505de expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530132.750840:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9e025dc000/0xb28d70e1257505d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e1257505de expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530132.750940:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d3fad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555759360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788530132.750972:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530132.750999:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555759360 00000100:00100000:1.0:1788530132.751005:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555759360 00000100:00100000:1.0:1788530132.751033:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1788530132.751039:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+26:6521:x1875409555759360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788530132.751106:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+26:6521:x1875409555759360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 67us (133us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788530132.751112:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1788530132.751130:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e0244e900 going to sleep for 11 seconds 00000100:00100000:1.0:1788530132.751137:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d3fad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555759360:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1788530132.751145:0:6521:0:(mgc_request_server.c:748:mgc_llog_local_copy()) MGC192.168.202.141@tcp: no remote llog for lustre-sptlrpc, check MGS config 00000100:00100000:1.0:1788530132.751166:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d3fad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555759488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788530132.751193:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530132.751205:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555759488 00000100:00100000:1.0:1788530132.751208:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555759488 00000100:00100000:1.0:1788530132.753606:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1788530132.753626:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+26:6521:x1875409555759488:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788530132.753800:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+26:6521:x1875409555759488:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 180us (2604us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788530132.753810:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1788530132.753885:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f0391a180 going to sleep for 11 seconds 00000100:00100000:1.0:1788530132.753913:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d3fad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555759488:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1788530132.753956:0:6521:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788530132.753971:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9e025dc000/0xb28d70e1257505d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257505de expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530132.753983:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9e025dc000/0xb28d70e1257505d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257505de expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788530132.753995:0:6521:0:(mgc_request.c:715:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788530132.753999:0:6521:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-client-ffff9a9f0aaed800 from 48 10000000:01000000:1.0:1788530132.754002:0:6521:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788530132.754043:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9e025dd000/0xb28d70e1257505e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530132.754053:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9e025dd000/0xb28d70e1257505e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530132.754078:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9e025dd000/0xb28d70e1257505e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530132.754099:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d3fad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555759616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788530132.754131:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530132.754158:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f0391a180 going to sleep for 11 seconds 00000100:00100000:3.0:1788530132.754858:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555759616 00000100:00100000:3.0:1788530132.754873:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555759616 00000100:00100000:3.0:1788530132.754938:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1788530132.754947:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+26:6521:x1875409555759616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788530132.754962:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788530132.754980:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f0c91de00/0xb28d70e1257505ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e1257505e5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530132.755012:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f0c91de00/0xb28d70e1257505ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e1257505e5 expref: 27 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530132.755024:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f0c91de00/0xb28d70e1257505ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e1257505e5 expref: 27 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530132.755034:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f0c91de00, rc 0) 00000100:00100000:3.0:1788530132.755101:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+27:6521:x1875409555759616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 155us (969us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530132.755108:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1788530132.755389:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d3fad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555759616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788530132.755417:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9e025dd000/0xb28d70e1257505e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257505ec expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530132.755426:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9e025dd000/0xb28d70e1257505e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e1257505ec expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530132.755555:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d3fad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555759744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788530132.755620:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530132.755652:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f0391a180 going to sleep for 11 seconds 00000100:00100000:3.0:1788530132.757605:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555759744 00000100:00100000:3.0:1788530132.757618:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555759744 00000100:00100000:3.0:1788530132.757670:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1788530132.757680:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+27:6521:x1875409555759744:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788530132.757885:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+27:6521:x1875409555759744:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 205us (2263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530132.757893:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1788530132.758027:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d3fad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555759744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788530132.759340:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d3fad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555759872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788530132.759583:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530132.759637:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f0391a180 going to sleep for 11 seconds 00000100:00100000:3.0:1788530132.759819:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555759872 00000100:00100000:3.0:1788530132.759832:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555759872 00000100:00100000:3.0:1788530132.759898:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1788530132.759918:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+27:6521:x1875409555759872:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788530132.760302:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+27:6521:x1875409555759872:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 385us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530132.760311:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1788530132.760424:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d3fad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555759872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788530132.761372:0:10380:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027daa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:10380:1875409555760000:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788530132.762210:0:10380:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530132.762314:0:10380:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f17635cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788530132.762500:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555760000 00000100:00100000:3.0:1788530132.762508:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555760000 00000100:00100000:3.0:1788530132.762553:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1788530132.762592:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+27:10380:x1875409555760000:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788530132.762757:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+27:10380:x1875409555760000:12345-0@lo:502:llog_process_th.0 Request processed in 196us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530132.762765:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1788530132.763535:0:10380:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027daa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:10380:1875409555760000:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788530132.764412:0:10380:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37426680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:10380:1875409555760128:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788530132.764509:0:10380:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530132.765578:0:10380:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e036399c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788530132.769600:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555760128 00000100:00100000:1.0:1788530132.769623:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555760128 00000100:00100000:1.0:1788530132.769708:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1788530132.769719:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+27:10380:x1875409555760128:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788530132.769920:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+27:10380:x1875409555760128:12345-0@lo:502:llog_process_th.0 Request processed in 201us (5409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530132.769929:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1788530132.770110:0:10380:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37426680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:10380:1875409555760128:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788530132.770149:0:10380:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1788530132.770517:0:6521:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1788530132.770533:0:6521:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788530132.770543:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9e025dd000/0xb28d70e1257505e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257505ec expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530132.770554:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9e025dd000/0xb28d70e1257505e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257505ec expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788530132.770593:0:6521:0:(mgc_request.c:715:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788530132.770597:0:6521:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:1.0:1788530132.770601:0:6521:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788530132.770639:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9e025dd200/0xb28d70e1257505f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530132.770648:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9e025dd200/0xb28d70e1257505f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530132.770659:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9e025dd200/0xb28d70e1257505f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530132.770685:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d3fad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555760256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788530132.770727:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530132.770761:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e0244e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788530132.771673:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555760256 00000100:00100000:0.0:1788530132.771683:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555760256 00000100:00100000:0.0:1788530132.771733:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1788530132.771743:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+27:6521:x1875409555760256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788530132.771758:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530132.771775:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f3d36aa00/0xb28d70e1257505fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e1257505f3 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530132.771804:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f3d36aa00/0xb28d70e1257505fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e1257505f3 expref: 28 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530132.771816:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f3d36aa00/0xb28d70e1257505fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e1257505f3 expref: 28 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530132.771826:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d36aa00, rc 0) 00000100:00100000:0.0:1788530132.771901:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+28:6521:x1875409555760256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 158us (1172us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530132.771909:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1788530132.772031:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d3fad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555760256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788530132.772053:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9e025dd200/0xb28d70e1257505f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257505fa expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530132.772074:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9e025dd200/0xb28d70e1257505f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e1257505fa expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530132.772124:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d3fad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555760384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788530132.772164:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530132.772203:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e0244e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788530132.772432:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555760384 00000100:00100000:0.0:1788530132.772437:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555760384 00000100:00100000:0.0:1788530132.772475:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1788530132.772483:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+28:6521:x1875409555760384:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788530132.772644:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+28:6521:x1875409555760384:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 162us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530132.772651:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1788530132.772742:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d3fad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555760384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788530132.772776:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d3fad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555760512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788530132.772819:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530132.772852:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e0244e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788530132.772903:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555760512 00000100:00100000:0.0:1788530132.772907:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555760512 00000100:00100000:0.0:1788530132.772937:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1788530132.772944:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+28:6521:x1875409555760512:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788530132.773029:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+28:6521:x1875409555760512:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 85us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530132.773037:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1788530132.773354:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d3fad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555760512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788530132.774733:0:10383:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37426680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:10383:1875409555760640:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788530132.774808:0:10383:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530132.774854:0:10383:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e03639e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788530132.775030:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555760640 00000100:00100000:1.0:1788530132.775042:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555760640 00000100:00100000:1.0:1788530132.775166:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1788530132.775184:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+28:10383:x1875409555760640:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788530132.775507:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+28:10383:x1875409555760640:12345-0@lo:502:llog_process_th.0 Request processed in 324us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530132.775515:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1788530132.776201:0:10383:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37426680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:10383:1875409555760640:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788530132.776306:0:10383:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788530132.776316:0:10383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788530132.776327:0:10383:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788530132.776333:0:10383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788530132.776366:0:10383:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37426680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:10383:1875409555760768:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788530132.776412:0:10383:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530132.776438:0:10383:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e03639e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788530132.776493:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555760768 00000100:00100000:1.0:1788530132.776499:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555760768 00000100:00100000:1.0:1788530132.776535:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1788530132.776542:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+28:10383:x1875409555760768:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788530132.776654:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+28:10383:x1875409555760768:12345-0@lo:502:llog_process_th.0 Request processed in 111us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530132.776662:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1788530132.777181:0:10383:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37426680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:10383:1875409555760768:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788530132.777202:0:10383:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788530132.777207:0:10383:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788530132.777209:0:10383:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788530132.777213:0:10383:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1788530132.777987:0:6521:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:1.0:1788530132.777998:0:6521:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788530132.778008:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9e025dd200/0xb28d70e1257505f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257505fa expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530132.778032:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9e025dd200/0xb28d70e1257505f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257505fa expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788530132.778043:0:6521:0:(mgc_request.c:715:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788530132.778046:0:6521:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-sptlrpc-ffff9a9f0aaed800 from 1 10000000:01000000:1.0:1788530132.778049:0:6521:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788530132.778150:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9e025ddc00/0xb28d70e125750601 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530132.778158:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9e025ddc00/0xb28d70e125750601 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530132.778286:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9e025ddc00/0xb28d70e125750601 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530132.779161:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d3fad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555760896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788530132.779310:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530132.779357:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e0244e840 going to sleep for 11 seconds 00000100:00100000:0.0:1788530132.779647:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555760896 00000100:00100000:0.0:1788530132.779655:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555760896 00000100:00100000:0.0:1788530132.779811:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1788530132.779821:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+28:6521:x1875409555760896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788530132.779843:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530132.779858:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f3d36a200/0xb28d70e125750608 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e125750601 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530132.779885:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f3d36a200/0xb28d70e125750608 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e125750601 expref: 29 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530132.779897:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f3d36a200/0xb28d70e125750608 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125750601 expref: 29 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530132.779906:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d36a200, rc 0) 00000100:00100000:0.0:1788530132.779957:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:6521:x1875409555760896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530132.779965:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1788530132.780113:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d3fad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555760896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788530132.780130:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9e025ddc00/0xb28d70e125750601 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125750608 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530132.780139:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9e025ddc00/0xb28d70e125750601 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e125750608 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530132.780186:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e035f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555761024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788530132.780367:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530132.780395:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e0327c840 going to sleep for 11 seconds 00000100:00100000:1.0:1788530132.780589:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555761024 00000100:00100000:1.0:1788530132.780595:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555761024 00000100:00100000:1.0:1788530132.780626:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1788530132.780633:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:6521:x1875409555761024:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788530132.780715:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:6521:x1875409555761024:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 82us (348us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788530132.780722:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1788530132.782013:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e035f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555761024:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1788530132.782041:0:6521:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788530132.782053:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9e025ddc00/0xb28d70e125750601 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125750608 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530132.782079:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9e025ddc00/0xb28d70e125750601 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125750608 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530133.065874:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37426680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555761152:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788530133.065967:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530133.066243:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555761152 00000100:00100000:0.0:1788530133.066252:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555761152 00000100:00100000:0.0:1788530133.066300:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788530133.066310:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e035f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555761152:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788530133.066374:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446453248 avail 1300213760 00000100:00100000:2.0:1788530133.079294:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37426680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555761152:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788530133.079432:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e035f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555761152:12345-0@lo:41:osp-pre-1-0.0 Request processed in 12912us (13254us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530133.079449:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00010000:0.0:1788530133.190332:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788530133.203012:0:10405:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffc0964870 20000000:00000080:3.0:1788530133.203035:0:10405:0:(mgs_handler.c:1172:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a9e035adc00 uarg=0000000000000000 20000000:01000000:3.0:1788530133.203091:0:10405:0:(mgs_llog.c:6198:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788530133.203100:0:10405:0:(mgs_llog.c:4653:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788530133.203109:0:10405:0:(mgs_llog.c:1385:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788530133.204022:0:10406:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:3.0:1788530133.204199:0:10405:0:(mgs_llog.c:4126:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:3.0:1788530133.210739:0:10405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:3.0:1788530133.210789:0:10405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:3.0:1788530133.210808:0:10405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:3.0:1788530133.210829:0:10405:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788530133.210855:0:10405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a9f0c91c200/0xb28d70e12575060f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530133.210877:0:10405:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a9f3d101600/0xb28d70e125750211 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e12575020a expref: 28 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530133.210885:0:10405:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a9f42167800/0xb28d70e12575021f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125750218 expref: 28 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530133.210893:0:10405:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a9f3d100200/0xb28d70e125750281 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e12575027a expref: 28 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530133.210900:0:10405:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a9f18141400/0xb28d70e1257503d1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e1257503ca expref: 28 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530133.210930:0:10405:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a9f18141800/0xb28d70e125750521 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550729 expref: 9 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530133.210941:0:10405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a9f0c91c200/0xb28d70e12575060f lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530133.210997:0:10405:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a9f18141800/0xb28d70e125750521 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550729 expref: 9 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530133.211020:0:10405:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a9f18141800/0xb28d70e125750521 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550729 expref: 9 pid: 6518 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530133.211039:0:10405:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e035f6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10405:1875409555761280:192.168.202.41@tcp:104: 00010000:00010000:3.0:1788530133.211325:0:10405:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a9f18141400/0xb28d70e1257503d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb28d70e1257503ca expref: 28 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530133.211335:0:10405:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a9f18141400/0xb28d70e1257503d1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb28d70e1257503ca expref: 28 pid: 6518 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530133.211346:0:10405:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e035f4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10405:1875409555761408:0@lo:104: 00000100:00100000:3.0:1788530133.211387:0:10405:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788530133.211417:0:10405:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a9f3d100200/0xb28d70e125750281 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb28d70e12575027a expref: 28 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530133.211425:0:10405:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a9f3d100200/0xb28d70e125750281 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb28d70e12575027a expref: 28 pid: 6517 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530133.211433:0:10405:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e035f4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10405:1875409555761536:0@lo:104: 00000100:00100000:3.0:1788530133.211463:0:10405:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788530133.211491:0:10405:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a9f42167800/0xb28d70e12575021f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb28d70e125750218 expref: 28 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530133.211500:0:10405:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a9f42167800/0xb28d70e12575021f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb28d70e125750218 expref: 28 pid: 6517 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530133.211508:0:10405:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e035f5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10405:1875409555761664:0@lo:104: 00000100:00100000:3.0:1788530133.211528:0:10405:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788530133.211552:0:10405:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a9f3d101600/0xb28d70e125750211 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb28d70e12575020a expref: 28 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530133.211587:0:10405:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a9f3d101600/0xb28d70e125750211 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb28d70e12575020a expref: 28 pid: 6518 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530133.211595:0:10405:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e035f5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10405:1875409555761792:0@lo:104: 00000100:00100000:3.0:1788530133.211616:0:10405:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530133.211630:0:10405:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e0327c480 going to sleep for 11 seconds 00000100:00100000:1.0:1788530133.211980:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555761408 00000100:00100000:1.0:1788530133.211988:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555761408 00000100:00100000:1.0:1788530133.212031:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555761536 00000100:00100000:1.0:1788530133.212042:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555761536 00000100:00100000:1.0:1788530133.212055:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555761664 00000100:00100000:1.0:1788530133.212057:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555761664 00000100:00100000:1.0:1788530133.212066:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555761792 00000100:00100000:1.0:1788530133.212068:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555761792 00000100:00100000:1.0:1788530133.212081:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788530133.212089:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e035f7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+6:10405:x1875409555761408:12345-0@lo:104: 00010000:00010000:1.0:1788530133.212103:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d600/0xb28d70e1257503ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e1257503d1 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530133.212165:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788530133.212171:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e035f7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+6:10405:x1875409555761408:12345-0@lo:104: Request processed in 83us (784us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530133.212178:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788530133.212198:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788530133.212205:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e035f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+5:10405:x1875409555761536:12345-0@lo:104: 00010000:00010000:1.0:1788530133.212212:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91ce00/0xb28d70e12575027a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e125750281 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530133.212263:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788530133.212269:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e035f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+5:10405:x1875409555761536:12345-0@lo:104: Request processed in 65us (805us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530133.212275:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788530133.212287:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788530133.212293:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e035f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+4:10405:x1875409555761664:12345-0@lo:104: 00010000:00010000:1.0:1788530133.212300:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff9a9f42167c00/0xb28d70e125750218 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e12575021f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530133.212345:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788530133.212356:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e035f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+4:10405:x1875409555761664:12345-0@lo:104: Request processed in 64us (827us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530133.212363:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788530133.212375:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788530133.212382:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e035f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+3:10405:x1875409555761792:12345-0@lo:104: 00010000:00010000:1.0:1788530133.212390:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff9a9f3d100800/0xb28d70e12575020a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e125750211 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530133.212417:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1788530133.212421:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e035f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+3:10405:x1875409555761792:12345-0@lo:104: Request processed in 41us (805us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530133.212426:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00010000:1.0:1788530133.212443:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788530133.212450:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d600/0xb28d70e1257503ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e1257503d1 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530133.212457:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f0c91d600 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:1.0:1788530133.212462:0:6511:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d600/0xb28d70e1257503ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xb28d70e1257503d1 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530133.212472:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d600/0xb28d70e1257503ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xb28d70e1257503d1 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788530133.212480:0:6511:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d600/0xb28d70e1257503ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xb28d70e1257503d1 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788530133.212486:0:6511:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788530133.212525:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d600/0xb28d70e1257503ca lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e1257503d1 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530133.212542:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788530133.212608:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d600/0xb28d70e1257503ca lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e1257503d1 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530133.212617:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d600/0xb28d70e1257503ca lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e1257503d1 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530133.212636:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788530133.212640:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91ce00/0xb28d70e12575027a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e125750281 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530133.212646:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f0c91ce00 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:1.0:1788530133.212649:0:6511:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91ce00/0xb28d70e12575027a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb28d70e125750281 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530133.212658:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91ce00/0xb28d70e12575027a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb28d70e125750281 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788530133.212664:0:6511:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91ce00/0xb28d70e12575027a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb28d70e125750281 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788530133.212669:0:6511:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788530133.212684:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91ce00/0xb28d70e12575027a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125750281 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530133.212690:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788530133.212697:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91ce00/0xb28d70e12575027a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125750281 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530133.212703:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91ce00/0xb28d70e12575027a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125750281 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530133.212719:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788530133.212722:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f42167c00/0xb28d70e125750218 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e12575021f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530133.212728:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f42167c00 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:1.0:1788530133.212731:0:6511:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f42167c00/0xb28d70e125750218 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb28d70e12575021f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530133.212737:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f42167c00/0xb28d70e125750218 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb28d70e12575021f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788530133.212744:0:6511:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f42167c00/0xb28d70e125750218 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb28d70e12575021f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788530133.212749:0:6511:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788530133.212762:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9f42167c00/0xb28d70e125750218 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e12575021f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530133.212768:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788530133.212784:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f42167c00/0xb28d70e125750218 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e12575021f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530133.212791:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f42167c00/0xb28d70e125750218 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e12575021f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530133.212801:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788530133.212804:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f3d100800/0xb28d70e12575020a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e125750211 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530133.212820:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d100800 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:1.0:1788530133.212823:0:6511:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f3d100800/0xb28d70e12575020a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb28d70e125750211 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530133.212830:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f3d100800/0xb28d70e12575020a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb28d70e125750211 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788530133.212836:0:6511:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f3d100800/0xb28d70e12575020a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb28d70e125750211 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788530133.212841:0:6511:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788530133.212853:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9f3d100800/0xb28d70e12575020a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125750211 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530133.212859:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788530133.212865:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f3d100800/0xb28d70e12575020a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125750211 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530133.212870:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f3d100800/0xb28d70e12575020a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125750211 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530133.212884:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530133.212886:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530133.212888:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788530133.212902:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d3fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3649:1875409555761920:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788530133.212935:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530133.213460:0:10405:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e035f4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10405:1875409555761408:0@lo:104: 00000100:00100000:3.0:1788530133.213473:0:10405:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e035f4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10405:1875409555761536:0@lo:104: 00000100:00100000:3.0:1788530133.213480:0:10405:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e035f5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10405:1875409555761664:0@lo:104: 00000100:00100000:3.0:1788530133.213488:0:10405:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e035f5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10405:1875409555761792:0@lo:104: 00010000:00010000:0.0:1788530133.214660:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530133.214669:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788530133.214685:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555761920 00000100:00100000:0.0:1788530133.214693:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555761920 00000100:00100000:1.0:1788530133.216394:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788530133.216415:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d3fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3649:1875409555762048:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788530133.216536:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530133.216629:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d3f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3647:1875409555762176:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788530133.216655:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530133.216682:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788530133.216689:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d3fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3647:1875409555762304:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788530133.216709:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530133.216824:0:10347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555762048 00000100:00100000:3.0:1788530133.216834:0:10347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555762048 00000100:00100000:2.0:1788530133.218443:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555762176 00000100:00100000:2.0:1788530133.218458:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555762176 00010000:00010000:0.0:1788530133.219416:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a9f18141400/0xb28d70e1257503d1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e1257503ca expref: 31 pid: 6518 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530133.219455:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555762304 00000100:00100000:0.0:1788530133.219460:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555762304 00010000:00010000:3.0:1788530133.219622:0:10347:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a9f3d100200/0xb28d70e125750281 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e12575027a expref: 32 pid: 6517 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530133.219643:0:10347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788530133.219653:0:10347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d3f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+32:3649:x1875409555761920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788530133.219683:0:10347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788530133.219690:0:10347:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a9f18141400/0xb28d70e1257503d1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e1257503ca expref: 32 pid: 6518 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530133.219702:0:10347:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a9f18141400/0xb28d70e1257503d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb28d70e1257503ca expref: 32 pid: 6518 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530133.219721:0:10347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f18141400/0xb28d70e1257503d1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb28d70e1257503ca expref: 32 pid: 6518 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530133.219738:0:10347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788530133.219810:0:10347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d3f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+31:3649:x1875409555761920:12345-0@lo:103:ldlm_bl.0 Request processed in 159us (6874us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530133.219818:0:10347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788530133.219837:0:10347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788530133.219844:0:10347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+30:3649:x1875409555762048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788530133.219851:0:10347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788530133.219856:0:10347:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a9f3d100200/0xb28d70e125750281 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e12575027a expref: 30 pid: 6517 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530133.219865:0:10347:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a9f3d100200/0xb28d70e125750281 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb28d70e12575027a expref: 30 pid: 6517 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530133.219876:0:10347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f3d100200/0xb28d70e125750281 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb28d70e12575027a expref: 30 pid: 6517 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530133.219885:0:10347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788530133.219906:0:10347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:3649:x1875409555762048:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (3371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530133.219921:0:10347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788530133.220032:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d3fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3649:1875409555762048:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788530133.220043:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d3fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3649:1875409555761920:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788530133.222882:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530133.222923:0:10347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531574656 00000100:00100000:1.0:1788530133.222934:0:10347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531574656 00010000:00010000:1.0:1788530133.222989:0:10347:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a9f18141800/0xb28d70e125750521 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550729 expref: 10 pid: 6518 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530133.223021:0:10347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 46 00000100:00100000:1.0:1788530133.223031:0:10347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f396c3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f442bcd-b742-4e76-ad7b-709f731358a0+10:2400:x1875409531574656:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788530133.223046:0:10347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788530133.223052:0:10347:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a9f18141800/0xb28d70e125750521 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550729 expref: 10 pid: 6518 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530133.223066:0:10347:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a9f18141800/0xb28d70e125750521 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550729 expref: 10 pid: 6518 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530133.223086:0:10347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788530133.223144:0:10347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f396c3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f442bcd-b742-4e76-ad7b-709f731358a0+10:2400:x1875409531574656:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 115us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530133.223173:0:10347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 46 00010000:00010000:3.0:1788530133.223371:0:10405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f18141800/0xb28d70e125750521 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550729 expref: 9 pid: 6518 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530133.223386:0:10405:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e035f6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10405:1875409555761280:192.168.202.41@tcp:104: 00010000:00010000:3.0:1788530133.223422:0:10405:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a9f0c91c200/0xb28d70e12575060f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530133.223710:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a9f42167800/0xb28d70e12575021f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e125750218 expref: 28 pid: 6517 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530133.223853:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788530133.223919:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+28:3647:x1875409555762176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788530133.223933:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788530133.223939:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a9f42167800/0xb28d70e12575021f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e125750218 expref: 28 pid: 6517 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530133.223949:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a9f42167800/0xb28d70e12575021f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb28d70e125750218 expref: 28 pid: 6517 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530133.223962:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f42167800/0xb28d70e12575021f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb28d70e125750218 expref: 28 pid: 6517 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530133.223975:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788530133.224031:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+27:3647:x1875409555762176:12345-0@lo:103:ldlm_bl.0 Request processed in 171us (7375us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530133.224038:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788530133.224099:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d3f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3647:1875409555762176:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788530133.226026:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a9f3d101600/0xb28d70e125750211 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e12575020a expref: 26 pid: 6518 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530133.226074:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788530133.226091:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2a1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+26:3647:x1875409555762304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788530133.226107:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788530133.226113:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a9f3d101600/0xb28d70e125750211 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e12575020a expref: 26 pid: 6518 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530133.226125:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a9f3d101600/0xb28d70e125750211 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb28d70e12575020a expref: 26 pid: 6518 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530133.226144:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f3d101600/0xb28d70e125750211 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb28d70e12575020a expref: 26 pid: 6518 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530133.226162:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a9f0c91c200/0xb28d70e12575060f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530133.226171:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f0c91c200/0xb28d70e12575060f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530133.226189:0:6510:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a9f0c91c200/0xb28d70e12575060f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530133.226197:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a9f0c91c200/0xb28d70e12575060f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530133.226357:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a9f0c91c200/0xb28d70e12575060f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530133.226367:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a9f0c91c200/0xb28d70e12575060f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530133.226375:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f0c91c200 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:0.0:1788530133.226380:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a9f0c91c200/0xb28d70e12575060f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530133.226389:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a9f0c91c200/0xb28d70e12575060f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530133.226409:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a9f0c91c200/0xb28d70e12575060f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530133.226421:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788530133.226538:0:10405:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a9f0c91c200/0xb28d70e12575060f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530133.226548:0:10405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a9f0c91c200/0xb28d70e12575060f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530133.226585:0:10405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f0c91c200/0xb28d70e12575060f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530133.227755:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2a1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+25:3647:x1875409555762304:12345-0@lo:103:ldlm_bl.0 Request processed in 1663us (11035us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530133.227767:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788530133.234644:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d3fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3647:1875409555762304:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788530134.213135:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788530134.404341:0:6521:0:(mgc_request.c:715:do_requeue()) updating log params 10000000:01000000:0.0:1788530134.404352:0:6521:0:(mgc_request.c:2194:mgc_process_log()) Process log params-ffff9a9e01aa6000 from 4 10000000:01000000:0.0:1788530134.404358:0:6521:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788530134.404411:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b800/0xb28d70e125750616 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530134.404424:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b800/0xb28d70e125750616 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530134.404438:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b800/0xb28d70e125750616 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530134.404479:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37425180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555762432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788530134.404606:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530134.404658:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e03639840 going to sleep for 11 seconds 00000100:00100000:2.0:1788530134.404721:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555762432 00000100:00100000:2.0:1788530134.404732:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555762432 00000100:00100000:2.0:1788530134.404803:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1788530134.404824:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+25:6521:x1875409555762432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788530134.404842:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530134.404859:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f18141800/0xb28d70e12575061d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e125750616 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530134.404885:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f18141800/0xb28d70e12575061d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e125750616 expref: 26 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530134.404896:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f18141800/0xb28d70e12575061d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125750616 expref: 26 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530134.404905:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f18141800, rc 0) 00000100:00100000:2.0:1788530134.404949:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+26:6521:x1875409555762432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530134.404956:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1788530134.406137:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37425180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555762432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788530134.406158:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b800/0xb28d70e125750616 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575061d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530134.406169:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b800/0xb28d70e125750616 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e12575061d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788530134.406352:0:6521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1788530134.406610:0:6521:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788530134.406778:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1788530134.406803:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 112 off8528 00000040:00080000:0.0:1788530134.406837:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 224 off8752 00000040:00080000:0.0:1788530134.406843:0:6521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1788530134.406898:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37425180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555762560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788530134.406947:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530134.406988:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e03639840 going to sleep for 11 seconds 00000100:00100000:1.0:1788530134.407010:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555762560 00000100:00100000:1.0:1788530134.407016:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555762560 00000100:00100000:1.0:1788530134.407053:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1788530134.407061:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+26:6521:x1875409555762560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788530134.407158:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+26:6521:x1875409555762560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 97us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530134.407166:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1788530134.408455:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37425180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555762560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788530134.408511:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37425180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555762688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788530134.413511:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530134.413605:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e03639840 going to sleep for 11 seconds 00000100:00100000:1.0:1788530134.415762:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555762688 00000100:00100000:1.0:1788530134.415779:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555762688 00000100:00100000:1.0:1788530134.415859:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1788530134.415870:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+26:6521:x1875409555762688:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788530134.416066:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+26:6521:x1875409555762688:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 197us (2568us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530134.416074:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1788530134.419327:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37425180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555762688:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788530134.419827:0:6521:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788530134.419923:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37425180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555762816:0@lo:502:ll_cfg_requeue.0 00000100:00100000:0.0:1788530134.420006:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530134.420046:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e03639840 going to sleep for 11 seconds 00000100:00100000:1.0:1788530134.420231:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555762816 00000100:00100000:1.0:1788530134.420238:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555762816 00000100:00100000:1.0:1788530134.420289:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1788530134.420299:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+26:6521:x1875409555762816:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788530134.420418:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+26:6521:x1875409555762816:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 121us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530134.420427:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1788530134.423105:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37425180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555762816:0@lo:502:ll_cfg_requeue.0 00000040:00080000:0.0:1788530134.423465:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1788530134.423506:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:0.0:1788530134.423522:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:0.0:1788530134.423536:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:0.0:1788530134.423549:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000100:00100000:0.0:1788530134.423622:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37425180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555762944:0@lo:502:ll_cfg_requeue.0 00000100:00100000:0.0:1788530134.423713:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530134.423764:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e03639840 going to sleep for 11 seconds 00000100:00100000:1.0:1788530134.424121:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555762944 00000100:00100000:1.0:1788530134.424129:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555762944 00000100:00100000:1.0:1788530134.424194:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1788530134.424217:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+26:6521:x1875409555762944:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788530134.424377:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+26:6521:x1875409555762944:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 163us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530134.424385:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1788530134.424521:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37425180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555762944:0@lo:502:ll_cfg_requeue.0 00000040:00080000:0.0:1788530134.428976:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:0.0:1788530134.429068:0:6521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 6 count 7 00000020:01000000:0.0:1788530134.435539:0:10428:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788530134.435557:0:10428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788530134.435586:0:10428:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788530134.435597:0:10428:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a9e01aa6000 00000020:00000080:0.0:1788530134.435600:0:10428:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788530134.435686:0:10428:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788530134.435691:0:10428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788530134.435692:0:10428:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788530134.435695:0:10428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 7 00000020:01000000:1.0:1788530134.438198:0:6521:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1788530134.438234:0:6521:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788530134.438247:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b800/0xb28d70e125750616 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575061d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530134.438259:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b800/0xb28d70e125750616 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575061d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788530134.438276:0:6521:0:(mgc_request.c:715:do_requeue()) updating log params 10000000:01000000:1.0:1788530134.438278:0:6521:0:(mgc_request.c:2194:mgc_process_log()) Process log params-ffff9a9f33b6f800 from 4 10000000:01000000:1.0:1788530134.438282:0:6521:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788530134.438328:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9e025dc600/0xb28d70e125750624 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530134.438337:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9e025dc600/0xb28d70e125750624 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530134.438349:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9e025dc600/0xb28d70e125750624 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530134.438375:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2a3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555763072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788530134.438444:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530134.438488:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555763072 00000100:00100000:1.0:1788530134.438496:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555763072 00000100:00100000:1.0:1788530134.438544:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1788530134.438554:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+26:6521:x1875409555763072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788530134.438596:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530134.438609:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9e025dc800/0xb28d70e12575062b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e125750624 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530134.438633:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9e025dc800/0xb28d70e12575062b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e125750624 expref: 27 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530134.438654:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9e025dc800/0xb28d70e12575062b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125750624 expref: 27 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530134.438663:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9e025dc800, rc 0) 00000100:00100000:1.0:1788530134.438695:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+27:6521:x1875409555763072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530134.438702:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1788530134.438747:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f396d5f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788530134.438767:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2a3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555763072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788530134.438780:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9e025dc600/0xb28d70e125750624 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575062b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530134.438787:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9e025dc600/0xb28d70e125750624 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e12575062b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788530134.439089:0:6521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1788530134.439769:0:6521:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788530134.440323:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:1.0:1788530134.440353:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:1.0:1788530134.440374:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:1.0:1788530134.440380:0:6521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1788530134.440468:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2a3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555763200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788530134.440536:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530134.440612:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555763200 00000100:00100000:1.0:1788530134.440619:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555763200 00000100:00100000:1.0:1788530134.441773:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1788530134.441784:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+27:6521:x1875409555763200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788530134.441961:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+27:6521:x1875409555763200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 179us (1424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530134.441969:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1788530134.442744:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f396d5f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788530134.442777:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2a3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555763200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788530134.443165:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2a3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555763328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788530134.443451:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530134.443494:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555763328 00000100:00100000:1.0:1788530134.443500:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555763328 00000100:00100000:1.0:1788530134.443539:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1788530134.443546:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+27:6521:x1875409555763328:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788530134.444117:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+27:6521:x1875409555763328:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 570us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530134.444125:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1788530134.444178:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f396d5f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788530134.444199:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2a3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555763328:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788530134.451125:0:6521:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788530134.451242:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2a3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555763456:0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788530134.451337:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530134.451394:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f396d5f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788530134.452074:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555763456 00000100:00100000:3.0:1788530134.452085:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555763456 00000100:00100000:3.0:1788530134.452140:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1788530134.452150:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+27:6521:x1875409555763456:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:3.0:1788530134.452276:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+27:6521:x1875409555763456:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 127us (938us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530134.452285:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1788530134.452385:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2a3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555763456:0@lo:502:ll_cfg_requeue.0 00000040:00080000:1.0:1788530134.452607:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:1.0:1788530134.452640:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:1.0:1788530134.452723:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:1.0:1788530134.452738:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:1.0:1788530134.452752:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000100:00100000:1.0:1788530134.452781:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2a3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555763584:0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788530134.453753:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530134.453790:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f396d5f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788530134.454806:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555763584 00000100:00100000:3.0:1788530134.454825:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555763584 00000100:00100000:3.0:1788530134.454883:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:3.0:1788530134.454895:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+27:6521:x1875409555763584:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:3.0:1788530134.456203:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+27:6521:x1875409555763584:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 1305us (2447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530134.456214:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1788530134.456358:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2a3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555763584:0@lo:502:ll_cfg_requeue.0 00000040:00080000:1.0:1788530134.456442:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:1.0:1788530134.456457:0:6521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 6 count 7 00000020:01000000:1.0:1788530134.464739:0:10431:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788530134.464753:0:10431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788530134.464756:0:10431:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788530134.464765:0:10431:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a9f33b6f800 00000020:00000080:1.0:1788530134.464768:0:10431:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788530134.470465:0:10431:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788530134.470483:0:10431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788530134.470485:0:10431:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788530134.470491:0:10431:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 7 count 7 00000020:01000000:1.0:1788530134.470695:0:6521:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1788530134.470713:0:6521:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788530134.470730:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9e025dc600/0xb28d70e125750624 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575062b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530134.470744:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9e025dc600/0xb28d70e125750624 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575062b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788530134.470767:0:6521:0:(mgc_request.c:715:do_requeue()) updating log params 10000000:01000000:1.0:1788530134.470780:0:6521:0:(mgc_request.c:2194:mgc_process_log()) Process log params-ffff9a9f32bea000 from 4 10000000:01000000:1.0:1788530134.470784:0:6521:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788530134.470841:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9e025dce00/0xb28d70e125750632 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530134.470850:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9e025dce00/0xb28d70e125750632 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530134.470865:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9e025dce00/0xb28d70e125750632 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530134.470904:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2a3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555763712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788530134.471009:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530134.471054:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555763712 00000100:00100000:1.0:1788530134.471063:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555763712 00000100:00100000:1.0:1788530134.471112:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1788530134.471121:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+27:6521:x1875409555763712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788530134.471133:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530134.471145:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9e025dde00/0xb28d70e125750639 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e125750632 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530134.471168:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9e025dde00/0xb28d70e125750639 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e125750632 expref: 28 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530134.471179:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9e025dde00/0xb28d70e125750639 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125750632 expref: 28 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530134.471187:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9e025dde00, rc 0) 00000100:00100000:1.0:1788530134.471217:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+28:6521:x1875409555763712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 98us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530134.471235:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1788530134.471280:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f396d5f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788530134.471301:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2a3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555763712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788530134.471328:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9e025dce00/0xb28d70e125750632 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125750639 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530134.471337:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9e025dce00/0xb28d70e125750632 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e125750639 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788530134.471481:0:6521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788530134.471814:0:6521:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788530134.472051:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].1, 224 off8416 00000040:00080000:1.0:1788530134.472075:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].2, 112 off8528 00000040:00080000:1.0:1788530134.472092:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].3, 224 off8752 00000040:00080000:1.0:1788530134.472097:0:6521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 3 count 4 00000100:00100000:1.0:1788530134.472150:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2a3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555763840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788530134.472187:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530134.472219:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555763840 00000100:00100000:1.0:1788530134.472224:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555763840 00000100:00100000:1.0:1788530134.472253:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1788530134.472260:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+28:6521:x1875409555763840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788530134.476985:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+28:6521:x1875409555763840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 4710us (4782us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530134.477728:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1788530134.478067:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f396d5f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788530134.478106:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2a3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555763840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788530134.478194:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2a3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555763968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788530134.480067:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530134.480133:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f396d5f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788530134.480250:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555763968 00000100:00100000:0.0:1788530134.480259:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555763968 00000100:00100000:0.0:1788530134.480319:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1788530134.480329:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+28:6521:x1875409555763968:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788530134.480470:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+28:6521:x1875409555763968:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 141us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530134.480485:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1788530134.483481:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2a3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555763968:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788530134.484048:0:6521:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788530134.484143:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2a3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555764096:0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788530134.484230:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530134.484276:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555764096 00000100:00100000:1.0:1788530134.484282:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555764096 00000100:00100000:1.0:1788530134.484335:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1788530134.484344:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+28:6521:x1875409555764096:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788530134.484457:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+28:6521:x1875409555764096:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 113us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530134.484465:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1788530134.484523:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f396d5f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788530134.484536:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2a3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555764096:0@lo:502:ll_cfg_requeue.0 00000040:00080000:1.0:1788530134.484717:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].1, 224 off8416 00000040:00080000:1.0:1788530134.484741:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].2, 112 off8528 00000040:00080000:1.0:1788530134.484752:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].3, 224 off8752 00000040:00080000:1.0:1788530134.484764:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].4, 224 off8976 00000040:00080000:1.0:1788530134.484775:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].5, 112 off9088 00000100:00100000:1.0:1788530134.484793:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2a3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555764224:0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788530134.484821:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530134.484840:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555764224 00000100:00100000:1.0:1788530134.484843:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555764224 00000100:00100000:1.0:1788530134.484868:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1788530134.484874:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+28:6521:x1875409555764224:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788530134.484925:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+28:6521:x1875409555764224:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 51us (103us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530134.484931:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1788530134.484954:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f396d5f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788530134.484964:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2a3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555764224:0@lo:502:ll_cfg_requeue.0 00000040:00080000:1.0:1788530134.484990:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].6, 224 off9312 00000040:00080000:1.0:1788530134.484996:0:6521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 6 count 7 00000020:01000000:1.0:1788530134.493139:0:10433:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788530134.493151:0:10433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788530134.493154:0:10433:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788530134.493163:0:10433:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a9f32bea000 00000020:00000080:1.0:1788530134.493166:0:10433:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788530134.493255:0:10433:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788530134.493260:0:10433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788530134.493261:0:10433:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788530134.493264:0:10433:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x16:0x0] index 7 count 7 00000020:01000000:1.0:1788530134.493318:0:6521:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1788530134.493336:0:6521:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788530134.493349:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9e025dce00/0xb28d70e125750632 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125750639 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530134.493363:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9e025dce00/0xb28d70e125750632 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125750639 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788530134.493377:0:6521:0:(mgc_request.c:715:do_requeue()) updating log params 10000000:01000000:1.0:1788530134.493380:0:6521:0:(mgc_request.c:2194:mgc_process_log()) Process log params-ffff9a9f0aaed800 from 4 10000000:01000000:1.0:1788530134.493383:0:6521:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788530134.493436:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9e025dcc00/0xb28d70e125750640 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530134.493453:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9e025dcc00/0xb28d70e125750640 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530134.493467:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9e025dcc00/0xb28d70e125750640 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530134.493496:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2a3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555764352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788530134.493590:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530134.493628:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555764352 00000100:00100000:1.0:1788530134.493635:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555764352 00000100:00100000:1.0:1788530134.493675:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1788530134.493684:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+28:6521:x1875409555764352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788530134.493695:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530134.493706:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9e025dd600/0xb28d70e125750647 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e125750640 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530134.493728:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9e025dd600/0xb28d70e125750647 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e125750640 expref: 29 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530134.493739:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9e025dd600/0xb28d70e125750647 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125750640 expref: 29 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530134.493747:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9e025dd600, rc 0) 00000100:00100000:1.0:1788530134.493779:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:6521:x1875409555764352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 96us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530134.493785:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1788530134.493839:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f396d5f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788530134.493865:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2a3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555764352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788530134.493879:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9e025dcc00/0xb28d70e125750640 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125750647 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530134.493887:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9e025dcc00/0xb28d70e125750640 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e125750647 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530134.493919:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2a3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555764480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788530134.493942:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530134.493961:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555764480 00000100:00100000:1.0:1788530134.493965:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555764480 00000100:00100000:1.0:1788530134.493986:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1788530134.493992:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:6521:x1875409555764480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788530134.494089:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:6521:x1875409555764480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 97us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530134.494096:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1788530134.494118:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f396d5f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788530134.494129:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2a3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555764480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788530134.494155:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2a3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555764608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788530134.494199:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530134.494216:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555764608 00000100:00100000:1.0:1788530134.494220:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555764608 00000100:00100000:1.0:1788530134.494241:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1788530134.494247:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:6521:x1875409555764608:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788530134.494335:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:6521:x1875409555764608:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 88us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530134.494351:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1788530134.494382:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f396d5f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788530134.494393:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2a3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555764608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788530134.496494:0:10434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2a3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:10434:1875409555764736:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788530134.496611:0:10434:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530134.496652:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555764736 00000100:00100000:1.0:1788530134.496659:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555764736 00000100:00100000:1.0:1788530134.496706:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:1.0:1788530134.496715:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f396c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:10434:x1875409555764736:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788530134.497984:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f396c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:10434:x1875409555764736:12345-0@lo:502:llog_process_th.0 Request processed in 1263us (1366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530134.499911:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:1.0:1788530134.500008:0:10434:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e0327c780 going to sleep for 11 seconds 00000100:00100000:1.0:1788530134.500036:0:10434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2a3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:10434:1875409555764736:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788530134.500072:0:10434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788530134.500082:0:10434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788530134.500084:0:10434:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788530134.500091:0:10434:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a9f0aaed800 00000020:00000080:1.0:1788530134.500093:0:10434:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788530134.500164:0:10434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2a3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:10434:1875409555764864:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788530134.500347:0:10434:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530134.500379:0:10434:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e0327c780 going to sleep for 11 seconds 00000100:00100000:2.0:1788530134.500445:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555764864 00000100:00100000:2.0:1788530134.500451:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555764864 00000100:00100000:2.0:1788530134.500509:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1788530134.500518:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f396c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:10434:x1875409555764864:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788530134.500647:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f396c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:10434:x1875409555764864:12345-0@lo:502:llog_process_th.0 Request processed in 130us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530134.500655:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1788530134.500731:0:10434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2a3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:10434:1875409555764864:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788530134.500748:0:10434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788530134.500756:0:10434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788530134.500758:0:10434:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788530134.500761:0:10434:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788530134.500987:0:6521:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788530134.501046:0:6521:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788530134.501056:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9e025dcc00/0xb28d70e125750640 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125750647 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530134.501068:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9e025dcc00/0xb28d70e125750640 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125750647 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530134.508777:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530134.508836:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530134.508983:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530134.509021:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530134.509047:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530134.509076:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531575040 00000100:00100000:0.0:1788530134.509086:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531575040 00000100:00100000:0.0:1788530134.509151:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531574912 00000100:00100000:0.0:1788530134.509154:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531574912 00000100:00100000:0.0:1788530134.509178:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 83 00000100:00100000:0.0:1788530134.509190:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37425180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2399:x1875409531575040:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1788530134.509272:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37425180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2399:x1875409531575040:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 84us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530134.509280:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 83 00000100:00100000:0.0:1788530134.509300:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 84 00000100:00100000:0.0:1788530134.509317:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37424e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:2399:x1875409531574912:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1788530134.509342:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37424e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:2399:x1875409531574912:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 27us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530134.509349:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 84 00000100:00100000:0.0:1788530134.509376:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531575296 00000100:00100000:0.0:1788530134.509380:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531575296 00000100:00100000:0.0:1788530134.509407:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531575168 00000100:00100000:0.0:1788530134.509411:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531575168 00000100:00100000:0.0:1788530134.509431:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 21 00000100:00100000:0.0:1788530134.509438:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37427b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2399:x1875409531575296:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1788530134.509479:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37427b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2399:x1875409531575296:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 41us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530134.509486:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 21 00000100:00100000:0.0:1788530134.509497:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 22 00000100:00100000:0.0:1788530134.509504:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37427100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2399:x1875409531575168:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1788530134.509525:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37427100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2399:x1875409531575168:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 21us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530134.509531:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 22 00000100:00080000:0.0:1788530134.509555:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788530134.509593:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788530134.509596:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788530134.509599:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788530134.509936:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531574784 00000100:00100000:2.0:1788530134.509941:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531574784 00000100:00100000:2.0:1788530134.509981:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 309 00000100:00100000:2.0:1788530134.510041:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f396c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f442bcd-b742-4e76-ad7b-709f731358a0+9:2399:x1875409531574784:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1788530134.510923:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f396c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f442bcd-b742-4e76-ad7b-709f731358a0+9:2399:x1875409531574784:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 931us (2152us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530134.510933:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 309 00000100:00100000:2.0:1788530135.230700:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530135.230739:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531575424 00000100:00100000:2.0:1788530135.230749:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531575424 00000100:00100000:2.0:1788530135.230797:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 310 00000100:00100000:2.0:1788530135.230808:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f396c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f442bcd-b742-4e76-ad7b-709f731358a0+9:6178:x1875409531575424:12345-192.168.202.41@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788530135.230824:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530135.230841:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f18140e00/0xb28d70e12575064e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1406819a55076f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530135.230879:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f18140e00/0xb28d70e12575064e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a55076f expref: 10 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530135.230892:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f18140e00/0xb28d70e12575064e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a55076f expref: 10 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530135.230902:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f18140e00, rc 0) 00000100:00100000:2.0:1788530135.230965:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f396c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f442bcd-b742-4e76-ad7b-709f731358a0+10:6178:x1875409531575424:12345-192.168.202.41@tcp:101:ll_cfg_requeue.0 Request processed in 158us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530135.230972:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 310 00000100:00100000:3.0:1788530135.239443:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00010000:00010000:3.0:1788530135.239470:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788530135.239485:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531575552 00000100:00100000:3.0:1788530135.239495:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531575552 00000100:00100000:3.0:1788530135.239548:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 311 00000100:00100000:3.0:1788530135.244470:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f396c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f442bcd-b742-4e76-ad7b-709f731358a0+10:6178:x1875409531575552:12345-192.168.202.41@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788530135.244715:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f396c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f442bcd-b742-4e76-ad7b-709f731358a0+10:6178:x1875409531575552:12345-192.168.202.41@tcp:501:ll_cfg_requeue.0 Request processed in 5149us (5275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530135.244737:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 311 00000100:00100000:2.0:1788530135.256110:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530135.256234:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531575680 00000100:00100000:3.0:1788530135.256247:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531575680 00000100:00100000:3.0:1788530135.256317:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 312 00000100:00100000:3.0:1788530135.256328:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f396c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f442bcd-b742-4e76-ad7b-709f731358a0+10:6178:x1875409531575680:12345-192.168.202.41@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788530135.256487:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f396c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f442bcd-b742-4e76-ad7b-709f731358a0+10:6178:x1875409531575680:12345-192.168.202.41@tcp:503:ll_cfg_requeue.0 Request processed in 158us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530135.256495:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 312 00000100:00100000:3.0:1788530135.258950:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530135.258988:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531575808 00000100:00100000:3.0:1788530135.258997:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531575808 00000100:00100000:3.0:1788530135.259062:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 313 00000100:00100000:3.0:1788530135.259074:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f396c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f442bcd-b742-4e76-ad7b-709f731358a0+10:6716:x1875409531575808:12345-192.168.202.41@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788530135.259226:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f396c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f442bcd-b742-4e76-ad7b-709f731358a0+10:6716:x1875409531575808:12345-192.168.202.41@tcp:502:llog_process_th.0 Request processed in 153us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530135.259234:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 313 00000100:00100000:3.0:1788530135.274943:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530135.274974:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531575936 00000100:00100000:3.0:1788530135.274983:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531575936 00000100:00100000:3.0:1788530135.275043:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 314 00000100:00100000:3.0:1788530135.275053:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f396c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f442bcd-b742-4e76-ad7b-709f731358a0+10:6716:x1875409531575936:12345-192.168.202.41@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788530135.275184:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f396c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f442bcd-b742-4e76-ad7b-709f731358a0+10:6716:x1875409531575936:12345-192.168.202.41@tcp:502:llog_process_th.0 Request processed in 132us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530135.275192:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 314 00010000:00010000:0.0:1788530136.259341:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788530136.641444:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37426a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555764992:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788530136.641517:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530136.641829:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555764992 00000100:00100000:2.0:1788530136.641838:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555764992 00000100:00100000:2.0:1788530136.641899:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788530136.641910:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555764992:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788530136.641944:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788530136.642003:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555764992:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530136.642010:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788530136.642246:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37426a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555764992:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788530137.153798:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37425500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555765248:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788530137.153891:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530137.154104:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555765248 00000100:00100000:0.0:1788530137.154113:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555765248 00000100:00100000:0.0:1788530137.154181:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788530137.154195:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555765248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788530137.154230:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788530137.154292:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555765248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530137.154300:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:0.0:1788530137.154351:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f37425500 x1875409555765248/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530153 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530137.154377:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37425500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555765248:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788530137.155092:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555765376:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788530137.155130:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530137.155160:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788530137.155169:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555765120:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788530137.155194:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530137.155310:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555765376 00000100:00100000:0.0:1788530137.155329:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555765376 00000100:00100000:0.0:1788530137.155357:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555765120 00000100:00100000:0.0:1788530137.155360:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555765120 00000100:00100000:0.0:1788530137.155374:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788530137.155382:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555765376:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788530137.155407:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788530137.155443:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555765376:12345-0@lo:13:osp-pre-0-1.0 Request processed in 61us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530137.155449:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788530137.155462:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788530137.155468:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555765120:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788530137.155486:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788530137.155514:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555765120:12345-0@lo:13:osp-pre-1-1.0 Request processed in 46us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530137.155520:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:2.0:1788530137.156770:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788530137.156779:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788530137.158853:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f3d2a0e00 x1875409555765376/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530153 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530137.158893:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555765376:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788530137.158941:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555765504:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788530137.159009:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788530137.159073:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e027d8700 x1875409555765120/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530153 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530137.159087:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555765120:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788530137.159446:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555765504 00000100:00100000:2.0:1788530137.159453:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555765504 00000100:00100000:2.0:1788530137.159517:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788530137.159528:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555765504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788530137.159587:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788530137.159656:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555765504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 128us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530137.159663:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:2.0:1788530137.159694:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e027dbb80 x1875409555765504/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530153 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530137.159707:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555765504:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788530137.160989:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37426a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555765888:0@lo:400:kworker.0 00000100:00100000:0.0:1788530137.161034:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530137.161059:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37409880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875409555766400:0@lo:400:kworker.0 00000100:00100000:0.0:1788530137.161083:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530137.161104:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788530137.161109:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37427800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875409555765760:0@lo:400:kworker.0 00000100:00100000:0.0:1788530137.161129:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530137.161145:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37425c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875409555766272:0@lo:400:kworker.0 00000100:00100000:0.0:1788530137.161164:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530137.161191:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555766400 00000100:00100000:0.0:1788530137.161197:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555766400 00000100:00100000:0.0:1788530137.161251:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555765760 00000100:00100000:0.0:1788530137.161255:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555765760 00000100:00100000:0.0:1788530137.161267:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555766272 00000100:00100000:0.0:1788530137.161270:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555766272 00000100:00100000:0.0:1788530137.161296:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788530137.161305:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37408e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875409555766400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530137.161347:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37408e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875409555766400:12345-0@lo:400:kworker.0 Request processed in 43us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530137.161354:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788530137.161370:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788530137.161376:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3740b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875409555765760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530137.161401:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3740b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875409555765760:12345-0@lo:400:kworker.0 Request processed in 26us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530137.161407:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788530137.161417:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788530137.161423:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3740bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875409555766272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530137.161446:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3740bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875409555766272:12345-0@lo:400:kworker.0 Request processed in 23us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530137.161451:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788530137.161492:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37427800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875409555765760:0@lo:400:kworker.0 00000100:00100000:0.0:1788530137.161502:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37425c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875409555766272:0@lo:400:kworker.0 00010000:00080000:0.0:1788530137.161511:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f37409880 x1875409555766400/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530153 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530137.161520:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37409880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875409555766400:0@lo:400:kworker.0 00000100:00100000:3.0:1788530137.161781:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37425500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3650:1875409555765632:0@lo:400:kworker.0 00000100:00100000:3.0:1788530137.161816:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530137.161842:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37427480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555766144:0@lo:400:kworker.0 00000100:00100000:3.0:1788530137.161864:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530137.161891:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3740a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875409555766656:0@lo:400:kworker.0 00000100:00100000:3.0:1788530137.161914:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530137.161932:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788530137.161939:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37426680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875409555766016:0@lo:400:kworker.0 00000100:00100000:3.0:1788530137.161960:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530137.161977:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37408a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875409555766528:0@lo:400:kworker.0 00000100:00100000:3.0:1788530137.161996:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530137.162021:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555766656 00000100:00100000:3.0:1788530137.162025:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555766656 00000100:00100000:3.0:1788530137.162054:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555766016 00000100:00100000:3.0:1788530137.162057:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555766016 00000100:00100000:3.0:1788530137.162068:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555766528 00000100:00100000:3.0:1788530137.162070:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555766528 00000100:00100000:3.0:1788530137.162083:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788530137.162090:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e035f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875409555766656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530137.162127:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e035f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875409555766656:12345-0@lo:400:kworker.0 Request processed in 36us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530137.162134:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788530137.162147:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788530137.162153:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e035f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875409555766016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530137.162178:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e035f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875409555766016:12345-0@lo:400:kworker.0 Request processed in 26us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530137.162197:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788530137.162209:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788530137.162215:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e035f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875409555766528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530137.162242:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e035f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875409555766528:12345-0@lo:400:kworker.0 Request processed in 27us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530137.162248:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788530137.162269:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555765888 00000100:00100000:3.0:1788530137.162273:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555765888 00000100:00100000:3.0:1788530137.162302:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555766144 00000100:00100000:3.0:1788530137.162306:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555766144 00000100:00100000:3.0:1788530137.162317:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788530137.162323:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37408380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555765888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530137.162361:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37408380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555765888:12345-0@lo:400:kworker.0 Request processed in 37us (1326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530137.162367:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788530137.162378:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788530137.162383:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e035f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555766144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530137.162408:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e035f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555766144:12345-0@lo:400:kworker.0 Request processed in 25us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530137.162413:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788530137.162438:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37426680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875409555766016:0@lo:400:kworker.0 00000100:00100000:3.0:1788530137.162448:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37408a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875409555766528:0@lo:400:kworker.0 00000100:00100000:3.0:1788530137.162456:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37427480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555766144:0@lo:400:kworker.0 00010000:00080000:3.0:1788530137.162465:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f3740a300 x1875409555766656/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530153 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530137.162481:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3740a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875409555766656:0@lo:400:kworker.0 00000100:00100000:3.0:1788530137.162513:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37426a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555765888:0@lo:400:kworker.0 00000100:00080000:1.0:1788530137.164445:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788530137.164455:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788530137.164459:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788530137.164747:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555765632 00000100:00100000:2.0:1788530137.164759:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555765632 00000100:00100000:2.0:1788530137.164826:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1788530137.164837:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f396c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:3650:x1875409555765632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530137.164943:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f396c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:3650:x1875409555765632:12345-0@lo:400:kworker.0 Request processed in 108us (3126us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530137.164951:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1788530137.167299:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37425500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3650:1875409555765632:0@lo:400:kworker.0 00010000:00010000:1.0:1788530137.280775:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788530138.176832:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788530138.176861:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555766784:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788530138.176966:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530138.177295:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555766784 00000100:00100000:2.0:1788530138.177307:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555766784 00000100:00100000:2.0:1788530138.177412:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788530138.177427:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555766784:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788530138.177492:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446453248 avail 1300213760 00000100:00100000:2.0:1788530138.177594:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555766784:12345-0@lo:41:osp-pre-1-0.0 Request processed in 172us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530138.177603:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788530138.187873:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555766784:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788530138.306475:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530139.332869:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788530139.627657:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530139.627698:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530139.627723:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530139.627743:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530139.627766:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530139.627803:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531576320 00000100:00100000:2.0:1788530139.627813:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531576320 00000100:00100000:2.0:1788530139.627887:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531576192 00000100:00100000:2.0:1788530139.627890:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531576192 00000100:00100000:2.0:1788530139.627913:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 91 00000100:00100000:2.0:1788530139.627925:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2400:x1875409531576320:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1788530139.628018:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2400:x1875409531576320:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 96us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530139.628026:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 91 00000100:00100000:2.0:1788530139.628046:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 92 00000100:00100000:2.0:1788530139.628053:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:2400:x1875409531576192:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1788530139.628081:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:2400:x1875409531576192:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 29us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530139.628087:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 92 00000100:00100000:2.0:1788530139.628108:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531576576 00000100:00100000:2.0:1788530139.628111:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531576576 00000100:00100000:2.0:1788530139.628137:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531576448 00000100:00100000:2.0:1788530139.628140:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531576448 00000100:00100000:2.0:1788530139.628161:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 23 00000100:00100000:2.0:1788530139.628168:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2400:x1875409531576576:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1788530139.628210:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2400:x1875409531576576:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 43us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530139.628218:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 23 00000100:00100000:2.0:1788530139.628230:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 24 00000100:00100000:2.0:1788530139.628236:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2400:x1875409531576448:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1788530139.628272:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2400:x1875409531576448:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 35us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530139.628279:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 24 00000100:00080000:2.0:1788530139.628301:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788530139.628306:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788530139.628309:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788530139.628312:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788530139.630764:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531576064 00000100:00100000:2.0:1788530139.630779:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531576064 00000100:00100000:2.0:1788530139.630843:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 316 00000100:00100000:2.0:1788530139.630854:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f396c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f442bcd-b742-4e76-ad7b-709f731358a0+10:2400:x1875409531576064:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1788530139.630931:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f396c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f442bcd-b742-4e76-ad7b-709f731358a0+10:2400:x1875409531576064:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 79us (3286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530139.630939:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 316 00010000:00010000:1.0:1788530140.352707:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530141.389745:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788530141.694991:0:10704:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg241-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:3.0:1788530141.761872:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37409880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555766912:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788530141.761948:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530141.762039:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555766912 00000100:00100000:1.0:1788530141.762047:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555766912 00000100:00100000:1.0:1788530141.762111:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788530141.762120:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e035f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555766912:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788530141.762154:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788530141.764188:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e035f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555766912:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2059us (2229us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530141.764201:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788530141.765838:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37409880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555766912:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788530142.272906:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788530142.272945:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37409180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555767040:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788530142.273050:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530142.273192:0:9912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555767040 00000100:00100000:0.0:1788530142.273203:0:9912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555767040 00000100:00100000:0.0:1788530142.273318:0:9912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788530142.273330:0:9912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e035f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555767040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788530142.273368:0:9912:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788530142.273418:0:9912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e035f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555767040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530142.273426:0:9912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:3.0:1788530142.273801:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788530142.273841:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f37409180 x1875409555767040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530158 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530142.273867:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37409180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555767040:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788530142.274698:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875409555767424:0@lo:400:kworker.0 00000100:00100000:3.0:1788530142.274765:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530142.274801:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3735c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875409555767936:0@lo:400:kworker.0 00000100:00100000:3.0:1788530142.274822:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530142.274842:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3960f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875409555768448:0@lo:400:kworker.0 00000100:00100000:3.0:1788530142.274860:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530142.274877:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:3.0:1788530142.274883:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3648:1875409555767296:0@lo:400:kworker.0 00000100:00100000:3.0:1788530142.274915:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530142.274939:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555767808:0@lo:400:kworker.0 00000100:00100000:3.0:1788530142.274959:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530142.274976:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3960d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875409555768320:0@lo:400:kworker.0 00000100:00100000:3.0:1788530142.274995:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530142.275009:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37370700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555768832:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788530142.275029:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530142.275066:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555767424 00000100:00100000:1.0:1788530142.275460:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03359500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555767552:0@lo:400:kworker.0 00000100:00100000:1.0:1788530142.275500:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530142.275522:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3735fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875409555768064:0@lo:400:kworker.0 00000100:00100000:1.0:1788530142.275543:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530142.275554:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3960d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555768576:0@lo:400:kworker.0 00000100:00100000:1.0:1788530142.275601:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530142.275620:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1788530142.275626:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37371f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555767168:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788530142.275645:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530142.275660:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875409555767680:0@lo:400:kworker.0 00000100:00100000:1.0:1788530142.275678:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530142.275687:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3960ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555768192:0@lo:400:kworker.0 00000100:00100000:1.0:1788530142.275706:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530142.275720:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3960ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555768704:0@lo:400:kworker.0 00000100:00100000:1.0:1788530142.275736:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530142.275760:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555767808 00000100:00100000:1.0:1788530142.275766:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555767808 00000100:00100000:1.0:1788530142.275798:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555767552 00000100:00100000:1.0:1788530142.275801:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555767552 00000100:00100000:1.0:1788530142.275816:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788530142.275833:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37372a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555767808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530142.275886:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37372a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555767808:12345-0@lo:400:kworker.0 Request processed in 53us (925us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530142.275893:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788530142.275911:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788530142.275917:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555767552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530142.275948:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555767552:12345-0@lo:400:kworker.0 Request processed in 31us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530142.275955:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788530142.275989:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03359500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555767552:0@lo:400:kworker.0 00000100:00100000:1.0:1788530142.276042:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555767296 00000100:00100000:1.0:1788530142.276046:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555767296 00000100:00100000:1.0:1788530142.276069:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:1.0:1788530142.276088:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f396c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:3648:x1875409555767296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530142.276117:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f396c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:3648:x1875409555767296:12345-0@lo:400:kworker.0 Request processed in 42us (1201us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530142.276123:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:1.0:1788530142.276151:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555767936 00000100:00100000:1.0:1788530142.276155:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555767936 00000100:00100000:1.0:1788530142.276199:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555768448 00000100:00100000:1.0:1788530142.276202:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555768448 00000100:00100000:1.0:1788530142.276216:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555768320 00000100:00100000:1.0:1788530142.276218:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555768320 00000100:00100000:1.0:1788530142.276229:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555768064 00000100:00100000:1.0:1788530142.276241:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555768064 00000100:00100000:1.0:1788530142.276254:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555767680 00000100:00100000:1.0:1788530142.276257:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555767680 00000100:00100000:1.0:1788530142.276268:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788530142.276377:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555767424 00000100:00100000:3.0:1788530142.276402:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788530142.276408:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37371c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875409555768448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530142.276694:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788530142.276703:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3740a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555768960:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788530142.276729:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530142.276758:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555768832 00000100:00100000:0.0:1788530142.276761:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555768832 00000100:00100000:0.0:1788530142.276779:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555767168 00000100:00100000:0.0:1788530142.276781:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555767168 00000100:00100000:0.0:1788530142.276792:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555768960 00000100:00100000:0.0:1788530142.276795:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555768960 00000100:00100000:0.0:1788530142.276807:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788530142.276812:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37373800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555768832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788530142.276833:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788530142.276862:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37373800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555768832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (1833us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530142.276868:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788530142.276881:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788530142.276886:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d3fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555767168:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788530142.276903:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788530142.276932:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d3fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555767168:12345-0@lo:13:osp-pre-1-1.0 Request processed in 45us (1285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530142.276937:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788530142.276946:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788530142.276951:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3740ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555768960:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788530142.276960:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788530142.276982:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3740ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555768960:12345-0@lo:13:osp-pre-0-1.0 Request processed in 31us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530142.276987:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:0.0:1788530142.277015:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f3740a680 x1875409555768960/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530158 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530142.277031:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3740a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555768960:0@lo:13:osp-pre-0-1.0 00010000:00080000:0.0:1788530142.277059:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f37371f80 x1875409555767168/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530158 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530142.277070:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37371f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555767168:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788530142.277100:0:6524:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1788530142.277107:0:6524:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:0.0:1788530142.277204:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788530142.277211:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37371500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875409555768320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530142.277254:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37371500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875409555768320:12345-0@lo:400:kworker.0 Request processed in 43us (2258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530142.277260:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788530142.277273:0:6524:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1788530142.277374:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37371c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875409555768448:12345-0@lo:400:kworker.0 Request processed in 34us (1580us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530142.277393:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788530142.277409:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875409555768064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530142.277442:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875409555768064:12345-0@lo:400:kworker.0 Request processed in 35us (1897us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530142.277485:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37373480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875409555767936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530142.277517:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37373480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875409555767936:12345-0@lo:400:kworker.0 Request processed in 1238us (2695us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530142.277715:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555768576 00000100:00100000:2.0:1788530142.277720:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555768576 00000100:00100000:2.0:1788530142.277750:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555768192 00000100:00100000:2.0:1788530142.277753:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555768192 00000100:00100000:2.0:1788530142.277763:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555768704 00000100:00100000:2.0:1788530142.277766:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555768704 00000100:00100000:2.0:1788530142.277777:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788530142.277783:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555768576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530142.277822:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555768576:12345-0@lo:400:kworker.0 Request processed in 40us (2221us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530142.277828:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788530142.277839:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788530142.277846:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d3f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555768192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530142.277871:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d3f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555768192:12345-0@lo:400:kworker.0 Request processed in 27us (2165us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530142.277877:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788530142.277887:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788530142.277893:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d3f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555768704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530142.277917:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d3f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555768704:12345-0@lo:400:kworker.0 Request processed in 24us (2179us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530142.277922:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788530142.277981:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3648:1875409555767296:0@lo:400:kworker.0 00000100:00100000:2.0:1788530142.277995:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555767808:0@lo:400:kworker.0 00000100:00100000:2.0:1788530142.278005:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3960d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875409555768320:0@lo:400:kworker.0 00010000:00080000:2.0:1788530142.278018:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f37370700 x1875409555768832/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530158 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530142.278032:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37370700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555768832:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788530142.278054:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3735c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875409555767936:0@lo:400:kworker.0 00010000:00080000:2.0:1788530142.278065:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f3960f800 x1875409555768448/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530158 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530142.278081:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3960f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875409555768448:0@lo:400:kworker.0 00000100:00080000:2.0:1788530142.278127:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788530142.278131:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788530142.278134:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788530142.278136:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788530142.278260:0:10719:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 5 min 3 max 116 00000100:00100000:2.0:1788530142.278266:0:10719:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_005' 00010000:00080000:2.0:1788530142.278310:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f3960ea00 x1875409555768192/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788530158 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530142.278318:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3960ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555768192:0@lo:400:kworker.0 00010000:00080000:2.0:1788530142.278327:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f3960ca80 x1875409555768704/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788530158 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530142.278334:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3960ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555768704:0@lo:400:kworker.0 00010000:00080000:2.0:1788530142.278343:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f3735fb80 x1875409555768064/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530158 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530142.278351:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3735fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875409555768064:0@lo:400:kworker.0 00010000:00080000:2.0:1788530142.278359:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f3960d880 x1875409555768576/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788530158 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530142.278367:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3960d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555768576:0@lo:400:kworker.0 00000100:00100000:3.0:1788530142.278903:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788530142.278931:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788530142.278942:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d3f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875409555767680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530142.279006:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d3f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875409555767680:12345-0@lo:400:kworker.0 Request processed in 69us (3327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530142.279013:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788530142.279027:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788530142.279034:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37370000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875409555767424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530142.279181:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37370000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875409555767424:12345-0@lo:400:kworker.0 Request processed in 147us (4415us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530142.279188:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788530142.279224:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875409555767680:0@lo:400:kworker.0 00000100:00100000:3.0:1788530142.279275:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875409555767424:0@lo:400:kworker.0 00000100:00100000:0.0:1788530142.279585:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788530142.279824:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00010000:00010000:0.0:1788530142.404296:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788530143.301803:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788530143.301829:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37371880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555769088:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788530143.301898:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530143.302596:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555769088 00000100:00100000:3.0:1788530143.302663:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555769088 00000100:00100000:3.0:1788530143.302788:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788530143.302797:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37370a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555769088:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788530143.302831:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446453248 avail 1300213760 00000100:00100000:3.0:1788530143.302886:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37370a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555769088:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (988us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530143.302894:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788530143.302940:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37371880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555769088:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788530143.428181:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530144.456425:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788530144.760025:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530144.760077:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530144.760106:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530144.760146:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531576704 00000100:00100000:2.0:1788530144.760157:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531576704 00000100:00100000:2.0:1788530144.760233:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 318 00000100:00100000:2.0:1788530144.760246:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f396c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f442bcd-b742-4e76-ad7b-709f731358a0+10:2399:x1875409531576704:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1788530144.760380:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f396c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f442bcd-b742-4e76-ad7b-709f731358a0+10:2399:x1875409531576704:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 136us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530144.760397:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 318 00000100:00100000:2.0:1788530144.760457:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531576832 00000100:00100000:2.0:1788530144.760461:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531576832 00000100:00100000:2.0:1788530144.760658:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531576960 00000100:00100000:2.0:1788530144.760662:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531576960 00000100:00100000:2.0:1788530144.760695:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 99 00000100:00100000:2.0:1788530144.760703:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3960d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:2400:x1875409531576832:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1788530144.760739:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3960d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:2400:x1875409531576832:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 37us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530144.760748:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 99 00000100:00100000:2.0:1788530144.760761:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 100 00000100:00100000:2.0:1788530144.760769:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3960ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2399:x1875409531576960:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1788530144.760796:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3960ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2399:x1875409531576960:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 28us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530144.760802:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 100 00000100:00080000:2.0:1788530144.761599:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788530144.761608:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788530144.777103:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530144.779198:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531577088 00000100:00100000:2.0:1788530144.779232:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531577088 00000100:00100000:2.0:1788530144.779340:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 18 00000100:00100000:2.0:1788530144.779355:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37371880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2398:x1875409531577088:12345-192.168.202.41@tcp:9:kworker.0 00000020:00000080:2.0:1788530144.779407:0:8439:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e125750536 00000100:00080000:2.0:1788530144.779421:0:8439:0:(import.c:65:import_set_state_nolock()) ffff9a9f37410800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788530144.779475:0:8439:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1788530144.779750:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37371880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+2:2398:x1875409531577088:12345-192.168.202.41@tcp:9:kworker.0 Request processed in 398us (2659us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530144.779759:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 18 00010000:00010000:2.0:1788530144.779825:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788530144.780046:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788530144.788531:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530144.788885:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531577216 00000100:00100000:0.0:1788530144.788901:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531577216 00000100:00100000:0.0:1788530144.789019:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 19 00000100:00100000:0.0:1788530144.789033:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37372300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2398:x1875409531577216:12345-192.168.202.41@tcp:9:kworker.0 00000020:00000080:0.0:1788530144.789084:0:8438:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e12575053d 00000100:00080000:0.0:1788530144.789095:0:8438:0:(import.c:65:import_set_state_nolock()) ffff9a9f37416000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788530144.789152:0:8438:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1788530144.789389:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37372300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+2:2398:x1875409531577216:12345-192.168.202.41@tcp:9:kworker.0 Request processed in 358us (871us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530144.789399:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 19 00010000:00010000:0.0:1788530144.789425:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788530144.790693:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788530145.474789:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530146.497718:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788530146.881055:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37370380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555769216:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788530146.883056:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530146.883207:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555769216 00000100:00100000:2.0:1788530146.883216:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555769216 00000100:00100000:2.0:1788530146.883460:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788530146.883474:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3960ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555769216:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788530146.883519:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788530146.883595:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3960ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555769216:12345-0@lo:41:osp-pre-0-1.0 Request processed in 124us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530146.883603:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788530146.883743:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37370380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555769216:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788530147.397575:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3740a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555769344:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788530147.397657:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530147.397742:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555769344 00000100:00100000:0.0:1788530147.397750:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555769344 00000100:00100000:0.0:1788530147.397801:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788530147.397812:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37409f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555769344:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788530147.397851:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788530147.397894:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37409f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555769344:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530147.397919:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:0.0:1788530147.397942:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788530147.397978:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f3740a680 x1875409555769344/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530163 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530147.397998:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3740a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555769344:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788530147.398190:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3960f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555769472:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788530147.398227:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530147.398282:0:9912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555769472 00000100:00100000:2.0:1788530147.398287:0:9912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555769472 00000100:00100000:2.0:1788530147.398320:0:9912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788530147.398326:0:9912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3960d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555769472:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788530147.398342:0:9912:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788530147.398379:0:9912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3960d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555769472:12345-0@lo:13:osp-pre-0-1.0 Request processed in 53us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530147.398386:0:9912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:2.0:1788530147.398411:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f3960f800 x1875409555769472/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530163 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530147.398446:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3960f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555769472:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788530147.398474:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788530147.398605:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3960f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3649:1875409555769600:0@lo:400:kworker.0 00000100:00100000:2.0:1788530147.398638:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530147.398658:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3960e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555770112:0@lo:400:kworker.0 00000100:00100000:2.0:1788530147.398681:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530147.398699:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3960f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875409555770624:0@lo:400:kworker.0 00000100:00100000:2.0:1788530147.398723:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530147.398744:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788530147.398749:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3960e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875409555769728:0@lo:400:kworker.0 00000100:00100000:2.0:1788530147.398773:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530147.398790:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3960d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875409555770240:0@lo:400:kworker.0 00000100:00100000:2.0:1788530147.398808:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530147.398824:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3735fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875409555770752:0@lo:400:kworker.0 00000100:00100000:2.0:1788530147.398842:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530147.398867:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555769600 00000100:00100000:2.0:1788530147.398871:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555769600 00000100:00100000:2.0:1788530147.398897:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:2.0:1788530147.398904:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f396c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:3649:x1875409555769600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530147.398933:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f396c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:3649:x1875409555769600:12345-0@lo:400:kworker.0 Request processed in 30us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530147.398940:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:2.0:1788530147.398963:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555770112 00000100:00100000:2.0:1788530147.398965:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555770112 00000100:00100000:2.0:1788530147.398999:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788530147.399006:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555770112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530147.399038:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555770112:12345-0@lo:400:kworker.0 Request processed in 32us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530147.399044:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788530147.399061:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555770624 00000100:00100000:2.0:1788530147.399065:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555770624 00000100:00100000:2.0:1788530147.399106:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555769728 00000100:00100000:2.0:1788530147.399108:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555769728 00000100:00100000:2.0:1788530147.399123:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555770240 00000100:00100000:2.0:1788530147.399126:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555770240 00000100:00100000:2.0:1788530147.399141:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555770752 00000100:00100000:2.0:1788530147.399143:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555770752 00000100:00100000:2.0:1788530147.399157:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788530147.399163:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875409555770624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530147.399207:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875409555770624:12345-0@lo:400:kworker.0 Request processed in 44us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530147.399213:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788530147.399225:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788530147.399232:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875409555769728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530147.399258:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875409555769728:12345-0@lo:400:kworker.0 Request processed in 27us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530147.399263:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788530147.399274:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788530147.399280:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875409555770240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530147.399304:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875409555770240:12345-0@lo:400:kworker.0 Request processed in 25us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530147.399319:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788530147.399330:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788530147.399336:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32bd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875409555770752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530147.399359:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32bd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875409555770752:12345-0@lo:400:kworker.0 Request processed in 23us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530147.399364:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788530147.399409:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3960e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875409555769728:0@lo:400:kworker.0 00000100:00100000:2.0:1788530147.399419:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3960d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875409555770240:0@lo:400:kworker.0 00010000:00080000:2.0:1788530147.399430:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f3735fb80 x1875409555770752/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530163 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530147.399440:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3735fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875409555770752:0@lo:400:kworker.0 00000100:00100000:2.0:1788530147.399448:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3960f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3649:1875409555769600:0@lo:400:kworker.0 00000100:00100000:2.0:1788530147.399457:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3960e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555770112:0@lo:400:kworker.0 00000100:00100000:2.0:1788530147.399465:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3960f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875409555770624:0@lo:400:kworker.0 00000100:00100000:2.0:1788530147.399516:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3960fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875409555769984:0@lo:400:kworker.0 00000100:00100000:2.0:1788530147.399537:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530147.399554:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3960dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555770496:0@lo:400:kworker.0 00000100:00100000:2.0:1788530147.399596:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530147.399612:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788530147.399618:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3960ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555769856:0@lo:400:kworker.0 00000100:00100000:2.0:1788530147.399634:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530147.399654:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3960c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875409555770368:0@lo:400:kworker.0 00000100:00100000:2.0:1788530147.399670:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530147.399681:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3735c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555770880:0@lo:400:kworker.0 00000100:00100000:2.0:1788530147.399696:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530147.399717:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555769984 00000100:00100000:2.0:1788530147.399720:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555769984 00000100:00100000:2.0:1788530147.399747:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555770368 00000100:00100000:2.0:1788530147.399749:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555770368 00000100:00100000:2.0:1788530147.399767:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788530147.399772:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3735fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875409555769984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530147.399804:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3735fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875409555769984:12345-0@lo:400:kworker.0 Request processed in 31us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530147.399810:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788530147.399822:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788530147.399828:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3960f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875409555770368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530147.399852:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3960f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875409555770368:12345-0@lo:400:kworker.0 Request processed in 25us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530147.399858:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788530147.399874:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555770496 00000100:00100000:2.0:1788530147.399877:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555770496 00000100:00100000:2.0:1788530147.399903:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555770880 00000100:00100000:2.0:1788530147.399905:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555770880 00000100:00100000:2.0:1788530147.399924:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788530147.399931:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3960f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555770496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530147.399977:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3960f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555770496:12345-0@lo:400:kworker.0 Request processed in 47us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530147.399984:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788530147.400003:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788530147.400009:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3960d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555770880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530147.400035:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3960d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555770880:12345-0@lo:400:kworker.0 Request processed in 27us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530147.400042:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788530147.400057:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555769856 00000100:00100000:2.0:1788530147.400060:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555769856 00000100:00100000:2.0:1788530147.400078:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788530147.400084:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3960e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555769856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530147.400109:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3960e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555769856:12345-0@lo:400:kworker.0 Request processed in 26us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530147.400115:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788530147.400155:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3960ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555769856:0@lo:400:kworker.0 00010000:00080000:2.0:1788530147.400165:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f3960c380 x1875409555770368/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530163 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530147.400174:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3960c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875409555770368:0@lo:400:kworker.0 00010000:00080000:2.0:1788530147.400195:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f3735c380 x1875409555770880/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788530163 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530147.400205:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3735c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555770880:0@lo:400:kworker.0 00000100:00100000:2.0:1788530147.400216:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3960fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875409555769984:0@lo:400:kworker.0 00010000:00080000:2.0:1788530147.400225:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f3960dc00 x1875409555770496/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788530163 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530147.400233:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3960dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555770496:0@lo:400:kworker.0 00000100:00080000:2.0:1788530147.400266:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788530147.400276:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788530147.400279:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788530147.400281:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788530147.404335:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3740a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555771008:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788530147.404453:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530147.404641:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555771008 00000100:00100000:0.0:1788530147.404653:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555771008 00000100:00100000:0.0:1788530147.404722:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788530147.404734:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3960dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555771008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788530147.404768:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788530147.404828:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3960dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555771008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530147.404835:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788530147.409583:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788530147.409607:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37408700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555771136:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788530147.409682:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788530147.409759:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f3740a680 x1875409555771008/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530163 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530147.409783:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3740a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555771008:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788530147.409861:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555771136 00000100:00100000:0.0:1788530147.409868:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555771136 00000100:00100000:0.0:1788530147.409921:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788530147.409931:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3960fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555771136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788530147.409951:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788530147.409992:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3960fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555771136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530147.409998:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:2.0:1788530147.410066:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f37408700 x1875409555771136/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530163 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530147.410079:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37408700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555771136:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788530147.522645:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788530148.417765:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788530148.417801:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37370e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555771264:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788530148.417884:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530148.418146:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555771264 00000100:00100000:2.0:1788530148.418155:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555771264 00000100:00100000:2.0:1788530148.418227:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788530148.418238:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37373100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555771264:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788530148.418283:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446453248 avail 1300213760 00000100:00100000:2.0:1788530148.418381:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37373100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555771264:12345-0@lo:41:osp-pre-1-0.0 Request processed in 143us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530148.418390:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788530148.418471:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37370e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555771264:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788530148.545412:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788530148.771188:0:10951:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg241-server.virtnet: executing yml_node 00010000:00010000:0.0:1788530149.575091:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788530149.862834:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530149.862889:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530149.862915:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530149.863082:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531577600 00000100:00100000:2.0:1788530149.863098:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531577600 00000100:00100000:2.0:1788530149.863205:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531577472 00000100:00100000:2.0:1788530149.863220:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531577472 00000100:00100000:2.0:1788530149.863253:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 107 00000100:00100000:2.0:1788530149.863265:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37373b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2400:x1875409531577600:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1788530149.863364:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37373b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2400:x1875409531577600:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 101us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530149.863373:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 107 00000100:00100000:2.0:1788530149.863393:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 108 00000100:00100000:2.0:1788530149.863400:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37371180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:2400:x1875409531577472:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1788530149.863442:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37371180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:2400:x1875409531577472:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 42us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530149.863449:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 108 00000100:00100000:0.0:1788530149.863856:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531577344 00000100:00100000:0.0:1788530149.863863:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531577344 00000100:00100000:0.0:1788530149.863919:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 320 00000100:00100000:0.0:1788530149.863927:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f442bcd-b742-4e76-ad7b-709f731358a0+10:2400:x1875409531577344:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1788530149.863970:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f442bcd-b742-4e76-ad7b-709f731358a0+10:2400:x1875409531577344:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 44us (1152us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530149.863977:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 320 00000100:00080000:3.0:1788530149.864234:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788530149.864241:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00100000:0.0:1788530149.960731:0:8431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41 00000020:00000080:0.0:1788530149.960745:0:8431:0:(genops.c:885:class_export_put()) final put ffff9a9f373f3000/aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41 00000001:00100000:1.0:1788530149.960882:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41 00000020:00000080:1.0:1788530149.960887:0:9518:0:(genops.c:885:class_export_put()) final put ffff9a9f37415000/aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41 00000020:00000080:3.0:1788530149.970614:0:476:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f373f3000/aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41 for lustre-OST0000 00000020:00000080:3.0:1788530149.970708:0:476:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a9f37410800 for lustre-OST0000 00000020:00000080:1.0:1788530149.970946:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f37415000/aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41 for lustre-OST0001 00000020:00000080:1.0:1788530149.970977:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a9f37416000 for lustre-OST0001 00010000:00010000:1.0:1788530150.594008:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530151.623139:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788530152.005366:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37372680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555771392:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788530152.005485:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530152.006478:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555771392 00000100:00100000:3.0:1788530152.006494:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555771392 00000100:00100000:3.0:1788530152.006590:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788530152.006600:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3960c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555771392:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788530152.006642:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788530152.006727:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3960c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555771392:12345-0@lo:41:osp-pre-0-1.0 Request processed in 128us (1242us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530152.006735:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788530152.006915:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37372680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555771392:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788530152.515156:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788530152.515181:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37408000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555771520:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788530152.515256:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530152.515374:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3960ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555771648:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788530152.515421:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530152.515448:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03359500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875409555772032:0@lo:400:kworker.0 00000100:00100000:2.0:1788530152.515450:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0263f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555772160:0@lo:400:kworker.0 00000100:00100000:2.0:1788530152.515474:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530152.515475:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530152.515493:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875409555772672:0@lo:400:kworker.0 00000100:00100000:1.0:1788530152.515493:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0263c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875409555772544:0@lo:400:kworker.0 00000100:00100000:1.0:1788530152.515512:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530152.515518:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3960e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555771776:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788530152.515528:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37366680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875409555773056:0@lo:400:kworker.0 00000100:00100000:2.0:1788530152.515539:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530152.515545:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530152.515577:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0263ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875409555772288:0@lo:400:kworker.0 00000100:00100000:1.0:1788530152.515580:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788530152.515585:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d3fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3648:1875409555771904:0@lo:400:kworker.0 00000100:00100000:2.0:1788530152.515610:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530152.515618:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530152.515628:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37365180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555772800:0@lo:400:kworker.0 00000100:00100000:1.0:1788530152.515655:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0263d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555772416:0@lo:400:kworker.0 00000100:00100000:2.0:1788530152.515658:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530152.515688:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555771520 00000100:00100000:1.0:1788530152.515689:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530152.515695:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555771520 00000100:00100000:1.0:1788530152.515707:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37364e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555772928:0@lo:400:kworker.0 00000100:00100000:1.0:1788530152.515727:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530152.515733:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555771648 00000100:00100000:2.0:1788530152.515736:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555771648 00000100:00100000:2.0:1788530152.515763:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555771776 00000100:00100000:2.0:1788530152.515767:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555771776 00000100:00100000:1.0:1788530152.515769:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555772032 00000100:00100000:1.0:1788530152.515772:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555772032 00000100:00100000:2.0:1788530152.515782:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788530152.515789:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d3fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555771520:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788530152.515806:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555772544 00000100:00100000:1.0:1788530152.515809:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555772544 00002000:00000024:2.0:1788530152.515816:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788530152.515823:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555773056 00000100:00100000:1.0:1788530152.515826:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555773056 00000100:00100000:1.0:1788530152.515837:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555772288 00000100:00100000:1.0:1788530152.515840:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555772288 00000100:00100000:1.0:1788530152.515851:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788530152.515857:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37366d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875409555772032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530152.515890:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37366d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875409555772032:12345-0@lo:400:kworker.0 Request processed in 33us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530152.515898:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788530152.515915:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788530152.515921:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37365f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875409555772544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530152.516078:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555772800 00000100:00100000:3.0:1788530152.516082:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555772800 00000100:00100000:3.0:1788530152.516106:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555772928 00000100:00100000:3.0:1788530152.516109:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555772928 00000100:00100000:3.0:1788530152.516128:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788530152.516145:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0231e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3650:x1875409555772800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530152.516173:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d3fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555771520:12345-0@lo:13:osp-pre-1-1.0 Request processed in 383us (916us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530152.516179:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0231e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3650:x1875409555772800:12345-0@lo:400:kworker.0 Request processed in 46us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530152.516180:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788530152.516184:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788530152.516193:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788530152.516194:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788530152.516199:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37375c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555772928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530152.516199:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3735c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555771648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788530152.516209:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788530152.516225:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37375c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555772928:12345-0@lo:400:kworker.0 Request processed in 26us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530152.516227:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3735c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555771648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 29us (806us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530152.516231:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788530152.516232:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788530152.516241:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00080000:3.0:1788530152.516246:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788530152.516247:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0231fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555771776:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788530152.516250:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788530152.516252:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:2.0:1788530152.516259:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788530152.516263:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555771904 00000100:00100000:3.0:1788530152.516266:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555771904 00000100:00100000:2.0:1788530152.516282:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0231fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555771776:12345-0@lo:13:osp-pre-0-1.0 Request processed in 36us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530152.516288:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788530152.516298:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1788530152.516304:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:3648:x1875409555771904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530152.516306:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788530152.516312:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37367b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875409555773056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530152.516333:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:3648:x1875409555771904:12345-0@lo:400:kworker.0 Request processed in 30us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530152.516339:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1788530152.516342:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37367b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875409555773056:12345-0@lo:400:kworker.0 Request processed in 31us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530152.516347:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788530152.516359:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788530152.516364:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0231df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875409555772288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530152.516366:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555772160 00000100:00100000:3.0:1788530152.516369:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555772160 00000100:00100000:3.0:1788530152.516385:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555772416 00000100:00100000:3.0:1788530152.516388:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555772416 00000100:00100000:2.0:1788530152.516389:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0231df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875409555772288:12345-0@lo:400:kworker.0 Request processed in 25us (788us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530152.516394:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788530152.516399:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788530152.516404:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0231f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555772160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530152.516433:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530152.516434:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0231f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555772160:12345-0@lo:400:kworker.0 Request processed in 30us (959us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530152.516441:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788530152.516450:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37367100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875409555773184:0@lo:400:kworker.0 00000100:00100000:3.0:1788530152.516451:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788530152.516457:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37377480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555772416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530152.516470:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530152.516480:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37377480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555772416:12345-0@lo:400:kworker.0 Request processed in 24us (791us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530152.516486:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00010000:00080000:2.0:1788530152.516501:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f3960ce00 x1875409555771648/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530168 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530152.516508:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555772672 00000100:00100000:3.0:1788530152.516511:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555772672 00000100:00100000:2.0:1788530152.516519:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3960ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555771648:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788530152.516528:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555773184 00000100:00100000:3.0:1788530152.516530:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555773184 00000100:00100000:3.0:1788530152.516541:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788530152.516545:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0263f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555772160:0@lo:400:kworker.0 00000100:00100000:3.0:1788530152.516546:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0231c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875409555772672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530152.516553:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788530152.516585:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37372d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555773312:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788530152.516596:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0231c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875409555772672:12345-0@lo:400:kworker.0 Request processed in 50us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530152.516611:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788530152.516623:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788530152.516629:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0231ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875409555773184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530152.516758:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d3fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3648:1875409555771904:0@lo:400:kworker.0 00000100:00100000:0.0:1788530152.516770:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0263d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555772416:0@lo:400:kworker.0 00010000:00080000:0.0:1788530152.516780:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f37364e00 x1875409555772928/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788530168 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530152.516788:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37364e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555772928:0@lo:400:kworker.0 00000100:00100000:0.0:1788530152.516797:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03359500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875409555772032:0@lo:400:kworker.0 00000100:00100000:0.0:1788530152.516806:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0263c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875409555772544:0@lo:400:kworker.0 00000100:00100000:0.0:1788530152.516815:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37366680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875409555773056:0@lo:400:kworker.0 00010000:00080000:0.0:1788530152.516860:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f37408000 x1875409555771520/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530168 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530152.516873:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37408000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555771520:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1788530152.516892:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788530152.516908:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f3960e680 x1875409555771776/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530168 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530152.516932:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3960e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555771776:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788530152.516945:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0263ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875409555772288:0@lo:400:kworker.0 00010000:00080000:0.0:1788530152.516969:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f37365180 x1875409555772800/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788530168 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530152.516977:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37365180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555772800:0@lo:400:kworker.0 00000100:00100000:1.0:1788530152.517215:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37365f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875409555772544:12345-0@lo:400:kworker.0 Request processed in 29us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530152.517225:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788530152.532186:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0231ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875409555773184:12345-0@lo:400:kworker.0 Request processed in 15546us (15703us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530152.532201:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788530152.543508:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788530152.543687:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f328e7800 x1875409555772672/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530168 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530152.543710:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875409555772672:0@lo:400:kworker.0 00010000:00080000:2.0:1788530152.543730:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f37367100 x1875409555773184/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530168 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530152.543739:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37367100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875409555773184:0@lo:400:kworker.0 00000100:00100000:0.0:1788530152.544008:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555773312 00000100:00100000:0.0:1788530152.544025:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555773312 00000100:00100000:0.0:1788530152.544121:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788530152.544148:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0231d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555773312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788530152.544188:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788530152.544322:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0231d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555773312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 186us (833us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530152.544330:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:3.0:1788530152.544607:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f37372d80 x1875409555773312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530168 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530152.544630:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37372d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555773312:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788530152.643610:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788530153.537049:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788530153.541350:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37372d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555773440:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788530153.541451:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530153.549923:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555773440 00000100:00100000:3.0:1788530153.549936:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555773440 00000100:00100000:3.0:1788530153.550349:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788530153.550360:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37376a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555773440:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788530153.550396:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446453248 avail 1300213760 00000100:00100000:3.0:1788530153.550484:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37376a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555773440:12345-0@lo:41:osp-pre-1-0.0 Request processed in 125us (9033us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530153.550491:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788530153.550587:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37372d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555773440:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788530153.674856:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788530154.143000:0:11135:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.5 00010000:00010000:0.0:1788530154.701916:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788530154.984874:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530154.984922:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530154.985012:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530154.985049:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531577984 00000100:00100000:0.0:1788530154.985063:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531577984 00000100:00100000:0.0:1788530154.985156:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531577856 00000100:00100000:0.0:1788530154.985160:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531577856 00000100:00100000:0.0:1788530154.985200:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 115 00000100:00100000:0.0:1788530154.985218:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37408000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2399:x1875409531577984:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1788530154.985336:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37408000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2399:x1875409531577984:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 124us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530154.985344:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 115 00000100:00100000:0.0:1788530154.985372:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 116 00000100:00100000:0.0:1788530154.985383:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3740b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:2400:x1875409531577856:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1788530154.985417:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3740b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:2400:x1875409531577856:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 39us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530154.985425:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 116 00000100:00080000:0.0:1788530154.985449:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788530154.985454:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788530154.985676:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531577728 00000100:00100000:1.0:1788530154.985684:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531577728 00000100:00100000:1.0:1788530154.985729:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 322 00000100:00100000:1.0:1788530154.985742:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f442bcd-b742-4e76-ad7b-709f731358a0+10:2399:x1875409531577728:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1788530154.985781:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f442bcd-b742-4e76-ad7b-709f731358a0+10:2399:x1875409531577728:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 44us (921us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530154.985789:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 322 00010000:00010000:0.0:1788530155.713216:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530156.736743:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788530157.125626:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37372d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555773568:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788530157.125729:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530157.125816:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555773568 00000100:00100000:3.0:1788530157.125826:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555773568 00000100:00100000:3.0:1788530157.125875:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788530157.125884:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37372680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555773568:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788530157.125917:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788530157.125963:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37372680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555773568:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530157.125984:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788530157.126046:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37372d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555773568:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788530157.633643:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37377800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875409555773824:0@lo:400:kworker.0 00000100:00100000:1.0:1788530157.633734:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530157.633792:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37374380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875409555774336:0@lo:400:kworker.0 00000100:00100000:1.0:1788530157.633826:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530157.633848:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37375180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875409555774848:0@lo:400:kworker.0 00000100:00100000:1.0:1788530157.633866:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530157.633896:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788530157.633901:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37375500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3650:1875409555773696:0@lo:400:kworker.0 00000100:00100000:1.0:1788530157.633926:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530157.633945:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37376300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875409555774208:0@lo:400:kworker.0 00000100:00100000:1.0:1788530157.633982:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530157.634002:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37377b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875409555774720:0@lo:400:kworker.0 00000100:00100000:1.0:1788530157.634023:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530157.634056:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555773824 00000100:00100000:1.0:1788530157.634066:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555773824 00000100:00100000:1.0:1788530157.634167:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555774336 00000100:00100000:1.0:1788530157.634171:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555774336 00000100:00100000:1.0:1788530157.634194:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555774848 00000100:00100000:1.0:1788530157.634197:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555774848 00000100:00100000:1.0:1788530157.634220:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555774208 00000100:00100000:1.0:1788530157.634223:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555774208 00000100:00100000:1.0:1788530157.634234:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555774720 00000100:00100000:1.0:1788530157.634237:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555774720 00000100:00100000:1.0:1788530157.634251:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788530157.634258:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37375f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875409555773824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530157.634314:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37375f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875409555773824:12345-0@lo:400:kworker.0 Request processed in 56us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530157.634322:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788530157.634343:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788530157.634349:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37374700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875409555774336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530157.634628:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37374700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875409555774336:12345-0@lo:400:kworker.0 Request processed in 279us (800us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530157.634635:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788530157.634650:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788530157.634656:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37374000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875409555774848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530157.634683:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37374000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875409555774848:12345-0@lo:400:kworker.0 Request processed in 28us (815us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530157.634688:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788530157.634699:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788530157.634704:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875409555774208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530157.634726:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875409555774208:12345-0@lo:400:kworker.0 Request processed in 22us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530157.634731:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788530157.634741:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788530157.634747:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875409555774720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530157.634782:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875409555774720:12345-0@lo:400:kworker.0 Request processed in 36us (758us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530157.634788:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788530157.634931:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37375880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875409555773952:0@lo:400:kworker.0 00000100:00100000:3.0:1788530157.634963:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530157.640009:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37374e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555774464:0@lo:400:kworker.0 00000100:00100000:1.0:1788530157.640476:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555773952 00000100:00100000:1.0:1788530157.640487:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555773952 00000100:00100000:1.0:1788530157.640546:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788530157.640556:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37372d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875409555773952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530157.640633:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37372d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875409555773952:12345-0@lo:400:kworker.0 Request processed in 78us (5669us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530157.640639:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788530157.640670:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555773696 00000100:00100000:1.0:1788530157.640674:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555773696 00000100:00100000:1.0:1788530157.640697:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1788530157.640702:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:3650:x1875409555773696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530157.640729:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:3650:x1875409555773696:12345-0@lo:400:kworker.0 Request processed in 26us (6802us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530157.640735:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00080000:1.0:1788530157.640767:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788530157.640772:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788530157.640799:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37409c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555775360:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788530157.641911:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530157.641974:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37376680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555774976:0@lo:400:kworker.0 00000100:00100000:3.0:1788530157.642027:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530157.642063:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3740aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555775488:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788530157.642210:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530157.642257:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37375500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3650:1875409555773696:0@lo:400:kworker.0 00000100:00100000:1.0:1788530157.642275:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37376300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875409555774208:0@lo:400:kworker.0 00000100:00100000:1.0:1788530157.642287:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37377b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875409555774720:0@lo:400:kworker.0 00000100:00100000:1.0:1788530157.642300:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37377800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875409555773824:0@lo:400:kworker.0 00010000:00080000:1.0:1788530157.642336:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f37374380 x1875409555774336/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530173 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530157.642347:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37374380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875409555774336:0@lo:400:kworker.0 00000100:00100000:0.0:1788530157.642508:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555774464 00000100:00100000:0.0:1788530157.642516:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555774464 00000100:00100000:0.0:1788530157.642582:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555774976 00000100:00100000:0.0:1788530157.642586:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555774976 00000100:00100000:0.0:1788530157.642609:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788530157.642619:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f33f9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555774464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530157.642672:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f33f9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555774464:12345-0@lo:400:kworker.0 Request processed in 55us (1319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530157.642680:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788530157.642928:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530157.642958:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37375880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875409555773952:0@lo:400:kworker.0 00010000:00080000:3.0:1788530157.642968:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f37374e00 x1875409555774464/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788530173 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530157.642976:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37374e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555774464:0@lo:400:kworker.0 00000100:00100000:3.0:1788530157.642996:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788530157.643003:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37374a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555774080:0@lo:400:kworker.0 00000100:00100000:3.0:1788530157.643028:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530157.643046:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37377100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555774592:0@lo:400:kworker.0 00000100:00100000:3.0:1788530157.643066:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530157.643205:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788530157.643213:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37370e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555774976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530157.643245:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37370e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555774976:12345-0@lo:400:kworker.0 Request processed in 33us (1218us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530157.643251:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:1.0:1788530157.643936:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f37375180 x1875409555774848/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530173 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530157.643951:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37375180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875409555774848:0@lo:400:kworker.0 00000100:00100000:1.0:1788530157.643982:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788530157.643991:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0231c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555775232:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788530157.644027:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530157.644338:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37376d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555775104:0@lo:400:kworker.0 00000100:00100000:3.0:1788530157.644443:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788530157.644475:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f37376680 x1875409555774976/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788530173 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530157.644494:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37376680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555774976:0@lo:400:kworker.0 00000100:00100000:3.0:1788530157.644651:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555774592 00000100:00100000:3.0:1788530157.644658:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555774592 00000100:00100000:3.0:1788530157.644703:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555775104 00000100:00100000:3.0:1788530157.644706:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555775104 00000100:00100000:3.0:1788530157.644721:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788530157.644728:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37371f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555774592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530157.644764:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37371f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555774592:12345-0@lo:400:kworker.0 Request processed in 37us (1697us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530157.644771:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788530157.644784:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788530157.644790:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37371880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555775104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530157.645168:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555775360 00000100:00100000:1.0:1788530157.645173:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555775360 00000100:00100000:1.0:1788530157.645199:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555775488 00000100:00100000:1.0:1788530157.645202:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555775488 00000100:00100000:1.0:1788530157.645213:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555775232 00000100:00100000:1.0:1788530157.645215:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555775232 00000100:00100000:1.0:1788530157.645228:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788530157.645235:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555775360:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788530157.645260:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788530157.645478:0:9912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788530157.645502:0:9912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37370380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555775488:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788530157.645521:0:9912:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788530157.648209:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555774080 00000100:00100000:2.0:1788530157.648231:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555774080 00000100:00100000:2.0:1788530157.648301:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788530157.648313:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37370700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555774080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530157.648454:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37371880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3647:x1875409555775104:12345-0@lo:400:kworker.0 Request processed in 3659us (4006us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530157.648469:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788530157.648523:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37372300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555775616:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788530157.650056:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555775360:12345-0@lo:13:osp-pre-0-1.0 Request processed in 4809us (7833us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530157.650083:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788530157.650140:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788530157.650153:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555775232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788530157.650184:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788530157.650233:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555775232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (6205us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530157.650257:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:1.0:1788530157.650287:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788530157.650294:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788530157.650337:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e0231c700 x1875409555775232/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530173 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530157.650378:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0231c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555775232:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1788530157.650396:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f37409c00 x1875409555775360/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530173 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530157.650409:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37409c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555775360:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788530157.657004:0:9912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37370380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555775488:12345-0@lo:13:osp-pre-1-1.0 Request processed in 11487us (14057us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530157.657023:0:9912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788530157.657651:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37370700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555774080:12345-0@lo:400:kworker.0 Request processed in 9336us (14617us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530157.657664:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788530157.657754:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37374a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555774080:0@lo:400:kworker.0 00010000:00080000:2.0:1788530157.657774:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f37377100 x1875409555774592/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788530173 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530157.657785:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37377100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555774592:0@lo:400:kworker.0 00010000:00080000:2.0:1788530157.657819:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f37376d80 x1875409555775104/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788530173 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530157.657828:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37376d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555775104:0@lo:400:kworker.0 00010000:00080000:2.0:1788530157.657841:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f3740aa00 x1875409555775488/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530173 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530157.657859:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3740aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555775488:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788530157.664180:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530157.669973:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555775616 00000100:00100000:0.0:1788530157.669992:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555775616 00000100:00100000:0.0:1788530157.670077:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788530157.670099:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0231e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555775616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788530157.670130:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788530157.670237:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0231e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555775616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 149us (6066us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530157.670245:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:0.0:1788530157.670326:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f37372300 x1875409555775616/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530173 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530157.670486:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37372300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555775616:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788530157.760895:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788530157.909689:0:11232:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.5 00000100:00100000:0.0:1788530158.656945:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37372300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555775744:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788530158.657056:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530158.657116:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555775744 00000100:00100000:3.0:1788530158.657125:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555775744 00000100:00100000:3.0:1788530158.657191:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788530158.657203:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37409500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555775744:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788530158.657253:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446453248 avail 1300213760 00000100:00100000:3.0:1788530158.657322:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37409500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555775744:12345-0@lo:41:osp-pre-1-0.0 Request processed in 121us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530158.657329:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788530158.657402:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37372300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555775744:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788530158.787062:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530159.809000:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788530160.107444:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530160.107549:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530160.107632:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530160.107891:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531578368 00000100:00100000:2.0:1788530160.107902:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531578368 00000100:00100000:2.0:1788530160.107980:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531578240 00000100:00100000:2.0:1788530160.107983:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531578240 00000100:00100000:2.0:1788530160.108009:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 123 00000100:00100000:2.0:1788530160.108036:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3740b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2400:x1875409531578368:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1788530160.108134:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3740b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2400:x1875409531578368:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 100us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530160.108141:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 123 00000100:00100000:2.0:1788530160.108160:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 124 00000100:00100000:2.0:1788530160.108166:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3740aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:2400:x1875409531578240:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1788530160.108204:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3740aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:2400:x1875409531578240:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 38us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530160.108211:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 124 00000100:00080000:0.0:1788530160.108643:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788530160.108655:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788530160.112090:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531578112 00000100:00100000:3.0:1788530160.112107:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531578112 00000100:00100000:3.0:1788530160.112253:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 324 00000100:00100000:3.0:1788530160.112265:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f442bcd-b742-4e76-ad7b-709f731358a0+10:2400:x1875409531578112:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1788530160.112373:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f442bcd-b742-4e76-ad7b-709f731358a0+10:2400:x1875409531578112:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 109us (4939us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530160.112381:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 324 00010000:00010000:0.0:1788530160.844026:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788530161.200237:0:11329:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.5 00010000:00010000:0.0:1788530161.856953:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788530162.240915:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788530162.240945:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37372300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555775872:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788530162.241028:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530162.241189:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555775872 00000100:00100000:2.0:1788530162.241198:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555775872 00000100:00100000:2.0:1788530162.241250:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788530162.241261:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37409c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555775872:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788530162.241299:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788530162.241354:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37409c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555775872:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530162.241361:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788530162.241645:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37372300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555775872:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788530162.752807:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788530162.752838:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37408700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555776000:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788530162.752915:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530162.752993:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555776000 00000100:00100000:0.0:1788530162.753001:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555776000 00000100:00100000:0.0:1788530162.753069:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788530162.753088:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3740a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555776000:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788530162.753124:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788530162.753171:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3740a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555776000:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530162.753177:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:0.0:1788530162.753199:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788530162.753229:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f37408700 x1875409555776000/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530178 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530162.753246:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37408700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555776000:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788530162.753417:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788530162.753430:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03c90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555776128:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788530162.753468:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530162.753530:0:9912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555776128 00000100:00100000:1.0:1788530162.753535:0:9912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555776128 00000100:00100000:1.0:1788530162.753624:0:9912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788530162.753632:0:9912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0231c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555776128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788530162.753649:0:9912:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788530162.753681:0:9912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0231c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555776128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 50us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530162.753687:0:9912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788530162.753780:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03c90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875409555776384:0@lo:400:kworker.0 00000100:00100000:1.0:1788530162.753806:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530162.753827:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03c91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875409555776896:0@lo:400:kworker.0 00000100:00100000:1.0:1788530162.753846:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530162.753862:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03c90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555777408:0@lo:400:kworker.0 00000100:00100000:1.0:1788530162.753884:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530162.753905:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788530162.753924:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03c92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3650:1875409555776256:0@lo:400:kworker.0 00000100:00100000:1.0:1788530162.753950:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530162.753971:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03c93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875409555776768:0@lo:400:kworker.0 00000100:00100000:1.0:1788530162.754004:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530162.754021:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03c91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875409555777280:0@lo:400:kworker.0 00000100:00100000:1.0:1788530162.754051:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530162.754076:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555776384 00000100:00100000:1.0:1788530162.754092:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555776384 00000100:00100000:1.0:1788530162.754130:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555776896 00000100:00100000:1.0:1788530162.754133:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555776896 00000100:00100000:1.0:1788530162.754150:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555776768 00000100:00100000:1.0:1788530162.754153:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555776768 00000100:00100000:1.0:1788530162.754165:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555777280 00000100:00100000:1.0:1788530162.754167:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555777280 00000100:00100000:1.0:1788530162.754181:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788530162.754188:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875409555776384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530162.754225:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875409555776384:12345-0@lo:400:kworker.0 Request processed in 38us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530162.754232:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788530162.754244:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788530162.754251:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875409555776896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530162.754277:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875409555776896:12345-0@lo:400:kworker.0 Request processed in 26us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530162.754283:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788530162.754294:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788530162.754300:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0375dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875409555776768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530162.754324:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0375dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875409555776768:12345-0@lo:400:kworker.0 Request processed in 25us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530162.754337:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788530162.754349:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788530162.754355:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0375ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875409555777280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530162.754383:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0375ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875409555777280:12345-0@lo:400:kworker.0 Request processed in 28us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530162.754389:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788530162.754410:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555776256 00000100:00100000:1.0:1788530162.754413:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555776256 00000100:00100000:1.0:1788530162.754436:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1788530162.754441:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:3650:x1875409555776256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530162.754468:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:3650:x1875409555776256:12345-0@lo:400:kworker.0 Request processed in 27us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530162.754474:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1788530162.754515:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03c92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3650:1875409555776256:0@lo:400:kworker.0 00000100:00100000:1.0:1788530162.754525:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03c93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875409555776768:0@lo:400:kworker.0 00010000:00080000:1.0:1788530162.754534:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e03c91f80 x1875409555777280/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530178 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530162.754543:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03c91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875409555777280:0@lo:400:kworker.0 00000100:00100000:1.0:1788530162.754551:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03c90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875409555776384:0@lo:400:kworker.0 00010000:00080000:1.0:1788530162.754580:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e03c91180 x1875409555776896/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530178 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530162.754588:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03c91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875409555776896:0@lo:400:kworker.0 00000100:00100000:2.0:1788530162.754715:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555777408 00000100:00100000:2.0:1788530162.754719:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555777408 00000100:00100000:2.0:1788530162.754757:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788530162.754764:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555777408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530162.754801:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555777408:12345-0@lo:400:kworker.0 Request processed in 38us (916us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530162.754815:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:2.0:1788530162.754837:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788530162.754842:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788530162.754844:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788530162.754846:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788530162.754856:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03c90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875409555776512:0@lo:400:kworker.0 00000100:00100000:2.0:1788530162.754882:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530162.754900:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03c92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555777024:0@lo:400:kworker.0 00000100:00100000:2.0:1788530162.754922:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530162.754939:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0231ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555777536:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788530162.754959:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788530162.754980:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e03c90a80 x1875409555776128/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530178 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530162.754995:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03c90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555776128:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788530162.755006:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788530162.755011:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03c93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555776640:0@lo:400:kworker.0 00000100:00100000:2.0:1788530162.755034:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530162.755238:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03c92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875409555777152:0@lo:400:kworker.0 00000100:00100000:2.0:1788530162.755260:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530162.755289:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555777024 00000100:00100000:2.0:1788530162.755293:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555777024 00000100:00100000:2.0:1788530162.755327:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788530162.755333:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f328e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555777024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530162.755367:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f328e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555777024:12345-0@lo:400:kworker.0 Request processed in 34us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530162.755382:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788530162.755403:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555776640 00000100:00100000:2.0:1788530162.755407:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555776640 00000100:00100000:2.0:1788530162.755437:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788530162.755444:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f328e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555776640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530162.755476:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f328e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555776640:12345-0@lo:400:kworker.0 Request processed in 32us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530162.755481:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788530162.755497:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555776512 00000100:00100000:2.0:1788530162.755501:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555776512 00000100:00100000:2.0:1788530162.755534:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555777152 00000100:00100000:2.0:1788530162.755537:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555777152 00000100:00100000:2.0:1788530162.755611:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788530162.755619:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0231e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875409555776512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530162.755648:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0231e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875409555776512:12345-0@lo:400:kworker.0 Request processed in 32us (765us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530162.755654:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788530162.755665:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788530162.755671:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f328e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875409555777152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530162.755694:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f328e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875409555777152:12345-0@lo:400:kworker.0 Request processed in 24us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530162.755700:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:2.0:1788530162.755739:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788530162.755743:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788530162.755770:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e03c90700 x1875409555777408/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788530178 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530162.755780:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03c90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555777408:0@lo:400:kworker.0 00000100:00100000:2.0:1788530162.755815:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03c93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555776640:0@lo:400:kworker.0 00000100:00100000:2.0:1788530162.755824:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03c92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875409555777152:0@lo:400:kworker.0 00000100:00100000:2.0:1788530162.755833:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03c90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875409555776512:0@lo:400:kworker.0 00010000:00080000:2.0:1788530162.755842:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e03c92680 x1875409555777024/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788530178 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530162.755849:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03c92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555777024:0@lo:400:kworker.0 00000100:00100000:0.0:1788530162.756379:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555777536 00000100:00100000:0.0:1788530162.756384:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555777536 00000100:00100000:0.0:1788530162.756424:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788530162.756431:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f328e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555777536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788530162.756446:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788530162.756492:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f328e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555777536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (1531us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530162.756498:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788530162.756524:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37408700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555777664:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788530162.756552:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530162.756605:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555777664 00000100:00100000:0.0:1788530162.756609:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555777664 00000100:00100000:0.0:1788530162.756630:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788530162.756636:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37409180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555777664:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788530162.756647:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788530162.756676:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37409180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555777664:12345-0@lo:13:osp-pre-0-1.0 Request processed in 40us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530162.756681:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:0.0:1788530162.756710:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f37408700 x1875409555777664/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530178 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530162.756724:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37408700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555777664:0@lo:13:osp-pre-0-1.0 00010000:00080000:2.0:1788530162.757141:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e0231ea00 x1875409555777536/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530178 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530162.757154:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0231ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555777536:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788530162.883146:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788530163.653127:0:11378:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Fri Sep 4 09:56:00 EDT 2026 00000100:00100000:2.0:1788530163.782284:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788530163.782325:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37372300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555777792:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788530163.782460:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530163.782545:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555777792 00000100:00100000:2.0:1788530163.782554:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555777792 00000100:00100000:2.0:1788530163.782658:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788530163.782677:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f08cd1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555777792:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788530163.782740:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446453248 avail 1300213760 00000100:00100000:2.0:1788530163.782840:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f08cd1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555777792:12345-0@lo:41:osp-pre-1-0.0 Request processed in 168us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530163.782854:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788530163.783453:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37372300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555777792:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788530163.905818:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530164.934439:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788530165.224414:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530165.224461:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530165.224541:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530165.224597:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531578752 00000100:00100000:3.0:1788530165.224607:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531578752 00000100:00100000:3.0:1788530165.224689:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531578624 00000100:00100000:3.0:1788530165.224694:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531578624 00000100:00100000:3.0:1788530165.224722:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 131 00000100:00100000:3.0:1788530165.224732:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37372300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2399:x1875409531578752:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1788530165.224833:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37372300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2399:x1875409531578752:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 102us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530165.224841:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 131 00000100:00100000:3.0:1788530165.224858:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 132 00000100:00100000:3.0:1788530165.224863:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37372a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:2399:x1875409531578624:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1788530165.224887:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37372a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:2399:x1875409531578624:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 24us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530165.224893:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 132 00000100:00080000:3.0:1788530165.224934:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788530165.224938:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788530165.225697:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531578496 00000100:00100000:1.0:1788530165.225707:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531578496 00000100:00100000:1.0:1788530165.225771:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 326 00000100:00100000:1.0:1788530165.225780:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f442bcd-b742-4e76-ad7b-709f731358a0+10:2399:x1875409531578496:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1788530165.225847:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f442bcd-b742-4e76-ad7b-709f731358a0+10:2399:x1875409531578496:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 68us (1443us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530165.225854:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 326 00010000:00010000:2.0:1788530165.955491:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530166.977144:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788530167.367255:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37408700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555777920:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788530167.367347:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530167.367458:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555777920 00000100:00100000:0.0:1788530167.367468:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555777920 00000100:00100000:0.0:1788530167.367521:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788530167.367532:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37409880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555777920:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788530167.367597:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788530167.367651:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37409880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555777920:12345-0@lo:41:osp-pre-0-1.0 Request processed in 120us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530167.367658:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788530167.367732:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37408700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555777920:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788530167.875835:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0375d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875409555778304:0@lo:400:kworker.0 00000100:00100000:1.0:1788530167.875927:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530167.875976:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0375ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555778816:0@lo:400:kworker.0 00000100:00100000:1.0:1788530167.876014:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530167.876039:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0375e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555779328:0@lo:400:kworker.0 00000100:00100000:1.0:1788530167.876217:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530167.876266:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788530167.876274:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0375ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555778432:0@lo:400:kworker.0 00000100:00100000:1.0:1788530167.876303:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530167.876323:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0375f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555778944:0@lo:400:kworker.0 00000100:00100000:1.0:1788530167.876345:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530167.876364:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0375ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555779456:0@lo:400:kworker.0 00000100:00100000:1.0:1788530167.876385:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530167.876425:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555778304 00000100:00100000:1.0:1788530167.876433:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555778304 00000100:00100000:1.0:1788530167.876493:0:10719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788530167.876520:0:10719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0375df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875409555778304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530167.876605:0:10719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0375df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875409555778304:12345-0@lo:400:kworker.0 Request processed in 86us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530167.876612:0:10719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788530167.876636:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555778816 00000100:00100000:1.0:1788530167.876639:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555778816 00000100:00100000:1.0:1788530167.876662:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555779328 00000100:00100000:1.0:1788530167.876664:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555779328 00000100:00100000:1.0:1788530167.876673:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555778944 00000100:00100000:1.0:1788530167.876675:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555778944 00000100:00100000:1.0:1788530167.876683:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555779456 00000100:00100000:1.0:1788530167.876685:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555779456 00000100:00100000:1.0:1788530167.876696:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788530167.876702:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0375c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555778816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530167.876728:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0375c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555778816:12345-0@lo:400:kworker.0 Request processed in 27us (714us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530167.876733:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788530167.876743:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788530167.876748:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0375c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555779328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530167.876767:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0375c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555779328:12345-0@lo:400:kworker.0 Request processed in 19us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530167.876772:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788530167.876781:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788530167.876786:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555778944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530167.876805:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555778944:12345-0@lo:400:kworker.0 Request processed in 19us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530167.876809:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788530167.877108:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0375d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3647:1875409555778048:0@lo:400:kworker.0 00000100:00100000:3.0:1788530167.877142:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530167.877168:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0375e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875409555778560:0@lo:400:kworker.0 00000100:00100000:3.0:1788530167.877189:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530167.877203:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0375fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875409555779072:0@lo:400:kworker.0 00000100:00100000:3.0:1788530167.877218:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530167.877234:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788530167.877240:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0375f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875409555778176:0@lo:400:kworker.0 00000100:00100000:3.0:1788530167.877267:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530167.877284:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0375c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875409555778688:0@lo:400:kworker.0 00000100:00100000:3.0:1788530167.877305:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530167.877323:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0375d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875409555779200:0@lo:400:kworker.0 00000100:00100000:3.0:1788530167.877356:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788530167.877385:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788530167.877389:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788530167.877400:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555778048 00000100:00100000:3.0:1788530167.877404:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555778048 00000100:00100000:3.0:1788530167.877432:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:3.0:1788530167.877439:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:3647:x1875409555778048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530167.877470:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:3647:x1875409555778048:12345-0@lo:400:kworker.0 Request processed in 33us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530167.877476:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:3.0:1788530167.877502:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555778560 00000100:00100000:3.0:1788530167.877505:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555778560 00000100:00100000:3.0:1788530167.877542:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555779072 00000100:00100000:3.0:1788530167.877545:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555779072 00000100:00100000:3.0:1788530167.877556:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555778176 00000100:00100000:3.0:1788530167.877580:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555778176 00000100:00100000:3.0:1788530167.877593:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555778688 00000100:00100000:3.0:1788530167.877596:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555778688 00000100:00100000:3.0:1788530167.877607:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555779200 00000100:00100000:3.0:1788530167.877609:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555779200 00000100:00100000:3.0:1788530167.877622:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788530167.877628:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37370a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875409555778560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530167.877657:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37370a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875409555778560:12345-0@lo:400:kworker.0 Request processed in 28us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530167.877662:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788530167.877671:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788530167.877677:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37373100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875409555779072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530167.877698:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37373100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875409555779072:12345-0@lo:400:kworker.0 Request processed in 22us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530167.877704:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788530167.877713:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788530167.877718:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37372680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875409555778176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530167.877741:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37372680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875409555778176:12345-0@lo:400:kworker.0 Request processed in 23us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530167.877747:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788530167.877756:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788530167.877762:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37370700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875409555778688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530167.877783:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37370700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875409555778688:12345-0@lo:400:kworker.0 Request processed in 22us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530167.877797:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788530167.877807:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788530167.878003:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875409555779200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530167.878035:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875409555779200:12345-0@lo:400:kworker.0 Request processed in 223us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530167.878042:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00080000:3.0:1788530167.878128:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788530167.878132:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788530167.878167:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0375f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875409555778176:0@lo:400:kworker.0 00010000:00080000:3.0:1788530167.878181:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e0375c380 x1875409555778688/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530183 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530167.878191:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0375c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875409555778688:0@lo:400:kworker.0 00010000:00080000:3.0:1788530167.878201:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e0375d180 x1875409555779200/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530183 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530167.878209:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0375d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875409555779200:0@lo:400:kworker.0 00000100:00100000:3.0:1788530167.878217:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0375d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3647:1875409555778048:0@lo:400:kworker.0 00000100:00100000:3.0:1788530167.878226:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0375e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875409555778560:0@lo:400:kworker.0 00000100:00100000:3.0:1788530167.878235:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0375fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875409555779072:0@lo:400:kworker.0 00000100:00100000:0.0:1788530167.878886:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3740a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555779712:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788530167.878936:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530167.878970:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788530167.878977:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37408700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555779584:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788530167.879010:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530167.879039:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555779712 00000100:00100000:0.0:1788530167.879044:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555779712 00000100:00100000:0.0:1788530167.879098:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555779584 00000100:00100000:0.0:1788530167.879102:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555779584 00000100:00100000:0.0:1788530167.879116:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788530167.879123:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37408a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555779712:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788530167.879150:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788530167.879187:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37408a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555779712:12345-0@lo:13:osp-pre-1-1.0 Request processed in 63us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530167.879193:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788530167.879207:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788530167.879213:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37408380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555779584:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788530167.879227:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788530167.879251:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37408380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555779584:12345-0@lo:13:osp-pre-0-1.0 Request processed in 39us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530167.879451:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:0.0:1788530167.879491:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f37408700 x1875409555779584/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530183 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530167.879508:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37408700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555779584:0@lo:13:osp-pre-0-1.0 00010000:00080000:0.0:1788530167.879519:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f3740a300 x1875409555779712/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530183 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530167.879543:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3740a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555779712:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788530167.881118:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788530167.881139:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555779456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530167.881225:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555779456:12345-0@lo:400:kworker.0 Request processed in 97us (4839us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530167.881248:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788530167.885940:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788530167.885968:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3740a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555779840:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788530167.886086:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530167.886186:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555779840 00000100:00100000:0.0:1788530167.886198:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555779840 00000100:00100000:0.0:1788530167.886273:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788530167.886287:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f328e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555779840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788530167.886317:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788530167.886375:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f328e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555779840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530167.886382:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788530167.888808:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555779968:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788530167.888934:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788530167.889001:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f3740a300 x1875409555779840/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530183 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530167.889033:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3740a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555779840:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788530167.889097:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555779968 00000100:00100000:2.0:1788530167.889105:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555779968 00000100:00100000:2.0:1788530167.889154:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788530167.889164:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f328e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555779968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788530167.889191:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788530167.889237:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f328e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555779968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530167.889244:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:2.0:1788530167.889488:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e037d5880 x1875409555779968/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530183 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530167.889502:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555779968:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788530167.891116:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555778432 00000100:00100000:1.0:1788530167.891135:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555778432 00000100:00100000:1.0:1788530167.891206:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788530167.891219:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0375f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555778432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530167.891514:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0375f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555778432:12345-0@lo:400:kworker.0 Request processed in 298us (15209us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530167.891523:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788530167.891629:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0375ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555778432:0@lo:400:kworker.0 00010000:00080000:1.0:1788530167.891649:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e0375f100 x1875409555778944/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788530183 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530167.891661:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0375f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555778944:0@lo:400:kworker.0 00010000:00080000:1.0:1788530167.891674:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e0375ed80 x1875409555779456/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788530183 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530167.891682:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0375ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555779456:0@lo:400:kworker.0 00000100:00100000:1.0:1788530167.891695:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0375d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875409555778304:0@lo:400:kworker.0 00010000:00080000:1.0:1788530167.891707:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e0375ce00 x1875409555778816/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788530183 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530167.891713:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0375ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555778816:0@lo:400:kworker.0 00010000:00080000:1.0:1788530167.891727:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e0375e680 x1875409555779328/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788530183 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530167.891734:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0375e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555779328:0@lo:400:kworker.0 00010000:00010000:2.0:1788530168.006426:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788530168.897411:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555780096:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788530168.897493:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530168.897682:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555780096 00000100:00100000:1.0:1788530168.897693:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555780096 00000100:00100000:1.0:1788530168.897769:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788530168.897787:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37408700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555780096:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788530168.897831:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446453248 avail 1300213760 00000100:00100000:1.0:1788530168.898500:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37408700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555780096:12345-0@lo:41:osp-pre-1-0.0 Request processed in 720us (1004us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530168.898509:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788530168.898649:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555780096:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788530169.025027:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530170.054752:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788530170.343215:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530170.343400:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530170.343436:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530170.343474:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531579136 00000100:00100000:3.0:1788530170.343488:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531579136 00000100:00100000:3.0:1788530170.343605:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531579008 00000100:00100000:3.0:1788530170.343609:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531579008 00000100:00100000:3.0:1788530170.343634:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 139 00000100:00100000:3.0:1788530170.343644:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2400:x1875409531579136:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1788530170.343914:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531578880 00000100:00100000:1.0:1788530170.343920:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531578880 00000100:00100000:1.0:1788530170.343953:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 328 00000100:00100000:1.0:1788530170.343961:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f442bcd-b742-4e76-ad7b-709f731358a0+10:2400:x1875409531578880:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1788530170.344028:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f442bcd-b742-4e76-ad7b-709f731358a0+10:2400:x1875409531578880:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 67us (829us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530170.344048:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 328 00000100:00100000:3.0:1788530170.344312:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2400:x1875409531579136:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 668us (910us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530170.344320:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 139 00000100:00100000:3.0:1788530170.344336:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 140 00000100:00100000:3.0:1788530170.344343:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:2400:x1875409531579008:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1788530170.344370:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:2400:x1875409531579008:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 28us (934us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530170.344377:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 140 00000100:00080000:3.0:1788530170.344402:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788530170.344407:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1788530171.073529:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530172.096799:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788530172.489986:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555780224:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788530172.490087:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530172.491021:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555780224 00000100:00100000:1.0:1788530172.491034:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555780224 00000100:00100000:1.0:1788530172.491099:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788530172.491110:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555780224:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788530172.491170:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788530172.500452:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555780224:12345-0@lo:41:osp-pre-0-1.0 Request processed in 9330us (10352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530172.500474:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788530172.500837:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555780224:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788530172.996909:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3740a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875409555780608:0@lo:400:kworker.0 00000100:00100000:1.0:1788530172.997156:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37409500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3649:1875409555780352:0@lo:400:kworker.0 00000100:00100000:2.0:1788530172.997319:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37409c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875409555780480:0@lo:400:kworker.0 00000100:00100000:1.0:1788530173.007079:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530173.007134:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555780352 00000100:00100000:1.0:1788530173.007144:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555780352 00000100:00100000:1.0:1788530173.007223:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:1.0:1788530173.007234:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:3649:x1875409555780352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530173.007299:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:3649:x1875409555780352:12345-0@lo:400:kworker.0 Request processed in 66us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530173.007308:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:1.0:1788530173.007415:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37409500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3649:1875409555780352:0@lo:400:kworker.0 00000100:00100000:1.0:1788530173.007431:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f2b92ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875409555780864:0@lo:400:kworker.0 00000100:00100000:1.0:1788530173.007476:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530173.007507:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555780864 00000100:00100000:1.0:1788530173.007510:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555780864 00000100:00100000:1.0:1788530173.007595:0:10719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788530173.007603:0:10719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875409555780864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530173.007638:0:10719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875409555780864:12345-0@lo:400:kworker.0 Request processed in 37us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530173.007645:0:10719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00080000:1.0:1788530173.007663:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788530173.007688:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f2b92ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875409555780864:0@lo:400:kworker.0 00000100:00100000:1.0:1788530173.007696:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f2b92c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875409555781376:0@lo:400:kworker.0 00000100:00100000:1.0:1788530173.007721:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530173.007746:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555781376 00000100:00100000:1.0:1788530173.007749:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555781376 00000100:00100000:1.0:1788530173.007801:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788530173.007808:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875409555781376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530173.007842:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875409555781376:12345-0@lo:400:kworker.0 Request processed in 34us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530173.007860:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00080000:1.0:1788530173.007875:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788530173.007896:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f2b92c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875409555781376:0@lo:400:kworker.0 00000100:00100000:1.0:1788530173.007906:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555781888:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788530173.007939:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530173.007984:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555781888 00000100:00100000:1.0:1788530173.007988:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555781888 00000100:00100000:1.0:1788530173.008022:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788530173.008029:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555781888:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788530173.008059:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788530173.008099:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555781888:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530173.008105:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:1.0:1788530173.008123:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788530173.008149:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f32bd3b80 x1875409555781888/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530189 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530173.008171:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555781888:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788530173.008837:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f2b92ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555780736:0@lo:400:kworker.0 00000100:00100000:1.0:1788530173.008883:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530173.008912:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f2b92c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555781248:0@lo:400:kworker.0 00000100:00100000:1.0:1788530173.009077:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530173.009102:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f2b92d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555781760:0@lo:400:kworker.0 00000100:00100000:1.0:1788530173.009125:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530173.009164:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555780736 00000100:00100000:1.0:1788530173.009179:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555780736 00000100:00100000:0.0:1788530173.009322:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530173.009355:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f2b92fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555781120:0@lo:400:kworker.0 00000100:00100000:0.0:1788530173.009379:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530173.009414:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788530173.009424:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555780736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530173.009792:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530173.009829:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f2b92f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875409555780992:0@lo:400:kworker.0 00000100:00100000:2.0:1788530173.009858:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530173.009882:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f2b92ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875409555781504:0@lo:400:kworker.0 00000100:00100000:2.0:1788530173.009906:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530173.009950:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03c92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555782016:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788530173.009980:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530173.010113:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555780608 00000100:00100000:3.0:1788530173.010120:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555780608 00000100:00100000:3.0:1788530173.010172:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555780480 00000100:00100000:3.0:1788530173.010176:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555780480 00000100:00100000:3.0:1788530173.010195:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555780992 00000100:00100000:3.0:1788530173.010199:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555780992 00000100:00100000:3.0:1788530173.012615:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555781504 00000100:00100000:3.0:1788530173.012628:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555781504 00000100:00100000:3.0:1788530173.012660:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788530173.012684:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32bd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875409555780608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530173.012784:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32bd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875409555780608:12345-0@lo:400:kworker.0 Request processed in 102us (3462us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530173.012791:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788530173.012809:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788530173.012817:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f328e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875409555780480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530173.012856:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f328e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875409555780480:12345-0@lo:400:kworker.0 Request processed in 39us (3063us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530173.012863:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788530173.012875:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788530173.012881:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f328e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875409555780992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530173.012911:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f328e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875409555780992:12345-0@lo:400:kworker.0 Request processed in 31us (3052us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530173.012918:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788530173.012950:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788530173.012957:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f328e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875409555781504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530173.012987:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f328e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875409555781504:12345-0@lo:400:kworker.0 Request processed in 31us (3080us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530173.012993:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00080000:3.0:1788530173.013037:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788530173.013106:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37409c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875409555780480:0@lo:400:kworker.0 00010000:00080000:3.0:1788530173.013128:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f2b92f100 x1875409555780992/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530189 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530173.013141:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f2b92f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875409555780992:0@lo:400:kworker.0 00010000:00080000:3.0:1788530173.013154:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f2b92ca80 x1875409555781504/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530189 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530173.013163:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f2b92ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875409555781504:0@lo:400:kworker.0 00000100:00100000:0.0:1788530173.013885:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f2b92e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555781632:0@lo:400:kworker.0 00000100:00100000:0.0:1788530173.013949:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530173.013982:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555782144:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788530173.014012:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530173.014050:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3740a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875409555780608:0@lo:400:kworker.0 00000100:00100000:0.0:1788530173.014064:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788530173.014072:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555782272:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788530173.014114:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530173.021291:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555780736:12345-0@lo:400:kworker.0 Request processed in 11857us (12395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530173.021308:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788530173.021362:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555781248 00000100:00100000:1.0:1788530173.021373:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555781248 00000100:00100000:1.0:1788530173.021428:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555781760 00000100:00100000:1.0:1788530173.021432:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555781760 00000100:00100000:1.0:1788530173.021443:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555781120 00000100:00100000:1.0:1788530173.021446:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555781120 00000100:00100000:1.0:1788530173.021456:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555781632 00000100:00100000:1.0:1788530173.021458:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555781632 00000100:00100000:1.0:1788530173.021474:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788530173.021482:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555781248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530173.025635:0:9912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555782016 00000100:00100000:2.0:1788530173.025655:0:9912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555782016 00000100:00100000:2.0:1788530173.025727:0:9912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555782144 00000100:00100000:2.0:1788530173.025730:0:9912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555782144 00000100:00100000:2.0:1788530173.025742:0:9912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555782272 00000100:00100000:2.0:1788530173.025744:0:9912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555782272 00000100:00100000:2.0:1788530173.025763:0:9912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788530173.025774:0:9912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f328e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3650:x1875409555782016:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788530173.025826:0:9912:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788530173.025965:0:9912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f328e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3650:x1875409555782016:12345-0@lo:13:osp-pre-1-1.0 Request processed in 192us (15983us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530173.025973:0:9912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788530173.025993:0:9912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788530173.026000:0:9912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32bd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1875409555782144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788530173.026009:0:9912:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788530173.026043:0:9912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32bd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1875409555782144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 44us (12030us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530173.026049:0:9912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788530173.026060:0:9912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788530173.026067:0:9912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32bd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1875409555782272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788530173.026090:0:9912:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788530173.026121:0:9912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32bd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1875409555782272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 54us (12007us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530173.026127:0:9912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:2.0:1788530173.026172:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e037d7100 x1875409555782272/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530189 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530173.026193:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555782272:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1788530173.026323:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f328e4380 x1875409555782144/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530189 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530173.026340:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555782144:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1788530173.026390:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e03c92d80 x1875409555782016/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530189 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530173.026403:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03c92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555782016:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788530173.028826:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555781248:12345-0@lo:400:kworker.0 Request processed in 7335us (19738us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530173.028843:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788530173.028890:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788530173.028906:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555781760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530173.028989:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555781760:12345-0@lo:400:kworker.0 Request processed in 92us (19864us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530173.028996:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788530173.029008:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788530173.029016:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32bd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555781120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530173.029060:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32bd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555781120:12345-0@lo:400:kworker.0 Request processed in 46us (19679us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530173.029086:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788530173.029100:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788530173.029106:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32bd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555781632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530173.029139:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32bd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555781632:12345-0@lo:400:kworker.0 Request processed in 33us (15199us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530173.029144:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788530173.029292:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f2b92ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555780736:0@lo:400:kworker.0 00010000:00080000:1.0:1788530173.029311:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f2b92c700 x1875409555781248/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788530189 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530173.029321:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f2b92c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555781248:0@lo:400:kworker.0 00010000:00080000:1.0:1788530173.029332:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f2b92d180 x1875409555781760/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788530189 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530173.029339:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f2b92d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555781760:0@lo:400:kworker.0 00000100:00080000:1.0:1788530173.029379:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788530173.029386:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788530173.029678:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f2b92fb80 x1875409555781120/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788530189 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530173.029690:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f2b92fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555781120:0@lo:400:kworker.0 00010000:00080000:2.0:1788530173.029701:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f2b92e680 x1875409555781632/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788530189 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530173.029709:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f2b92e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555781632:0@lo:400:kworker.0 00010000:00010000:0.0:1788530173.121014:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788530174.027891:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788530174.035071:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555782400:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788530174.035165:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530174.035347:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555782400 00000100:00100000:0.0:1788530174.035357:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555782400 00000100:00100000:0.0:1788530174.035421:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788530174.035431:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555782400:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788530174.035477:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446453248 avail 1300213760 00000100:00100000:0.0:1788530174.035543:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555782400:12345-0@lo:41:osp-pre-1-0.0 Request processed in 112us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530174.035552:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788530174.036157:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555782400:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788530174.144781:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530175.181295:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788530175.473830:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530175.474013:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530175.474040:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530175.474083:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531579264 00000100:00100000:1.0:1788530175.474094:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531579264 00000100:00100000:1.0:1788530175.474150:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 330 00000100:00100000:1.0:1788530175.474161:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f442bcd-b742-4e76-ad7b-709f731358a0+10:2400:x1875409531579264:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1788530175.474384:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f442bcd-b742-4e76-ad7b-709f731358a0+10:2400:x1875409531579264:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 224us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530175.474405:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 330 00000100:00100000:1.0:1788530175.474446:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531579392 00000100:00100000:1.0:1788530175.474450:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531579392 00000100:00100000:1.0:1788530175.474506:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531579520 00000100:00100000:1.0:1788530175.474509:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531579520 00000100:00100000:1.0:1788530175.474530:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 147 00000100:00100000:1.0:1788530175.474537:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:2400:x1875409531579392:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1788530175.474682:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 148 00000100:00100000:2.0:1788530175.474711:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2400:x1875409531579520:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1788530175.474873:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:2400:x1875409531579392:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 334us (1051us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530175.474881:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 147 00000100:00100000:2.0:1788530175.476124:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2400:x1875409531579520:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 1409us (2076us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530175.476135:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 148 00000100:00080000:0.0:1788530175.476689:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788530175.476707:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788530176.193309:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530177.217142:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788530177.607136:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788530177.610829:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555782528:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788530177.610932:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530177.611039:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555782528 00000100:00100000:2.0:1788530177.611053:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555782528 00000100:00100000:2.0:1788530177.611137:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788530177.611150:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555782528:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788530177.611207:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788530177.611270:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555782528:12345-0@lo:41:osp-pre-0-1.0 Request processed in 122us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530177.611279:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788530177.611339:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555782528:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788530178.113122:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555782912:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788530178.113194:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530178.113311:0:9912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555782912 00000100:00100000:0.0:1788530178.113322:0:9912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555782912 00000100:00100000:0.0:1788530178.113392:0:9912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788530178.113402:0:9912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555782912:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788530178.113430:0:9912:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788530178.113479:0:9912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555782912:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530178.113486:0:9912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:0.0:1788530178.113529:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f32bd2d80 x1875409555782912/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530194 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530178.113549:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555782912:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1788530178.113649:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788530178.113836:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788530178.113844:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555783040:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788530178.113872:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530178.113922:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555783040 00000100:00100000:0.0:1788530178.113927:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555783040 00000100:00100000:0.0:1788530178.113955:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788530178.113962:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32bd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555783040:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788530178.113978:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788530178.114010:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32bd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555783040:12345-0@lo:13:osp-pre-0-1.0 Request processed in 48us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530178.114016:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:0.0:1788530178.114031:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788530178.114049:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f32bd2d80 x1875409555783040/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530194 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530178.114062:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555783040:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788530178.114195:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555782784:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788530178.114231:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530178.114249:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f2b92e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875409555783296:0@lo:400:kworker.0 00000100:00100000:1.0:1788530178.114274:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530178.114359:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f2b92ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875409555783808:0@lo:400:kworker.0 00000100:00100000:1.0:1788530178.114381:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530178.114401:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f2b92ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875409555784320:0@lo:400:kworker.0 00000100:00100000:1.0:1788530178.114440:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530178.114465:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:1.0:1788530178.114473:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555782656:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788530178.114495:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530178.114507:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03c92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3648:1875409555783168:0@lo:400:kworker.0 00000100:00100000:1.0:1788530178.114533:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530178.114596:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f2b92c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555783680:0@lo:400:kworker.0 00000100:00100000:1.0:1788530178.114621:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530178.114639:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f2b92c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875409555784192:0@lo:400:kworker.0 00000100:00100000:1.0:1788530178.114658:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530178.114685:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555783296 00000100:00100000:1.0:1788530178.114689:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555783296 00000100:00100000:1.0:1788530178.114727:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555783808 00000100:00100000:1.0:1788530178.114730:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555783808 00000100:00100000:1.0:1788530178.114748:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555784320 00000100:00100000:1.0:1788530178.114751:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555784320 00000100:00100000:1.0:1788530178.114762:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555784192 00000100:00100000:1.0:1788530178.114764:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555784192 00000100:00100000:1.0:1788530178.114779:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788530178.114785:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37409c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875409555783296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530178.114826:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37409c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875409555783296:12345-0@lo:400:kworker.0 Request processed in 41us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530178.114832:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788530178.114848:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788530178.114854:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37409500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875409555783808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530178.114878:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37409500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875409555783808:12345-0@lo:400:kworker.0 Request processed in 25us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530178.114884:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788530178.114907:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788530178.114914:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875409555784320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530178.114940:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875409555784320:12345-0@lo:400:kworker.0 Request processed in 27us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530178.114945:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788530178.114966:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788530178.114972:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875409555784192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530178.114999:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875409555784192:12345-0@lo:400:kworker.0 Request processed in 28us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530178.115005:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788530178.115027:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555783168 00000100:00100000:1.0:1788530178.115031:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555783168 00000100:00100000:1.0:1788530178.115052:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1788530178.115058:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:3648:x1875409555783168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530178.115086:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:3648:x1875409555783168:12345-0@lo:400:kworker.0 Request processed in 28us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530178.115091:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1788530178.115115:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555783680 00000100:00100000:1.0:1788530178.115119:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555783680 00000100:00100000:1.0:1788530178.115142:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788530178.115148:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555783680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530178.115176:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555783680:12345-0@lo:400:kworker.0 Request processed in 29us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530178.115182:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788530178.115215:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03c92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3648:1875409555783168:0@lo:400:kworker.0 00000100:00100000:1.0:1788530178.115228:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f2b92c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555783680:0@lo:400:kworker.0 00000100:00100000:1.0:1788530178.115236:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f2b92c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875409555784192:0@lo:400:kworker.0 00000100:00100000:1.0:1788530178.115245:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f2b92e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875409555783296:0@lo:400:kworker.0 00000100:00100000:1.0:1788530178.115254:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f2b92ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875409555783808:0@lo:400:kworker.0 00010000:00080000:1.0:1788530178.115276:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f2b92ce00 x1875409555784320/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530194 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530178.115421:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555782784 00000100:00100000:0.0:1788530178.115425:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555782784 00000100:00100000:0.0:1788530178.115454:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555782656 00000100:00100000:0.0:1788530178.115458:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555782656 00000100:00100000:0.0:1788530178.115473:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788530178.115479:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d4e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555782784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788530178.115497:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788530178.115531:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d4e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555782784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 52us (1299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530178.115536:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788530178.115722:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788530178.115729:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555782656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788530178.115740:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788530178.115766:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555782656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 38us (1269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530178.115782:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:0.0:1788530178.115800:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788530178.115803:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788530178.115806:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788530178.115808:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788530178.115825:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f2b92fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555783424:0@lo:400:kworker.0 00000100:00100000:0.0:1788530178.115852:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530178.115873:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f2b92ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875409555783936:0@lo:400:kworker.0 00000100:00100000:0.0:1788530178.115904:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530178.115923:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3740a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555784448:0@lo:400:kworker.0 00000100:00100000:0.0:1788530178.115945:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530178.115967:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788530178.115972:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f2b92d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875409555783552:0@lo:400:kworker.0 00000100:00100000:0.0:1788530178.115991:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530178.116006:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f2b92f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555784064:0@lo:400:kworker.0 00000100:00100000:0.0:1788530178.116021:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530178.116045:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555784448 00000100:00100000:0.0:1788530178.116048:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555784448 00000100:00100000:0.0:1788530178.116070:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555784064 00000100:00100000:0.0:1788530178.116072:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555784064 00000100:00100000:0.0:1788530178.116086:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788530178.116092:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32bd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555784448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530178.116119:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32bd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555784448:12345-0@lo:400:kworker.0 Request processed in 28us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530178.116125:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788530178.116136:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788530178.116148:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32bd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555784064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530178.116173:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32bd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555784064:12345-0@lo:400:kworker.0 Request processed in 26us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530178.116178:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788530178.116203:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555783936 00000100:00100000:0.0:1788530178.116206:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555783936 00000100:00100000:0.0:1788530178.116240:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555783552 00000100:00100000:0.0:1788530178.116242:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555783552 00000100:00100000:0.0:1788530178.116259:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788530178.116265:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32bd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875409555783936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530178.117437:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f2b92ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875409555784320:0@lo:400:kworker.0 00010000:00080000:1.0:1788530178.117511:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e037d7b80 x1875409555782656/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530194 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530178.117532:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555782656:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1788530178.117544:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e037d6680 x1875409555782784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530194 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530178.117556:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555782784:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788530178.117613:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555783424 00000100:00100000:1.0:1788530178.117618:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555783424 00000100:00100000:1.0:1788530178.117652:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788530178.117661:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32bd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555783424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530178.117738:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32bd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555783424:12345-0@lo:400:kworker.0 Request processed in 77us (1884us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530178.117746:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788530178.117773:0:10719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788530178.117781:0:10719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32bd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875409555783552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530178.117816:0:10719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32bd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875409555783552:12345-0@lo:400:kworker.0 Request processed in 36us (1823us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530178.117821:0:10719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788530178.117995:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32bd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875409555783936:12345-0@lo:400:kworker.0 Request processed in 1727us (2098us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530178.118004:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00080000:0.0:1788530178.118054:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788530178.118094:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f2b92d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875409555783552:0@lo:400:kworker.0 00010000:00080000:0.0:1788530178.118107:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f2b92f100 x1875409555784064/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788530194 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530178.118115:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f2b92f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555784064:0@lo:400:kworker.0 00000100:00100000:0.0:1788530178.118125:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f2b92fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555783424:0@lo:400:kworker.0 00010000:00080000:0.0:1788530178.118137:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f2b92ca80 x1875409555783936/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530194 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530178.118146:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f2b92ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875409555783936:0@lo:400:kworker.0 00010000:00080000:0.0:1788530178.118158:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f3740a300 x1875409555784448/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788530194 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530178.118165:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3740a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555784448:0@lo:400:kworker.0 00010000:00010000:2.0:1788530178.241516:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788530179.145072:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32a55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555784576:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788530179.145171:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530179.145271:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555784576 00000100:00100000:2.0:1788530179.145282:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555784576 00000100:00100000:2.0:1788530179.145343:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788530179.145353:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555784576:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788530179.145398:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446453248 avail 1300213760 00000100:00100000:2.0:1788530179.145454:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555784576:12345-0@lo:41:osp-pre-1-0.0 Request processed in 102us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530179.145472:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788530179.145524:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32a55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555784576:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788530179.265440:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530180.288966:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788530180.589413:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530180.592498:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530180.593145:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531579648 00000100:00100000:1.0:1788530180.593161:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531579648 00000100:00100000:1.0:1788530180.593242:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 332 00000100:00100000:1.0:1788530180.593255:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f442bcd-b742-4e76-ad7b-709f731358a0+10:2401:x1875409531579648:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1788530180.593363:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f442bcd-b742-4e76-ad7b-709f731358a0+10:2401:x1875409531579648:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 110us (875us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530180.593372:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 332 00000100:00100000:3.0:1788530180.595410:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530180.602187:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531579776 00000100:00100000:0.0:1788530180.602202:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531579776 00000100:00100000:0.0:1788530180.602333:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531579904 00000100:00100000:0.0:1788530180.602338:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531579904 00000100:00100000:0.0:1788530180.602380:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 155 00000100:00100000:0.0:1788530180.602391:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:2402:x1875409531579776:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1788530180.602502:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:2402:x1875409531579776:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 112us (13100us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530180.602512:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 155 00000100:00100000:0.0:1788530180.602534:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 156 00000100:00100000:0.0:1788530180.602542:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2401:x1875409531579904:12345-192.168.202.41@tcp:400:kworker.0 00000100:00080000:2.0:1788530180.602815:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788530180.602820:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788530180.602945:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2401:x1875409531579904:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 402us (7548us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530180.602952:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 156 00010000:00010000:2.0:1788530181.317906:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530182.345815:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788530182.721448:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788530182.721484:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32a55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555784704:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788530182.721593:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530182.721759:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555784704 00000100:00100000:2.0:1788530182.721768:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555784704 00000100:00100000:2.0:1788530182.721820:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788530182.721830:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555784704:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788530182.721877:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788530182.721937:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555784704:12345-0@lo:41:osp-pre-0-1.0 Request processed in 108us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530182.721945:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788530182.721995:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32a55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555784704:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788530183.239148:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555784832:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788530183.239245:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530183.239338:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555784960:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788530183.239361:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530183.239401:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555784832 00000100:00100000:3.0:1788530183.239410:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555784832 00000100:00100000:3.0:1788530183.239461:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555784960 00000100:00100000:3.0:1788530183.239463:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555784960 00000100:00100000:3.0:1788530183.239478:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788530183.239487:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555784832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788530183.239537:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788530183.239842:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555784832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 354us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530183.239859:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788530183.239877:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788530183.239883:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555784960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788530183.239898:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788530183.239924:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555784960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 42us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530183.239930:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:3.0:1788530183.239947:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788530183.239951:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788530183.239978:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e037d4000 x1875409555784960/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530199 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530183.239998:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555784960:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1788530183.240030:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e037d4700 x1875409555784832/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530199 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530183.240041:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555784832:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788530183.241251:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555785088:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788530183.241309:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530183.241365:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555785216:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788530183.241385:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530183.241423:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555785088 00000100:00100000:3.0:1788530183.241430:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555785088 00000100:00100000:3.0:1788530183.241482:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555785216 00000100:00100000:3.0:1788530183.241485:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555785216 00000100:00100000:3.0:1788530183.241500:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788530183.241508:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555785088:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788530183.241529:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788530183.241589:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555785088:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530183.241596:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788530183.241817:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788530183.241825:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555785216:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788530183.241835:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788530183.241881:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555785216:12345-0@lo:13:osp-pre-1-1.0 Request processed in 57us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530183.241886:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:3.0:1788530183.241902:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788530183.241906:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788530183.241939:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f32bd2d80 x1875409555785216/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530199 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530183.241958:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555785216:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1788530183.241989:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f32bd0a80 x1875409555785088/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530199 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530183.242002:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555785088:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788530183.242345:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875409555785472:0@lo:400:kworker.0 00000100:00100000:0.0:1788530183.242377:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530183.242395:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875409555785984:0@lo:400:kworker.0 00000100:00100000:0.0:1788530183.242410:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530183.242424:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788530183.242428:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555785600:0@lo:400:kworker.0 00000100:00100000:0.0:1788530183.242447:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530183.242458:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f2b92ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875409555786112:0@lo:400:kworker.0 00000100:00100000:0.0:1788530183.242473:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530183.242494:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555785472 00000100:00100000:0.0:1788530183.242508:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555785472 00000100:00100000:0.0:1788530183.242546:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555785984 00000100:00100000:0.0:1788530183.242548:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555785984 00000100:00100000:3.0:1788530183.242802:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3648:1875409555785344:0@lo:400:kworker.0 00000100:00100000:3.0:1788530183.242831:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530183.242865:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555785856:0@lo:400:kworker.0 00000100:00100000:3.0:1788530183.242891:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530183.242906:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f2b92f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875409555786368:0@lo:400:kworker.0 00000100:00100000:3.0:1788530183.242921:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530183.242935:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788530183.242940:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875409555785728:0@lo:400:kworker.0 00000100:00100000:3.0:1788530183.242955:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530183.242968:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f2b92fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875409555786240:0@lo:400:kworker.0 00000100:00100000:3.0:1788530183.242985:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530183.243006:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555785344 00000100:00100000:3.0:1788530183.243009:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555785344 00000100:00100000:3.0:1788530183.243037:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1788530183.243045:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:3648:x1875409555785344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530183.243087:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:3648:x1875409555785344:12345-0@lo:400:kworker.0 Request processed in 41us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530183.243095:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1788530183.243138:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555785600 00000100:00100000:3.0:1788530183.243142:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555785600 00000100:00100000:3.0:1788530183.243158:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555785856 00000100:00100000:3.0:1788530183.243160:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555785856 00000100:00100000:3.0:1788530183.243170:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788530183.243176:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f2b92ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555785600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530183.243210:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f2b92ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555785600:12345-0@lo:400:kworker.0 Request processed in 34us (762us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530183.243216:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788530183.243225:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788530183.243338:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555785856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530183.243375:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555785856:12345-0@lo:400:kworker.0 Request processed in 144us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530183.243381:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788530183.243397:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555786112 00000100:00100000:3.0:1788530183.243400:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555786112 00000100:00100000:3.0:1788530183.243415:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555786368 00000100:00100000:3.0:1788530183.243417:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555786368 00000100:00100000:3.0:1788530183.243426:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555785728 00000100:00100000:3.0:1788530183.243428:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555785728 00000100:00100000:3.0:1788530183.243437:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555786240 00000100:00100000:3.0:1788530183.243438:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555786240 00000100:00100000:3.0:1788530183.243449:0:10719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788530183.243455:0:10719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f2b92d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875409555785472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530183.243481:0:10719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f2b92d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875409555785472:12345-0@lo:400:kworker.0 Request processed in 26us (1103us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530183.243486:0:10719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788530183.243497:0:10719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788530183.243502:0:10719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f2b92e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875409555786112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530183.243521:0:10719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f2b92e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875409555786112:12345-0@lo:400:kworker.0 Request processed in 19us (1047us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530183.243526:0:10719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788530183.243533:0:10719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788530183.243538:0:10719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875409555786368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530183.243556:0:10719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875409555786368:12345-0@lo:400:kworker.0 Request processed in 18us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530183.243793:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788530183.243801:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875409555785728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530183.243830:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875409555785728:12345-0@lo:400:kworker.0 Request processed in 31us (874us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530183.243835:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788530183.243855:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788530183.243861:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875409555786240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530183.243883:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875409555786240:12345-0@lo:400:kworker.0 Request processed in 23us (898us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530183.243889:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788530183.243898:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788530183.243903:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f2b92ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875409555785984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530183.243923:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f2b92ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875409555785984:12345-0@lo:400:kworker.0 Request processed in 20us (1512us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530183.243928:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00080000:0.0:1788530183.243950:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788530183.243954:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788530183.243981:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555785600:0@lo:400:kworker.0 00010000:00080000:0.0:1788530183.243992:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f2b92ca80 x1875409555786112/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530199 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530183.244002:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f2b92ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875409555786112:0@lo:400:kworker.0 00000100:00100000:0.0:1788530183.244012:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875409555785472:0@lo:400:kworker.0 00000100:00100000:0.0:1788530183.244035:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875409555785984:0@lo:400:kworker.0 00000100:00100000:3.0:1788530183.244183:0:10719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788530183.244219:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875409555785728:0@lo:400:kworker.0 00000100:00100000:3.0:1788530183.244532:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f2b92fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875409555786240:0@lo:400:kworker.0 00000100:00100000:3.0:1788530183.244544:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3648:1875409555785344:0@lo:400:kworker.0 00000100:00100000:3.0:1788530183.244554:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555785856:0@lo:400:kworker.0 00010000:00080000:3.0:1788530183.244599:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f2b92f100 x1875409555786368/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530199 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530183.245201:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f2b92f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875409555786368:0@lo:400:kworker.0 00010000:00010000:1.0:1788530183.363691:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788530183.469937:0:12009:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 09:56:20 (1788530180) === 00000100:00100000:1.0:1788530183.879990:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530183.880621:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531580032 00000100:00100000:2.0:1788530183.880632:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531580032 00000100:00100000:2.0:1788530183.880694:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 334 00000100:00100000:2.0:1788530183.880705:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f442bcd-b742-4e76-ad7b-709f731358a0+10:8732:x1875409531580032:12345-192.168.202.41@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788530183.880721:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530183.880739:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f18140800/0xb28d70e125750655 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1406819a550776 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530183.880765:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f18140800/0xb28d70e125750655 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550776 expref: 11 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530183.880795:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f18140800/0xb28d70e125750655 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550776 expref: 11 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530183.880806:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f18140800, rc 0) 00000100:00100000:2.0:1788530183.880895:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f442bcd-b742-4e76-ad7b-709f731358a0+11:8732:x1875409531580032:12345-192.168.202.41@tcp:101:mount.lustre.0 Request processed in 191us (917us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530183.880903:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 334 00000100:00100000:0.0:1788530183.891000:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530183.891092:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531580160 00000100:00100000:3.0:1788530183.891103:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531580160 00000100:00100000:3.0:1788530183.891167:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 335 00000100:00100000:3.0:1788530183.891179:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f442bcd-b742-4e76-ad7b-709f731358a0+11:8732:x1875409531580160:12345-192.168.202.41@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788530183.891362:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f442bcd-b742-4e76-ad7b-709f731358a0+11:8732:x1875409531580160:12345-192.168.202.41@tcp:501:mount.lustre.0 Request processed in 184us (371us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788530183.891371:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 335 00000100:00100000:0.0:1788530183.903680:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530183.903818:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531580288 00000100:00100000:3.0:1788530183.903828:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531580288 00000100:00100000:3.0:1788530183.903900:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 336 00000100:00100000:3.0:1788530183.903911:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f442bcd-b742-4e76-ad7b-709f731358a0+11:8732:x1875409531580288:12345-192.168.202.41@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788530183.903928:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788530183.903948:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f0c91c200/0xb28d70e12575065c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1406819a55077d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530183.903979:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f0c91c200/0xb28d70e12575065c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a55077d expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530183.904004:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f0c91c200/0xb28d70e12575065c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a55077d expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530183.904015:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f0c91c200, rc 0) 00000100:00100000:3.0:1788530183.904079:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f442bcd-b742-4e76-ad7b-709f731358a0+12:8732:x1875409531580288:12345-192.168.202.41@tcp:101:mount.lustre.0 Request processed in 169us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530183.904087:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 336 00000100:00100000:1.0:1788530183.910328:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530183.910701:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531580416 00000100:00100000:2.0:1788530183.910713:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531580416 00000100:00100000:2.0:1788530183.910781:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 337 00000100:00100000:2.0:1788530183.910793:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f442bcd-b742-4e76-ad7b-709f731358a0+12:8732:x1875409531580416:12345-192.168.202.41@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788530183.910998:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f442bcd-b742-4e76-ad7b-709f731358a0+12:8732:x1875409531580416:12345-192.168.202.41@tcp:501:mount.lustre.0 Request processed in 206us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530183.911007:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 337 00000100:00100000:0.0:1788530183.912707:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530183.912795:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531580544 00000100:00100000:1.0:1788530183.912804:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531580544 00000100:00100000:1.0:1788530183.912873:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 338 00000100:00100000:1.0:1788530183.912885:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f442bcd-b742-4e76-ad7b-709f731358a0+12:8732:x1875409531580544:12345-192.168.202.41@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788530183.913084:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f442bcd-b742-4e76-ad7b-709f731358a0+12:8732:x1875409531580544:12345-192.168.202.41@tcp:503:mount.lustre.0 Request processed in 199us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530183.913092:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 338 00000100:00100000:0.0:1788530183.916065:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530183.916382:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531580672 00000100:00100000:3.0:1788530183.916395:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531580672 00000100:00100000:3.0:1788530183.916460:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 339 00000100:00100000:3.0:1788530183.916470:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f442bcd-b742-4e76-ad7b-709f731358a0+12:8736:x1875409531580672:12345-192.168.202.41@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788530183.916682:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f442bcd-b742-4e76-ad7b-709f731358a0+12:8736:x1875409531580672:12345-192.168.202.41@tcp:502:llog_process_th.0 Request processed in 212us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530183.916691:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 339 00000100:00100000:3.0:1788530183.941701:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530183.944273:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531580800 00000100:00100000:2.0:1788530183.944289:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531580800 00000100:00100000:2.0:1788530183.944361:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 340 00000100:00100000:2.0:1788530183.944372:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f442bcd-b742-4e76-ad7b-709f731358a0+12:8736:x1875409531580800:12345-192.168.202.41@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788530183.944545:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f442bcd-b742-4e76-ad7b-709f731358a0+12:8736:x1875409531580800:12345-192.168.202.41@tcp:502:llog_process_th.0 Request processed in 173us (2855us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530183.944553:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 340 00000100:00100000:0.0:1788530183.949890:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530183.951208:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531580928 00000100:00100000:1.0:1788530183.951220:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531580928 00000100:00100000:1.0:1788530183.951284:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 341 00000100:00100000:1.0:1788530183.951293:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f442bcd-b742-4e76-ad7b-709f731358a0+12:8736:x1875409531580928:12345-192.168.202.41@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788530183.951453:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f442bcd-b742-4e76-ad7b-709f731358a0+12:8736:x1875409531580928:12345-192.168.202.41@tcp:502:llog_process_th.0 Request processed in 160us (1574us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530183.951471:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 341 00000100:00100000:0.0:1788530183.959882:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530183.959998:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531581056 00000100:00100000:3.0:1788530183.960009:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531581056 00000100:00100000:3.0:1788530183.960066:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 342 00000100:00100000:3.0:1788530183.960076:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f442bcd-b742-4e76-ad7b-709f731358a0+12:8732:x1875409531581056:12345-192.168.202.41@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788530183.960094:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788530183.960121:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f0c91ce00/0xb28d70e125750663 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1406819a5507ae expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530183.960150:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f0c91ce00/0xb28d70e125750663 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5507ae expref: 13 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530183.960180:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f0c91ce00/0xb28d70e125750663 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5507ae expref: 13 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530183.960189:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f0c91ce00, rc 0) 00000100:00100000:3.0:1788530183.960257:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f442bcd-b742-4e76-ad7b-709f731358a0+13:8732:x1875409531581056:12345-192.168.202.41@tcp:101:mount.lustre.0 Request processed in 182us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530183.960263:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 342 00000100:00100000:3.0:1788530183.974660:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530183.974790:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531581184 00000100:00100000:2.0:1788530183.974805:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531581184 00000100:00100000:2.0:1788530183.974869:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 343 00000100:00100000:2.0:1788530183.974881:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f442bcd-b742-4e76-ad7b-709f731358a0+13:8732:x1875409531581184:12345-192.168.202.41@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788530183.974923:0:6518:0:(mgs_nids.c:1159:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788530183.974941:0:6518:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788530183.974946:0:6518:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788530183.974949:0:6518:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788530183.974952:0:6518:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1788530183.974954:0:6518:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:2.0:1788530183.982428:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f442bcd-b742-4e76-ad7b-709f731358a0+13:8732:x1875409531581184:12345-192.168.202.41@tcp:256:mount.lustre.0 Request processed in 7536us (7766us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530183.982443:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 343 00000100:00100000:0.0:1788530183.991202:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530183.991339:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531581312 00000100:00100000:1.0:1788530183.991350:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531581312 00000100:00100000:1.0:1788530183.991414:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 344 00000100:00100000:1.0:1788530183.991425:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f442bcd-b742-4e76-ad7b-709f731358a0+13:8732:x1875409531581312:12345-192.168.202.41@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788530183.991442:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530183.991461:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f42166000/0xb28d70e12575066a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1406819a5507b5 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530183.991491:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f42166000/0xb28d70e12575066a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5507b5 expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530183.991503:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f42166000/0xb28d70e12575066a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5507b5 expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530183.991512:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f42166000, rc 0) 00000100:00100000:1.0:1788530183.991599:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f442bcd-b742-4e76-ad7b-709f731358a0+14:8732:x1875409531581312:12345-192.168.202.41@tcp:101:mount.lustre.0 Request processed in 174us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530183.993152:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 344 00000100:00100000:3.0:1788530183.993284:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530183.993374:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531581440 00000100:00100000:2.0:1788530183.993387:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531581440 00000100:00100000:2.0:1788530183.993462:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 345 00000100:00100000:2.0:1788530183.993476:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f442bcd-b742-4e76-ad7b-709f731358a0+14:8732:x1875409531581440:12345-192.168.202.41@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788530183.993705:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f442bcd-b742-4e76-ad7b-709f731358a0+14:8732:x1875409531581440:12345-192.168.202.41@tcp:501:mount.lustre.0 Request processed in 232us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530183.993712:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 345 00000100:00100000:0.0:1788530183.995372:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530183.995614:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531581568 00000100:00100000:1.0:1788530183.995625:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531581568 00000100:00100000:1.0:1788530183.996102:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 346 00000100:00100000:1.0:1788530183.996118:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f442bcd-b742-4e76-ad7b-709f731358a0+14:8732:x1875409531581568:12345-192.168.202.41@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788530183.997463:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f442bcd-b742-4e76-ad7b-709f731358a0+14:8732:x1875409531581568:12345-192.168.202.41@tcp:503:mount.lustre.0 Request processed in 1341us (2091us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530183.997479:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 346 00000100:00100000:0.0:1788530184.011529:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530184.011633:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531581696 00000100:00100000:3.0:1788530184.011645:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531581696 00000100:00100000:3.0:1788530184.011697:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 347 00000100:00100000:3.0:1788530184.011706:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f442bcd-b742-4e76-ad7b-709f731358a0+14:8739:x1875409531581696:12345-192.168.202.41@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788530184.011880:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f442bcd-b742-4e76-ad7b-709f731358a0+14:8739:x1875409531581696:12345-192.168.202.41@tcp:502:llog_process_th.0 Request processed in 173us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530184.011888:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 347 00000100:00100000:3.0:1788530184.015461:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530184.015620:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531581824 00000100:00100000:1.0:1788530184.015632:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531581824 00000100:00100000:1.0:1788530184.015693:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 348 00000100:00100000:1.0:1788530184.015703:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f442bcd-b742-4e76-ad7b-709f731358a0+14:8739:x1875409531581824:12345-192.168.202.41@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788530184.015953:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f442bcd-b742-4e76-ad7b-709f731358a0+14:8739:x1875409531581824:12345-192.168.202.41@tcp:502:llog_process_th.0 Request processed in 250us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530184.015971:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 348 00000100:00100000:0.0:1788530184.027709:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530184.027806:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530184.033884:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530184.038383:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531581952 00000100:00100000:2.0:1788530184.038397:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531581952 00000100:00100000:2.0:1788530184.038456:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531582208 00000100:00100000:2.0:1788530184.038459:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531582208 00000100:00100000:2.0:1788530184.038483:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 16 00000100:00100000:2.0:1788530184.038492:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f2b92ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2398:x1875409531581952:12345-192.168.202.41@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788530184.038521:0:6525:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-MDT0000: connection from 5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc@192.168.202.41@tcp t0 exp 0000000000000000 cur 391 last 0 00000020:00000080:2.0:1788530184.038556:0:6525:0:(genops.c:1385:class_connect()) connect: client 5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc, cookie 0xb28d70e125750671 00000004:00100000:2.0:1788530184.038613:0:6525:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788530184.038739:0:6525:0:(import.c:65:import_set_state_nolock()) ffff9a9e027a9800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788530184.038816:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f2b92ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+6:2398:x1875409531581952:12345-192.168.202.41@tcp:38:mount.lustre.0 Request processed in 324us (11593us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530184.038824:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 16 00000100:00100000:2.0:1788530184.038853:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 17 00000100:00100000:2.0:1788530184.038858:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f2b92c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2398:x1875409531582208:12345-192.168.202.41@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788530184.038872:0:6525:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-MDT0001: connection from 5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc@192.168.202.41@tcp t0 exp 0000000000000000 cur 391 last 0 00000020:00000080:2.0:1788530184.038893:0:6525:0:(genops.c:1385:class_connect()) connect: client 5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc, cookie 0xb28d70e125750678 00000004:00100000:2.0:1788530184.038905:0:6525:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788530184.038952:0:6525:0:(import.c:65:import_set_state_nolock()) ffff9a9e027ac000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788530184.038986:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f2b92c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+6:2398:x1875409531582208:12345-192.168.202.41@tcp:38:mount.lustre.0 Request processed in 125us (11178us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530184.038992:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 17 00000100:00100000:0.0:1788530184.041192:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530184.043086:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531582592 00000100:00100000:3.0:1788530184.043111:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531582592 00000100:00100000:3.0:1788530184.043203:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531582720 00000100:00100000:3.0:1788530184.043208:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531582720 00000100:00100000:3.0:1788530184.043245:0:10719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 163 00000100:00100000:3.0:1788530184.043256:0:10719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f2b92c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:2402:x1875409531582592:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1788530184.043334:0:10719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f2b92c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:2402:x1875409531582592:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 80us (9463us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530184.043358:0:10719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 163 00000100:00100000:3.0:1788530184.043375:0:10719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 164 00000100:00100000:3.0:1788530184.043381:0:10719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f2b92ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2402:x1875409531582720:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1788530184.043402:0:10719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f2b92ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2402:x1875409531582720:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 22us (2218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530184.043408:0:10719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 164 00000100:00080000:0.0:1788530184.043737:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788530184.043741:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788530184.048763:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530184.048859:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530184.048894:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531582336 00000100:00100000:3.0:1788530184.048903:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531582336 00000100:00100000:3.0:1788530184.049022:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531582464 00000100:00100000:3.0:1788530184.049025:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531582464 00000100:00100000:3.0:1788530184.049045:0:10719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 18 00000100:00100000:3.0:1788530184.049054:0:10719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+6:0:x1875409531582336:12345-192.168.202.41@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788530184.049089:0:10719:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446453248 avail 1300213760 00000100:00100000:3.0:1788530184.049168:0:10719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+6:0:x1875409531582336:12345-192.168.202.41@tcp:41:mount.lustre.0 Request processed in 115us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530184.049176:0:10719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 18 00000100:00100000:3.0:1788530184.049191:0:10719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 19 00000100:00100000:3.0:1788530184.049198:0:10719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+6:8732:x1875409531582464:12345-192.168.202.41@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788530184.049213:0:10719:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788530184.050105:0:10719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+6:8732:x1875409531582464:12345-192.168.202.41@tcp:41:mount.lustre.0 Request processed in 902us (1240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530184.050115:0:10719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 19 00000100:00080000:0.0:1788530184.050719:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788530184.050725:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788530184.051953:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530184.053338:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531582080 00000100:00100000:3.0:1788530184.053353:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531582080 00000100:00100000:3.0:1788530184.053427:0:10719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 20 00000100:00100000:3.0:1788530184.053438:0:10719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f2b92f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+6:0:x1875409531582080:12345-192.168.202.41@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788530184.053469:0:10719:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788530184.053539:0:10719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f2b92f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+6:0:x1875409531582080:12345-192.168.202.41@tcp:41:mount.lustre.0 Request processed in 103us (1593us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530184.053547:0:10719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 20 00000100:00100000:0.0:1788530184.067803:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530184.067899:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531582848 00000100:00100000:2.0:1788530184.067911:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531582848 00000100:00100000:2.0:1788530184.068398:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 21 00000100:00100000:2.0:1788530184.068411:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f2b92fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+6:8732:x1875409531582848:12345-192.168.202.41@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788530184.068517:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f2b92fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+6:8732:x1875409531582848:12345-192.168.202.41@tcp:40:mount.lustre.0 Request processed in 110us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530184.068525:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 21 00000100:00100000:3.0:1788530184.072436:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530184.073882:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531582976 00000100:00100000:0.0:1788530184.073899:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531582976 00000100:00100000:0.0:1788530184.073980:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 20 00000100:00100000:0.0:1788530184.073992:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2398:x1875409531582976:12345-192.168.202.41@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788530184.074032:0:8436:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-OST0000: connection from 5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc@192.168.202.41@tcp t0 exp 0000000000000000 cur 391 last 0 00000020:00000080:0.0:1788530184.074067:0:8436:0:(genops.c:1385:class_connect()) connect: client 5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc, cookie 0xb28d70e12575067f 00002000:00100000:0.0:1788530184.074080:0:8436:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc/ffff9a9e03346000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a05 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788530184.074306:0:8436:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788530184.074395:0:8436:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788530184.074431:0:8436:0:(import.c:65:import_set_state_nolock()) ffff9a9e03344800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788530184.074523:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+6:2398:x1875409531582976:12345-192.168.202.41@tcp:8:mount.lustre.0 Request processed in 531us (2098us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530184.074532:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 20 00000100:00100000:3.0:1788530184.077516:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530184.078008:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531583104 00000100:00100000:0.0:1788530184.078019:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531583104 00000100:00100000:0.0:1788530184.078072:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 21 00000100:00100000:0.0:1788530184.078080:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2398:x1875409531583104:12345-192.168.202.41@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788530184.078121:0:8439:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-OST0001: connection from 5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc@192.168.202.41@tcp t0 exp 0000000000000000 cur 391 last 0 00000020:00000080:0.0:1788530184.078156:0:8439:0:(genops.c:1385:class_connect()) connect: client 5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc, cookie 0xb28d70e125750686 00002000:00100000:0.0:1788530184.078169:0:8439:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc/ffff9a9e03345800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a05 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788530184.078183:0:8439:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788530184.078278:0:8439:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788530184.078307:0:8439:0:(import.c:65:import_set_state_nolock()) ffff9a9e03342800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788530184.078429:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+6:2398:x1875409531583104:12345-192.168.202.41@tcp:8:mount.lustre.0 Request processed in 347us (923us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530184.078438:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 21 00000100:00100000:3.0:1788530184.086081:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530184.093200:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531583232 00000100:00100000:1.0:1788530184.093217:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531583232 00000100:00100000:1.0:1788530184.093291:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 5 00000100:00100000:1.0:1788530184.093304:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0375e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+6:8732:x1875409531583232:12345-192.168.202.41@tcp:900:mount.lustre.0 00000100:00100000:1.0:1788530184.093484:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0375e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+6:8732:x1875409531583232:12345-192.168.202.41@tcp:900:mount.lustre.0 Request processed in 182us (7415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530184.093493:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 5 00000100:00100000:3.0:1788530184.103817:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530184.103918:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531583360 00000100:00100000:1.0:1788530184.103932:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531583360 00000100:00100000:1.0:1788530184.104010:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 1 00000100:00100000:1.0:1788530184.104021:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0375ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+6:8732:x1875409531583360:12345-192.168.202.41@tcp:33:mount.lustre.0 00000004:00200000:1.0:1788530184.104134:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1788530184.104221:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0375ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+6:8732:x1875409531583360:12345-192.168.202.41@tcp:33:mount.lustre.0 Request processed in 200us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530184.104228:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 1 00000100:00100000:3.0:1788530184.256819:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788530184.256854:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32a55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555786496:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788530184.256928:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530184.258136:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555786496 00000100:00100000:1.0:1788530184.258154:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555786496 00000100:00100000:1.0:1788530184.259939:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788530184.259963:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0375d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555786496:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788530184.260038:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446453248 avail 1300213760 00000100:00100000:1.0:1788530184.260162:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0375d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555786496:12345-0@lo:41:osp-pre-1-0.0 Request processed in 208us (3232us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530184.260169:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788530184.261062:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32a55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555786496:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788530184.390774:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530185.408779:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530186.435984:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530187.459550:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788530187.840794:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788530187.840830:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32a54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555786624:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788530187.840917:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530187.841308:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555786624 00000100:00100000:2.0:1788530187.841318:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555786624 00000100:00100000:2.0:1788530187.841373:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788530187.841382:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555786624:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788530187.841420:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788530187.841509:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555786624:12345-0@lo:41:osp-pre-0-1.0 Request processed in 127us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530187.841515:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788530187.841623:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32a54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555786624:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788530188.352915:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555787008:0@lo:400:kworker.0 00000100:00100000:0.0:1788530188.352940:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875409555787136:0@lo:400:kworker.0 00000100:00100000:1.0:1788530188.353019:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875409555786880:0@lo:400:kworker.0 00000100:00100000:3.0:1788530188.353115:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3647:1875409555786752:0@lo:400:kworker.0 00000100:00100000:2.0:1788530188.354732:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530188.354732:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530188.354816:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37373800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875409555787520:0@lo:400:kworker.0 00000100:00100000:0.0:1788530188.355521:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530188.355585:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37370380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555787648:0@lo:400:kworker.0 00000100:00100000:0.0:1788530188.355616:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530188.355643:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3740a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555788160:0@lo:400:kworker.0 00000100:00100000:0.0:1788530188.355685:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530188.355895:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788530188.355904:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37409f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875409555788032:0@lo:400:kworker.0 00000100:00100000:0.0:1788530188.355932:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530188.356046:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555786880 00000100:00100000:0.0:1788530188.356055:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555786880 00000100:00100000:0.0:1788530188.356111:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555787136 00000100:00100000:0.0:1788530188.356115:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555787136 00000100:00100000:0.0:1788530188.356147:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555788032 00000100:00100000:0.0:1788530188.356150:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555788032 00000100:00100000:0.0:1788530188.356180:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788530188.356189:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875409555786880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530188.356242:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875409555786880:12345-0@lo:400:kworker.0 Request processed in 54us (1511us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530188.356250:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788530188.356269:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788530188.356275:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37408a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875409555787136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530188.356301:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37408a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875409555787136:12345-0@lo:400:kworker.0 Request processed in 27us (783us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530188.356307:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788530188.356317:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788530188.356322:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875409555788032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530188.356346:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875409555788032:12345-0@lo:400:kworker.0 Request processed in 24us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530188.356352:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788530188.356369:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555787648 00000100:00100000:0.0:1788530188.356373:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555787648 00000100:00100000:0.0:1788530188.356406:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555788160 00000100:00100000:0.0:1788530188.356409:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555788160 00000100:00100000:0.0:1788530188.356439:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788530188.356446:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37408380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555787648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530188.356476:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37408380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555787648:12345-0@lo:400:kworker.0 Request processed in 31us (860us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530188.356483:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788530188.356494:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788530188.356500:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555788160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530188.356525:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555788160:12345-0@lo:400:kworker.0 Request processed in 25us (839us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530188.356530:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:0.0:1788530188.356555:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788530188.356592:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788530188.356594:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788530188.356634:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f37409f80 x1875409555788032/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530204 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530188.356648:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37409f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875409555788032:0@lo:400:kworker.0 00000100:00100000:0.0:1788530188.356660:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875409555787136:0@lo:400:kworker.0 00010000:00080000:0.0:1788530188.356668:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f37370380 x1875409555787648/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788530204 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530188.356677:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37370380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555787648:0@lo:400:kworker.0 00010000:00080000:0.0:1788530188.356685:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f3740a680 x1875409555788160/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788530204 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530188.356693:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3740a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555788160:0@lo:400:kworker.0 00000100:00100000:0.0:1788530188.356723:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788530188.356744:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03c90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555788544:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788530188.356770:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530188.357068:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555788544 00000100:00100000:0.0:1788530188.357073:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555788544 00000100:00100000:0.0:1788530188.357106:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788530188.357114:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37370380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555788544:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788530188.357150:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788530188.357190:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37370380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555788544:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530188.357197:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00080000:0.0:1788530188.357221:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e03c90a80 x1875409555788544/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530204 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530188.357236:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03c90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555788544:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788530188.357510:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530188.357606:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555787264:0@lo:400:kworker.0 00000100:00100000:3.0:1788530188.357634:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530188.357654:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3740a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555787776:0@lo:400:kworker.0 00000100:00100000:3.0:1788530188.357673:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530188.357691:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37409180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555788288:0@lo:400:kworker.0 00000100:00100000:3.0:1788530188.357736:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530188.357754:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788530188.357760:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03c91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555788416:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788530188.357911:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530188.357996:0:9912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555788416 00000100:00100000:3.0:1788530188.358001:0:9912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555788416 00000100:00100000:3.0:1788530188.358029:0:9912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788530188.358036:0:9912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0375fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555788416:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788530188.358056:0:9912:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788530188.358088:0:9912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0375fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555788416:12345-0@lo:13:osp-pre-0-1.0 Request processed in 52us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530188.358095:0:9912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788530188.358115:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0375d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555788800:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788530188.358204:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788530188.358229:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e03c91880 x1875409555788416/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530204 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530188.358244:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03c91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555788416:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788530188.358264:0:9912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555788800 00000100:00100000:3.0:1788530188.358268:0:9912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555788800 00000100:00100000:3.0:1788530188.358293:0:9912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788530188.358299:0:9912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0375d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555788800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788530188.358308:0:9912:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788530188.358338:0:9912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0375d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555788800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 39us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530188.358343:0:9912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00080000:3.0:1788530188.358365:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e0375d500 x1875409555788800/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530204 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530188.358387:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0375d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555788800:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788530188.358516:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555787008 00000100:00100000:1.0:1788530188.358521:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555787008 00000100:00100000:1.0:1788530188.358543:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555787264 00000100:00100000:1.0:1788530188.358545:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555787264 00000100:00100000:1.0:1788530188.358583:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788530188.358591:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555787008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530188.358629:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555787008:12345-0@lo:400:kworker.0 Request processed in 39us (3907us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530188.358635:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788530188.358651:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788530188.358657:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0375ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555787264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530188.358690:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0375ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555787264:12345-0@lo:400:kworker.0 Request processed in 33us (1055us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530188.358696:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788530188.358979:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555787264:0@lo:400:kworker.0 00000100:00100000:0.0:1788530188.359084:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555786752 00000100:00100000:0.0:1788530188.359090:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555786752 00000100:00100000:2.0:1788530188.359232:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530188.359249:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1788530188.359256:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:3647:x1875409555786752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530188.359288:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555787008:0@lo:400:kworker.0 00000100:00100000:2.0:1788530188.359300:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788530188.359308:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0375e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555788672:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788530188.359310:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555787520 00000100:00100000:3.0:1788530188.359314:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555787520 00000100:00100000:3.0:1788530188.359365:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788530188.359372:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875409555787520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530188.359468:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:3647:x1875409555786752:12345-0@lo:400:kworker.0 Request processed in 212us (1958us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530188.359475:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1788530188.359510:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555787776 00000100:00100000:0.0:1788530188.359514:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555787776 00000100:00100000:0.0:1788530188.359537:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555788288 00000100:00100000:0.0:1788530188.359540:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555788288 00000100:00100000:0.0:1788530188.359556:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788530188.359579:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0375f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555787776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530188.359623:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0375f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555787776:12345-0@lo:400:kworker.0 Request processed in 44us (1948us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530188.359630:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788530188.359642:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788530188.359648:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0375ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555788288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530188.359674:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0375ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555788288:12345-0@lo:400:kworker.0 Request processed in 28us (1939us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530188.359680:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:0.0:1788530188.359701:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788530188.359706:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788530188.359709:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788530188.359928:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875409555786880:0@lo:400:kworker.0 00000100:00100000:0.0:1788530188.359937:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875409555787392:0@lo:400:kworker.0 00000100:00100000:0.0:1788530188.359969:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530188.359990:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3740ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875409555787904:0@lo:400:kworker.0 00000100:00100000:0.0:1788530188.360015:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530188.360054:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555787392 00000100:00100000:0.0:1788530188.360057:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555787392 00000100:00100000:0.0:1788530188.360084:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555787904 00000100:00100000:0.0:1788530188.360087:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555787904 00000100:00100000:0.0:1788530188.360105:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788530188.360111:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875409555787392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530188.360221:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875409555787392:12345-0@lo:400:kworker.0 Request processed in 110us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530188.360228:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788530188.360242:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788530188.360255:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875409555787904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530188.360284:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875409555787904:12345-0@lo:400:kworker.0 Request processed in 28us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530188.360290:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00080000:0.0:1788530188.360312:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788530188.360329:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875409555787392:0@lo:400:kworker.0 00000100:00100000:0.0:1788530188.360339:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3740ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875409555787904:0@lo:400:kworker.0 00000100:00100000:1.0:1788530188.360438:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3647:1875409555786752:0@lo:400:kworker.0 00010000:00080000:1.0:1788530188.360454:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f3740a300 x1875409555787776/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788530204 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530188.360474:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3740a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555787776:0@lo:400:kworker.0 00010000:00080000:1.0:1788530188.360488:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f37409180 x1875409555788288/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788530204 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530188.360497:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37409180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555788288:0@lo:400:kworker.0 00000100:00100000:2.0:1788530188.361184:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530188.361238:0:9912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555788672 00000100:00100000:0.0:1788530188.361244:0:9912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555788672 00000100:00100000:0.0:1788530188.361290:0:9912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788530188.361300:0:9912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555788672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788530188.361321:0:9912:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788530188.361375:0:9912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555788672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530188.361382:0:9912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788530188.361637:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875409555787520:12345-0@lo:400:kworker.0 Request processed in 2265us (2405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530188.361645:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00010000:00080000:2.0:1788530188.362215:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e0375e300 x1875409555788672/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530204 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530188.362232:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0375e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555788672:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1788530188.362241:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f37373800 x1875409555787520/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530204 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530188.362247:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37373800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875409555787520:0@lo:400:kworker.0 00010000:00010000:1.0:1788530188.482282:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788530189.289147:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530189.289258:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531583488 00000100:00100000:3.0:1788530189.289260:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530189.289271:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531583488 00000100:00100000:3.0:1788530189.289318:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530189.289338:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 350 00000100:00100000:3.0:1788530189.289352:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530189.289353:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f442bcd-b742-4e76-ad7b-709f731358a0+14:2402:x1875409531583488:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1788530189.289382:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530189.289440:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531583744 00000100:00100000:0.0:1788530189.289445:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531583744 00000100:00100000:0.0:1788530189.289530:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531584000 00000100:00100000:0.0:1788530189.289534:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531584000 00000100:00100000:0.0:1788530189.289555:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531583616 00000100:00100000:0.0:1788530189.289612:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531583616 00000100:00100000:0.0:1788530189.289638:0:10719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 171 00000100:00100000:0.0:1788530189.289645:0:10719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0375d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2402:x1875409531583744:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1788530189.289737:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530189.289770:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f442bcd-b742-4e76-ad7b-709f731358a0+14:2402:x1875409531583488:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 421us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530189.289779:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 350 00000100:00100000:3.0:1788530189.289851:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530189.289857:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531583872 00000100:00100000:2.0:1788530189.289863:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531583872 00000100:00100000:2.0:1788530189.289891:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 172 00000100:00100000:2.0:1788530189.289898:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0375c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+6:2402:x1875409531584000:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1788530189.289929:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0375c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+6:2402:x1875409531584000:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 32us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530189.289936:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 172 00000100:00100000:2.0:1788530189.289952:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 173 00000100:00100000:2.0:1788530189.289959:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0375e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:2402:x1875409531583616:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1788530189.289985:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0375e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:2402:x1875409531583616:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 27us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530189.289990:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 173 00000100:00100000:2.0:1788530189.290003:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 174 00000100:00100000:2.0:1788530189.290009:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3735f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+6:2402:x1875409531583872:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1788530189.290031:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3735f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+6:2402:x1875409531583872:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 23us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530189.290038:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 174 00000100:00100000:2.0:1788530189.290111:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531584256 00000100:00100000:2.0:1788530189.290115:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531584256 00000100:00100000:2.0:1788530189.290160:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531584128 00000100:00100000:2.0:1788530189.290163:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531584128 00000100:00100000:2.0:1788530189.290185:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 52 00000100:00100000:2.0:1788530189.290191:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0375f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+6:2402:x1875409531584256:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1788530189.290216:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0375f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+6:2402:x1875409531584256:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 26us (869us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530189.290233:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 52 00000100:00100000:2.0:1788530189.290246:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 53 00000100:00100000:2.0:1788530189.290252:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3735c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+6:2402:x1875409531584128:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1788530189.290289:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3735c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+6:2402:x1875409531584128:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 24us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530189.290295:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 53 00000100:00080000:2.0:1788530189.290311:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788530189.290315:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788530189.290317:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788530189.290319:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788530189.291812:0:10719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0375d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2402:x1875409531583744:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 2158us (2546us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530189.291834:0:10719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 171 00000100:00100000:0.0:1788530189.376947:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32a54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555788928:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788530189.377812:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530189.384760:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555788928 00000100:00100000:2.0:1788530189.384778:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555788928 00000100:00100000:2.0:1788530189.384874:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788530189.384891:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32bd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555788928:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788530189.384940:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446453248 avail 1300213760 00000100:00100000:2.0:1788530189.385186:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32bd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555788928:12345-0@lo:41:osp-pre-1-0.0 Request processed in 298us (7373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530189.385197:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788530189.389869:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32a54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555788928:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788530189.504843:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788530189.898305:0:7454:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc 00000001:00100000:2.0:1788530189.903777:0:6502:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc 00000001:00100000:1.0:1788530189.908289:0:8431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc 00000001:00100000:0.0:1788530189.922021:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc 00010000:00010000:1.0:1788530190.528865:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788530191.330466:0:12202:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg241-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:1.0:1788530191.553909:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530192.578034:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788530192.962606:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32a54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555789056:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788530192.962690:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530192.962822:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555789056 00000100:00100000:2.0:1788530192.962833:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555789056 00000100:00100000:2.0:1788530192.962897:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788530192.962908:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32bd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555789056:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788530192.962956:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788530192.963011:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32bd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555789056:12345-0@lo:41:osp-pre-0-1.0 Request processed in 105us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530192.963031:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788530192.964650:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32a54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555789056:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788530193.473969:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555789184:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788530193.474077:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530193.479997:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37409180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555789568:0@lo:400:kworker.0 00000100:00100000:0.0:1788530193.480082:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530193.482102:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3740ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875409555789696:0@lo:400:kworker.0 00000100:00100000:1.0:1788530193.482545:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3647:1875409555789312:0@lo:400:kworker.0 00000100:00100000:1.0:1788530193.482635:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530193.482687:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788530193.482694:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875409555789440:0@lo:400:kworker.0 00000100:00100000:1.0:1788530193.482721:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530193.485444:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555789184 00000100:00100000:2.0:1788530193.485460:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555789184 00000100:00100000:2.0:1788530193.485671:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788530193.485688:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32bd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555789184:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788530193.485731:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788530193.486250:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530193.486333:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555789440 00000100:00100000:0.0:1788530193.486338:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555789440 00000100:00100000:0.0:1788530193.486392:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555789696 00000100:00100000:0.0:1788530193.486396:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555789696 00000100:00100000:0.0:1788530193.486417:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788530193.486424:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875409555789440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530193.488289:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875409555789440:12345-0@lo:400:kworker.0 Request processed in 1853us (5554us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530193.488309:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788530193.488685:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788530193.488699:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3740a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875409555789696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530193.488933:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32bd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555789184:12345-0@lo:13:osp-pre-1-1.0 Request processed in 3250us (14857us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530193.488942:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788530193.490332:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3740a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875409555789696:12345-0@lo:400:kworker.0 Request processed in 1633us (4078us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530193.490345:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788530193.490954:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555789568 00000100:00100000:2.0:1788530193.490963:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555789568 00000100:00100000:2.0:1788530193.491016:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788530193.491025:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3740a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555789568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530193.491077:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3740a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555789568:12345-0@lo:400:kworker.0 Request processed in 55us (10996us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530193.491084:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00080000:2.0:1788530193.491103:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788530193.491318:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3740ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875409555789696:0@lo:400:kworker.0 00010000:00080000:2.0:1788530193.491336:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f32bd3800 x1875409555789184/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530209 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530193.491356:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555789184:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788530193.491433:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555789312 00000100:00100000:2.0:1788530193.491445:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555789312 00000100:00100000:0.0:1788530193.492822:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f08db7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875409555790080:0@lo:400:kworker.0 00000100:00100000:0.0:1788530193.492887:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530193.492939:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37409180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555789568:0@lo:400:kworker.0 00000100:00100000:0.0:1788530193.492958:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788530193.492965:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3735c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555790208:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788530193.492992:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530193.493053:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555790080 00000100:00100000:0.0:1788530193.493057:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555790080 00000100:00100000:0.0:1788530193.493111:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788530193.493120:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f08db7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875409555790080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530193.493164:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f08db7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875409555790080:12345-0@lo:400:kworker.0 Request processed in 45us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530193.493171:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00080000:0.0:1788530193.493193:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788530193.493214:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f08db7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875409555790080:0@lo:400:kworker.0 00000100:00100000:0.0:1788530193.493266:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f08db6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555790592:0@lo:400:kworker.0 00000100:00100000:0.0:1788530193.493289:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530193.493315:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555790592 00000100:00100000:0.0:1788530193.493319:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555790592 00000100:00100000:0.0:1788530193.493347:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788530193.493353:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f08db5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555790592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530193.493394:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f08db5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555790592:12345-0@lo:400:kworker.0 Request processed in 41us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530193.493400:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:0.0:1788530193.493414:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788530193.493434:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f08db6d80 x1875409555790592/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788530209 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530193.493443:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f08db6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555790592:0@lo:400:kworker.0 00000100:00100000:2.0:1788530193.496369:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1788530193.496401:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:3647:x1875409555789312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530193.498950:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788530193.498983:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f08db6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555790720:0@lo:400:kworker.0 00000100:00100000:1.0:1788530193.501661:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555790208 00000100:00100000:1.0:1788530193.501689:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555790208 00000100:00100000:1.0:1788530193.501820:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788530193.501834:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f08db6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555790208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788530193.501866:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788530193.501972:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:3647:x1875409555789312:12345-0@lo:400:kworker.0 Request processed in 5583us (19333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530193.501983:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1788530193.502071:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37409f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555789952:0@lo:400:kworker.0 00000100:00100000:2.0:1788530193.502149:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530193.502180:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f08db7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875409555790464:0@lo:400:kworker.0 00000100:00100000:2.0:1788530193.502207:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530193.502236:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788530193.502243:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32a54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555789824:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788530193.502269:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530193.502303:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f08db4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555790336:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788530193.502326:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530193.502355:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555789952 00000100:00100000:2.0:1788530193.502359:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555789952 00000100:00100000:2.0:1788530193.502390:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788530193.502397:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555789952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530193.502437:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555789952:12345-0@lo:400:kworker.0 Request processed in 40us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530193.502443:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788530193.502461:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555789824 00000100:00100000:2.0:1788530193.502464:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555789824 00000100:00100000:2.0:1788530193.502497:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555790336 00000100:00100000:2.0:1788530193.502499:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555790336 00000100:00100000:2.0:1788530193.502509:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788530193.502527:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555789824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788530193.502545:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788530193.502593:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555789824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530193.502600:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788530193.502611:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788530193.502618:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32bd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555790336:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788530193.502628:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788530193.502650:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32bd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555790336:12345-0@lo:13:osp-pre-0-1.0 Request processed in 34us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530193.502655:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00080000:2.0:1788530193.502701:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f32a54e00 x1875409555789824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530209 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530193.502722:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32a54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555789824:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1788530193.502732:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f08db4380 x1875409555790336/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530209 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530193.502744:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f08db4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555790336:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788530193.502763:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37409f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555789952:0@lo:400:kworker.0 00000100:00100000:3.0:1788530193.503298:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555790464 00000100:00100000:3.0:1788530193.503304:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555790464 00000100:00100000:3.0:1788530193.503354:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1788530193.503362:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875409555790464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530193.503406:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875409555790464:12345-0@lo:400:kworker.0 Request processed in 46us (1198us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530193.503413:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00010000:00080000:3.0:1788530193.503439:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f08db7100 x1875409555790464/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530209 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530193.503450:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f08db7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875409555790464:0@lo:400:kworker.0 00000100:00100000:0.0:1788530193.511718:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530193.512630:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555790720 00000100:00100000:0.0:1788530193.512641:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555790720 00000100:00100000:0.0:1788530193.512696:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788530193.512707:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f08db4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555790720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530193.512860:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f08db4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555790720:12345-0@lo:400:kworker.0 Request processed in 154us (1150us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530193.512868:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:0.0:1788530193.512911:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f08db6d80 x1875409555790720/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788530209 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530193.512926:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f08db6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555790720:0@lo:400:kworker.0 00000100:00100000:0.0:1788530193.512987:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788530193.513001:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f08db6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875409555790848:0@lo:400:kworker.0 00000100:00080000:1.0:1788530193.513447:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788530193.513454:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788530193.513457:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788530193.513578:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f08db6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555790208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 11746us (20584us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530193.513600:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788530193.515241:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875409555789440:0@lo:400:kworker.0 00000100:00100000:1.0:1788530193.515259:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3647:1875409555789312:0@lo:400:kworker.0 00000100:00100000:0.0:1788530193.518167:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530193.518866:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555790848 00000100:00100000:1.0:1788530193.518876:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555790848 00010000:00080000:0.0:1788530193.518994:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f3735c380 x1875409555790208/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530209 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530193.519062:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3735c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555790208:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788530193.526709:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788530193.526758:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f08db5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875409555790848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530193.526878:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f08db5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875409555790848:12345-0@lo:400:kworker.0 Request processed in 153us (8722us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530193.526885:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00080000:1.0:1788530193.526923:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788530193.528052:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788530193.528070:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875409555790976:0@lo:400:kworker.0 00000100:00100000:1.0:1788530193.528122:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530193.536129:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555790976 00000100:00100000:0.0:1788530193.536150:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555790976 00000100:00100000:0.0:1788530193.536332:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788530193.536345:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875409555790976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530193.536462:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875409555790976:12345-0@lo:400:kworker.0 Request processed in 120us (8339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530193.536480:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00080000:0.0:1788530193.537637:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788530193.537689:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f08db6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875409555790848:0@lo:400:kworker.0 00010000:00080000:3.0:1788530193.539071:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e037d2680 x1875409555790976/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530209 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530193.539128:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875409555790976:0@lo:400:kworker.0 00010000:00010000:1.0:1788530193.601126:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788530194.415292:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530194.415346:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530194.415377:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530194.415400:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530194.415419:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530194.415437:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530194.415461:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530194.415496:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531584640 00000100:00100000:3.0:1788530194.415507:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531584640 00000100:00100000:1.0:1788530194.415624:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531584384 00000100:00100000:1.0:1788530194.415631:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531584384 00000100:00100000:3.0:1788530194.415632:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531584896 00000100:00100000:3.0:1788530194.415638:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531584896 00000100:00100000:3.0:1788530194.415675:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531584512 00000100:00100000:1.0:1788530194.415677:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 352 00000100:00100000:3.0:1788530194.415679:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531584512 00000100:00100000:1.0:1788530194.415693:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f442bcd-b742-4e76-ad7b-709f731358a0+14:2401:x1875409531584384:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1788530194.415699:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531584768 00000100:00100000:3.0:1788530194.415702:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531584768 00000100:00100000:3.0:1788530194.415722:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 181 00000100:00100000:3.0:1788530194.415731:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3735e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2401:x1875409531584640:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1788530194.416699:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3735e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2401:x1875409531584640:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 956us (1338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530194.416722:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 181 00000100:00100000:3.0:1788530194.416794:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 182 00000100:00100000:3.0:1788530194.416817:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3735d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2401:x1875409531584896:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1788530194.423793:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f442bcd-b742-4e76-ad7b-709f731358a0+14:2401:x1875409531584384:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 8078us (8487us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530194.423823:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 352 00000100:00100000:3.0:1788530194.427394:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3735d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2401:x1875409531584896:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 10570us (11998us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530194.427416:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 182 00000100:00100000:3.0:1788530194.427479:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 183 00000100:00100000:3.0:1788530194.427494:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3735ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:2401:x1875409531584512:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1788530194.427618:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3735ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:2401:x1875409531584512:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 129us (12196us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530194.427626:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 183 00000100:00100000:3.0:1788530194.427640:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 184 00000100:00100000:3.0:1788530194.427648:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3735f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2401:x1875409531584768:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1788530194.427673:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3735f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2401:x1875409531584768:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 27us (12235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530194.427680:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 184 00000100:00100000:3.0:1788530194.427708:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531585152 00000100:00100000:3.0:1788530194.427719:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531585152 00000100:00100000:3.0:1788530194.427781:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531585024 00000100:00100000:3.0:1788530194.427785:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531585024 00000100:00100000:3.0:1788530194.427981:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 56 00000100:00100000:3.0:1788530194.427991:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3735d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2401:x1875409531585152:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1788530194.428025:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3735d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2401:x1875409531585152:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 37us (12624us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530194.428031:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 56 00000100:00100000:3.0:1788530194.428044:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 57 00000100:00100000:3.0:1788530194.428053:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3735dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2401:x1875409531585024:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1788530194.428079:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3735dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2401:x1875409531585024:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 29us (12616us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530194.428086:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 57 00000100:00080000:0.0:1788530194.434620:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788530194.434634:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788530194.434638:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788530194.434642:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788530194.507052:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788530194.507092:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f08db6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555791104:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788530194.507209:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530194.507313:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555791104 00000100:00100000:0.0:1788530194.507325:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555791104 00000100:00100000:0.0:1788530194.507393:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788530194.507406:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32bd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555791104:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788530194.507462:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446453248 avail 1300213760 00000100:00100000:0.0:1788530194.507534:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32bd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555791104:12345-0@lo:41:osp-pre-1-0.0 Request processed in 128us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530194.507544:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788530194.507638:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f08db6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555791104:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788530194.627945:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530195.657117:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530196.675094:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530197.696902:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788530198.080981:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555791232:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788530198.081139:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530198.081515:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555791232 00000100:00100000:1.0:1788530198.081529:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555791232 00000100:00100000:1.0:1788530198.081988:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788530198.082003:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f08db6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555791232:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788530198.082058:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788530198.082203:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f08db6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555791232:12345-0@lo:41:osp-pre-0-1.0 Request processed in 203us (1065us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530198.082213:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788530198.082843:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555791232:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788530198.596085:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37409180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555791744:0@lo:400:kworker.0 00000100:00100000:2.0:1788530198.596273:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530198.596354:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875409555792256:0@lo:400:kworker.0 00000100:00100000:2.0:1788530198.596398:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530198.596436:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d258e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875409555792768:0@lo:400:kworker.0 00000100:00100000:2.0:1788530198.596458:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530198.596490:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788530198.596497:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37409f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875409555791616:0@lo:400:kworker.0 00000100:00100000:2.0:1788530198.596517:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530198.596533:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875409555792128:0@lo:400:kworker.0 00000100:00100000:2.0:1788530198.596554:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530198.596598:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875409555792640:0@lo:400:kworker.0 00000100:00100000:2.0:1788530198.596620:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530198.596653:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555791744 00000100:00100000:2.0:1788530198.596663:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555791744 00000100:00100000:2.0:1788530198.596739:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788530198.596749:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d25b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555791744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530198.596811:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d25b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555791744:12345-0@lo:400:kworker.0 Request processed in 63us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530198.596819:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788530198.596876:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37409180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555791744:0@lo:400:kworker.0 00000100:00100000:0.0:1788530198.598171:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32a54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3648:1875409555791488:0@lo:400:kworker.0 00000100:00100000:0.0:1788530198.598224:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530198.598260:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37373800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555792000:0@lo:400:kworker.0 00000100:00100000:0.0:1788530198.598283:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530198.598301:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555792512:0@lo:400:kworker.0 00000100:00100000:0.0:1788530198.598322:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530198.598339:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d25aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555793024:0@lo:400:kworker.0 00000100:00100000:0.0:1788530198.598357:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530198.598376:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1788530198.598382:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555791360:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788530198.598407:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530198.598440:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3740ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875409555791872:0@lo:400:kworker.0 00000100:00100000:0.0:1788530198.598464:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530198.598481:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555792384:0@lo:400:kworker.0 00000100:00100000:0.0:1788530198.598500:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530198.598517:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d259c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555792896:0@lo:400:kworker.0 00000100:00100000:0.0:1788530198.598534:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530198.598589:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555792256 00000100:00100000:0.0:1788530198.598595:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555792256 00000100:00100000:0.0:1788530198.598652:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555792768 00000100:00100000:0.0:1788530198.598655:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555792768 00000100:00100000:0.0:1788530198.598669:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555791616 00000100:00100000:0.0:1788530198.598671:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555791616 00000100:00100000:0.0:1788530198.598818:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555792128 00000100:00100000:0.0:1788530198.598823:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555792128 00000100:00100000:0.0:1788530198.598851:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555792640 00000100:00100000:0.0:1788530198.598854:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555792640 00000100:00100000:0.0:1788530198.598865:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555791872 00000100:00100000:0.0:1788530198.598867:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555791872 00000100:00100000:0.0:1788530198.598880:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788530198.598888:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d259880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875409555792256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530198.598932:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d259880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875409555792256:12345-0@lo:400:kworker.0 Request processed in 44us (2533us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530198.598941:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788530198.598961:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1788530198.599334:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f08db4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555793152:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788530198.599366:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530198.599398:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788530198.599404:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3735f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555793280:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788530198.599439:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530198.599472:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1788530198.599481:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d25b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875409555791616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530198.599511:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d25b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875409555791616:12345-0@lo:400:kworker.0 Request processed in 33us (2994us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530198.599517:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1788530198.599532:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1788530198.599539:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d25a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875409555792128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530198.599589:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d25a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875409555792128:12345-0@lo:400:kworker.0 Request processed in 50us (3034us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530198.599595:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1788530198.599608:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1788530198.599615:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d258380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875409555792640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530198.599643:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d258380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875409555792640:12345-0@lo:400:kworker.0 Request processed in 29us (3022us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530198.599649:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1788530198.599660:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1788530198.599667:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875409555791872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530198.599723:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875409555791872:12345-0@lo:400:kworker.0 Request processed in 57us (1258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530198.599729:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1788530198.599790:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555792512 00000100:00100000:3.0:1788530198.599795:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555792512 00000100:00100000:3.0:1788530198.599823:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555793024 00000100:00100000:3.0:1788530198.599826:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555793024 00000100:00100000:3.0:1788530198.599839:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555792384 00000100:00100000:3.0:1788530198.599842:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555792384 00000100:00100000:3.0:1788530198.599855:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555792896 00000100:00100000:3.0:1788530198.599858:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555792896 00000100:00100000:3.0:1788530198.599876:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788530198.599883:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f08db7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555792512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530198.599915:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f08db7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555792512:12345-0@lo:400:kworker.0 Request processed in 32us (1591us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530198.599921:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788530198.599933:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788530198.599940:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f08db4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555793024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530198.599980:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f08db4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555793024:12345-0@lo:400:kworker.0 Request processed in 41us (1622us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530198.599985:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788530198.599997:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788530198.600003:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555792384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530198.600030:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555792384:12345-0@lo:400:kworker.0 Request processed in 28us (1529us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530198.600036:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788530198.600047:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788530198.600052:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555792896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530198.600077:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555792896:12345-0@lo:400:kworker.0 Request processed in 25us (1542us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530198.600093:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788530198.600133:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555791360 00000100:00100000:3.0:1788530198.600137:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555791360 00000100:00100000:3.0:1788530198.600152:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555793152 00000100:00100000:3.0:1788530198.600155:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555793152 00000100:00100000:3.0:1788530198.600162:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555793280 00000100:00100000:3.0:1788530198.600164:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555793280 00000100:00100000:3.0:1788530198.600173:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788530198.600180:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555791360:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788530198.600207:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788530198.600241:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555791360:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (1833us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530198.600248:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788530198.600259:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788530198.600265:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3735c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555793152:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788530198.600279:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788530198.600312:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3735c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555793152:12345-0@lo:13:osp-pre-0-1.0 Request processed in 47us (945us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530198.600318:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788530198.600328:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788530198.600334:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555793280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788530198.600343:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788530198.600365:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555793280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 31us (926us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530198.600371:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788530198.600388:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555793408:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788530198.600421:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788530198.600473:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f3735f800 x1875409555793280/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530214 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530198.600492:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3735f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555793280:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1788530198.600502:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f08db4e00 x1875409555793152/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530214 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530198.600512:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f08db4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555793152:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788530198.600533:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555793408 00000100:00100000:3.0:1788530198.600536:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555793408 00000100:00100000:3.0:1788530198.600550:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788530198.600556:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555793408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788530198.600592:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788530198.600621:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555793408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530198.600628:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00080000:3.0:1788530198.600650:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e027d4700 x1875409555793408/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530214 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530198.600661:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555793408:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1788530198.600681:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f32bd3b80 x1875409555791360/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530214 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530198.600692:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555791360:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788530198.600716:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3740ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875409555791872:0@lo:400:kworker.0 00010000:00080000:3.0:1788530198.600725:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f328e4e00 x1875409555792384/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788530214 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530198.600738:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555792384:0@lo:400:kworker.0 00010000:00080000:3.0:1788530198.600748:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f3d259c00 x1875409555792896/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788530214 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530198.600755:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d259c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555792896:0@lo:400:kworker.0 00010000:00080000:3.0:1788530198.600766:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f328e5c00 x1875409555792512/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788530214 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530198.600773:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555792512:0@lo:400:kworker.0 00010000:00080000:3.0:1788530198.600780:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f3d25aa00 x1875409555793024/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788530214 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530198.600788:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d25aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555793024:0@lo:400:kworker.0 00000100:00100000:3.0:1788530198.600858:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555791488 00000100:00100000:3.0:1788530198.600862:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555791488 00000100:00100000:3.0:1788530198.600888:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1788530198.600893:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:3648:x1875409555791488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530198.600924:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:3648:x1875409555791488:12345-0@lo:400:kworker.0 Request processed in 31us (2700us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530198.600930:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1788530198.600975:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555792000 00000100:00100000:3.0:1788530198.600978:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555792000 00000100:00100000:3.0:1788530198.601001:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788530198.601008:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f08db4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555792000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530198.601039:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f08db4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555792000:12345-0@lo:400:kworker.0 Request processed in 32us (2755us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530198.601052:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788530198.601076:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32a54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3648:1875409555791488:0@lo:400:kworker.0 00000100:00100000:3.0:1788530198.601087:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37373800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555792000:0@lo:400:kworker.0 00000100:00100000:3.0:1788530198.601115:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37409f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875409555791616:0@lo:400:kworker.0 00000100:00100000:3.0:1788530198.601127:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875409555792128:0@lo:400:kworker.0 00000100:00100000:3.0:1788530198.601138:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875409555792640:0@lo:400:kworker.0 00010000:00080000:3.0:1788530198.601149:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f328e4a80 x1875409555792256/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530214 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530198.601158:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875409555792256:0@lo:400:kworker.0 00000100:00080000:1.0:1788530198.602235:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788530198.602243:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788530198.602247:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788530198.602251:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788530198.602512:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d258a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875409555792768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530198.602615:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d258a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875409555792768:12345-0@lo:400:kworker.0 Request processed in 3647us (6154us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530198.602624:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00010000:00080000:1.0:1788530198.603722:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f3d258e00 x1875409555792768/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530214 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530198.603746:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d258e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875409555792768:0@lo:400:kworker.0 00010000:00010000:3.0:1788530198.720915:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788530199.545222:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530199.545279:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530199.545306:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530199.545333:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530199.545357:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530199.545375:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530199.545407:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530199.545419:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531585280 00000100:00100000:0.0:1788530199.545438:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531585280 00000100:00100000:3.0:1788530199.545474:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531585536 00000100:00100000:3.0:1788530199.545480:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531585536 00000100:00100000:0.0:1788530199.545541:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 354 00000100:00100000:3.0:1788530199.545550:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531585792 00000100:00100000:3.0:1788530199.545553:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531585792 00000100:00100000:0.0:1788530199.545553:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f442bcd-b742-4e76-ad7b-709f731358a0+14:2400:x1875409531585280:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1788530199.545606:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531585408 00000100:00100000:3.0:1788530199.545610:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531585408 00000100:00100000:3.0:1788530199.545623:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531585664 00000100:00100000:3.0:1788530199.545646:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531585664 00000100:00100000:3.0:1788530199.545666:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 191 00000100:00100000:3.0:1788530199.545675:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2400:x1875409531585536:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1788530199.545679:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f442bcd-b742-4e76-ad7b-709f731358a0+14:2400:x1875409531585280:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 128us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530199.545688:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 354 00000100:00100000:3.0:1788530199.545725:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2400:x1875409531585536:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 52us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530199.545732:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 191 00000100:00100000:3.0:1788530199.545745:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 192 00000100:00100000:0.0:1788530199.545751:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 193 00000100:00100000:3.0:1788530199.545752:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2400:x1875409531585792:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1788530199.545757:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:2400:x1875409531585408:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1788530199.545774:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2400:x1875409531585792:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 23us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530199.545778:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:2400:x1875409531585408:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 21us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530199.545781:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 192 00000100:00100000:0.0:1788530199.545784:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 193 00000100:00080000:1.0:1788530199.545958:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788530199.545965:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788530199.546132:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 194 00000100:00100000:3.0:1788530199.546143:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2400:x1875409531585664:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1788530199.546176:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2400:x1875409531585664:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 36us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530199.546183:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 194 00000100:00100000:3.0:1788530199.546216:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531586048 00000100:00100000:3.0:1788530199.546220:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531586048 00000100:00100000:3.0:1788530199.546260:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531585920 00000100:00100000:3.0:1788530199.546263:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531585920 00000100:00100000:3.0:1788530199.546283:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 62 00000100:00100000:3.0:1788530199.546289:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2400:x1875409531586048:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1788530199.546315:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2400:x1875409531586048:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 26us (982us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530199.546322:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 62 00000100:00100000:3.0:1788530199.546341:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 63 00000100:00100000:3.0:1788530199.546346:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2400:x1875409531585920:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1788530199.546375:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2400:x1875409531585920:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 28us (968us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530199.546380:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 63 00000100:00080000:2.0:1788530199.546632:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788530199.546637:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788530199.618415:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788530199.618446:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555793536:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788530199.618522:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530199.618668:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555793536 00000100:00100000:0.0:1788530199.618676:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555793536 00000100:00100000:0.0:1788530199.618740:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788530199.618751:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555793536:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788530199.618793:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446453248 avail 1300213760 00000100:00100000:0.0:1788530199.618853:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555793536:12345-0@lo:41:osp-pre-1-0.0 Request processed in 104us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530199.618860:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788530199.618946:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555793536:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788530199.746322:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788530200.351984:0:12519:0:(tgt_mount.c:2429:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788530200.352828:0:12519:0:(tgt_mount.c:2444:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788530200.774100:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530201.794519:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788530202.434021:0:12616:0:(tgt_mount.c:2429:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788530202.434335:0:12616:0:(tgt_mount.c:2444:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788530202.816763:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788530203.204808:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788530203.204862:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37373800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555793664:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788530203.205020:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530203.205334:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555793664 00000100:00100000:1.0:1788530203.205351:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555793664 00000100:00100000:1.0:1788530203.205432:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788530203.205443:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555793664:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788530203.205499:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788530203.205685:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555793664:12345-0@lo:41:osp-pre-0-1.0 Request processed in 243us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530203.205697:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788530203.205861:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37373800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555793664:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788530203.713309:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37373800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555793792:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788530203.713377:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530203.713442:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32a54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555793920:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788530203.713467:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530203.713486:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788530203.713491:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555794048:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788530203.713514:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530203.713545:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555793792 00000100:00100000:3.0:1788530203.713553:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555793792 00000100:00100000:3.0:1788530203.713618:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555793920 00000100:00100000:3.0:1788530203.713621:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555793920 00000100:00100000:3.0:1788530203.713633:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555794048 00000100:00100000:3.0:1788530203.713636:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555794048 00000100:00100000:3.0:1788530203.713662:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788530203.713671:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f328e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555793792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788530203.713698:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788530203.713739:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f328e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555793792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530203.713747:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788530203.713944:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788530203.713958:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f328e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555793920:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788530203.713975:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788530203.714179:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d25ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555794176:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788530203.714214:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530203.714321:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f328e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555793920:12345-0@lo:13:osp-pre-0-1.0 Request processed in 363us (852us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530203.714328:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788530203.714340:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555794176 00000100:00100000:3.0:1788530203.714344:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555794176 00000100:00100000:3.0:1788530203.714362:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788530203.714368:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f328e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555794048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788530203.714379:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788530203.714405:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f328e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555794048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 36us (890us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530203.714411:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788530203.714423:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788530203.714429:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555794176:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788530203.714438:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788530203.714469:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555794176:12345-0@lo:13:osp-pre-1-1.0 Request processed in 40us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530203.714475:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:3.0:1788530203.714498:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788530203.714501:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788530203.714618:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f3d25ad80 x1875409555794176/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530219 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530203.714637:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d25ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555794176:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788530203.714668:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3735f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555794688:0@lo:400:kworker.0 00000100:00100000:0.0:1788530203.714694:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530203.714710:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f08db4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875409555794560:0@lo:400:kworker.0 00000100:00100000:0.0:1788530203.714712:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e035f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875409555795200:0@lo:400:kworker.0 00000100:00100000:0.0:1788530203.714732:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530203.714737:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3650:1875409555794304:0@lo:400:kworker.0 00000100:00100000:0.0:1788530203.714762:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555795200 00000100:00100000:0.0:1788530203.714766:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555795200 00000100:00100000:3.0:1788530203.714885:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530203.714897:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1788530203.714904:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875409555795200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530203.714909:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e035f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875409555794816:0@lo:400:kworker.0 00000100:00100000:3.0:1788530203.714960:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788530203.714986:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f37373800 x1875409555793792/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530219 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530203.714999:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37373800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555793792:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788530203.715023:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555794304 00000100:00100000:3.0:1788530203.715027:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555794304 00000100:00100000:3.0:1788530203.715055:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:3.0:1788530203.715063:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:3650:x1875409555794304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530203.715094:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:3650:x1875409555794304:12345-0@lo:400:kworker.0 Request processed in 32us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530203.715094:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875409555795200:12345-0@lo:400:kworker.0 Request processed in 191us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530203.715101:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:0.0:1788530203.715109:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1788530203.715120:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555794816 00000100:00100000:0.0:1788530203.715123:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555794816 00000100:00100000:3.0:1788530203.715134:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3650:1875409555794304:0@lo:400:kworker.0 00000100:00100000:0.0:1788530203.715146:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1788530203.715152:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e035f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875409555794816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530203.715183:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e035f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875409555794816:12345-0@lo:400:kworker.0 Request processed in 31us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530203.715189:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1788530203.715223:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e035f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875409555794816:0@lo:400:kworker.0 00000100:00080000:0.0:1788530203.715237:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788530203.715240:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788530203.715247:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530203.715265:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e035f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875409555795072:0@lo:400:kworker.0 00000100:00100000:0.0:1788530203.715286:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530203.715303:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788530203.715308:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875409555794432:0@lo:400:kworker.0 00000100:00100000:0.0:1788530203.715327:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530203.715342:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e035f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875409555794944:0@lo:400:kworker.0 00000100:00100000:0.0:1788530203.715359:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530203.715449:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555794560 00000100:00100000:0.0:1788530203.715453:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555794560 00000100:00100000:0.0:1788530203.715477:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555795072 00000100:00100000:0.0:1788530203.715479:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555795072 00000100:00100000:0.0:1788530203.715704:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555794432 00000100:00100000:0.0:1788530203.715708:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555794432 00000100:00100000:0.0:1788530203.715720:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555794944 00000100:00100000:0.0:1788530203.715722:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555794944 00000100:00100000:0.0:1788530203.715745:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1788530203.715751:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875409555794560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530203.715787:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875409555794560:12345-0@lo:400:kworker.0 Request processed in 36us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530203.715793:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1788530203.715806:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1788530203.715812:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875409555795072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530203.715838:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875409555795072:12345-0@lo:400:kworker.0 Request processed in 27us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530203.715844:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1788530203.715855:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1788530203.715861:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875409555794432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530203.715887:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875409555794432:12345-0@lo:400:kworker.0 Request processed in 26us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530203.715891:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1788530203.715902:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1788530203.715908:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875409555794944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530203.715932:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875409555794944:12345-0@lo:400:kworker.0 Request processed in 25us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530203.715937:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00080000:0.0:1788530203.715955:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788530203.715958:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788530203.716103:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875409555794432:0@lo:400:kworker.0 00010000:00080000:0.0:1788530203.716116:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e035f7b80 x1875409555794944/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530219 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530203.716138:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e035f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875409555794944:0@lo:400:kworker.0 00000100:00100000:0.0:1788530203.716151:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f08db4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875409555794560:0@lo:400:kworker.0 00000100:00100000:0.0:1788530203.716159:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e035f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875409555795072:0@lo:400:kworker.0 00010000:00080000:0.0:1788530203.716194:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e035f6a00 x1875409555795200/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530219 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530203.716202:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e035f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875409555795200:0@lo:400:kworker.0 00000100:00100000:1.0:1788530203.716229:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555794688 00000100:00100000:1.0:1788530203.716235:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555794688 00000100:00100000:1.0:1788530203.716264:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788530203.716271:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555794688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530203.716312:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555794688:12345-0@lo:400:kworker.0 Request processed in 41us (1617us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530203.716318:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788530203.716334:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3735f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555794688:0@lo:400:kworker.0 00010000:00080000:2.0:1788530203.720968:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f32a54e00 x1875409555793920/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530219 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530203.721001:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32a54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555793920:0@lo:13:osp-pre-0-1.0 00010000:00080000:2.0:1788530203.721044:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f328e4a80 x1875409555794048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530219 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530203.721058:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555794048:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788530203.844224:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788530204.653184:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530204.653227:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530204.653276:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530204.653298:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530204.653375:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530204.653408:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531586176 00000100:00100000:3.0:1788530204.653418:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531586176 00000100:00100000:3.0:1788530204.653475:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 356 00000100:00100000:3.0:1788530204.653485:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f442bcd-b742-4e76-ad7b-709f731358a0+14:2400:x1875409531586176:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1788530204.653789:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531586304 00000100:00100000:1.0:1788530204.653795:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531586304 00000100:00100000:1.0:1788530204.653853:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531586560 00000100:00100000:1.0:1788530204.653857:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531586560 00000100:00100000:1.0:1788530204.653881:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531586432 00000100:00100000:1.0:1788530204.653884:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531586432 00000100:00100000:1.0:1788530204.653902:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531586688 00000100:00100000:1.0:1788530204.653905:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531586688 00000100:00100000:3.0:1788530204.653913:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f442bcd-b742-4e76-ad7b-709f731358a0+14:2400:x1875409531586176:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 427us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530204.653922:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 201 00000100:00100000:3.0:1788530204.653926:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 356 00000100:00100000:1.0:1788530204.653935:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e035f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:2400:x1875409531586304:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1788530204.653969:0:10719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 202 00000100:00100000:1.0:1788530204.653977:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e035f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:2400:x1875409531586304:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 44us (809us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530204.653996:0:10719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e035f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2400:x1875409531586560:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1788530204.654002:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 201 00000100:00100000:1.0:1788530204.654025:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 203 00000100:00100000:3.0:1788530204.654030:0:10719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e035f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2400:x1875409531586560:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 37us (801us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530204.654038:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e035f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2400:x1875409531586432:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1788530204.654042:0:10719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 202 00000100:00100000:3.0:1788530204.654062:0:10719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 204 00000100:00100000:3.0:1788530204.654070:0:10719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e035f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2400:x1875409531586688:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1788530204.654079:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e035f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2400:x1875409531586432:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 44us (778us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530204.654087:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 203 00000100:00100000:3.0:1788530204.654103:0:10719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e035f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2400:x1875409531586688:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 32us (725us total) trans 0 rc 0/0 00000100:00080000:1.0:1788530204.654109:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788530204.654112:0:10719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 204 00000100:00080000:1.0:1788530204.654116:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788530204.654270:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530204.654301:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531586816 00000100:00100000:2.0:1788530204.654306:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531586816 00000100:00100000:2.0:1788530204.654359:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 22 00000100:00100000:2.0:1788530204.654371:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2398:x1875409531586816:12345-192.168.202.41@tcp:9:kworker.0 00000020:00000080:2.0:1788530204.654391:0:8752:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e12575067f 00000100:00080000:2.0:1788530204.654400:0:8752:0:(import.c:65:import_set_state_nolock()) ffff9a9e03344800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788530204.654453:0:8752:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1788530204.654599:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+2:2398:x1875409531586816:12345-192.168.202.41@tcp:9:kworker.0 Request processed in 231us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530204.654606:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 22 00000100:00080000:1.0:1788530204.655773:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788530204.655812:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530204.656015:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531586944 00000100:00100000:2.0:1788530204.656024:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531586944 00000100:00100000:2.0:1788530204.656078:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 23 00000100:00100000:2.0:1788530204.656088:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2398:x1875409531586944:12345-192.168.202.41@tcp:9:kworker.0 00000020:00000080:2.0:1788530204.656111:0:8438:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e125750686 00000100:00080000:2.0:1788530204.656119:0:8438:0:(import.c:65:import_set_state_nolock()) ffff9a9e03342800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788530204.656193:0:8438:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1788530204.656318:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+2:2398:x1875409531586944:12345-192.168.202.41@tcp:9:kworker.0 Request processed in 231us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530204.656325:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 23 00010000:00010000:1.0:1788530204.656483:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788530204.656491:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788530204.661457:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788530204.737722:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788530204.737762:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e035f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555795328:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788530204.737868:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530204.738247:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555795328 00000100:00100000:1.0:1788530204.738257:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555795328 00000100:00100000:1.0:1788530204.738318:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788530204.738329:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e035f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555795328:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788530204.738383:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446453248 avail 1300213760 00000100:00100000:1.0:1788530204.738484:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e035f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555795328:12345-0@lo:41:osp-pre-1-0.0 Request processed in 157us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530204.738492:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788530204.738540:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e035f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555795328:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788530204.867529:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788530205.435166:0:12714:0:(tgt_mount.c:2429:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788530205.435540:0:12714:0:(tgt_mount.c:2444:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788530205.892091:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530206.916925:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788530207.664010:0:12811:0:(tgt_mount.c:2429:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788530207.664264:0:12811:0:(tgt_mount.c:2444:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788530207.939223:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788530208.331961:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788530208.331982:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e035f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555795456:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788530208.332058:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530208.335779:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555795456 00000100:00100000:1.0:1788530208.335799:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555795456 00000100:00100000:1.0:1788530208.335855:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788530208.335867:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e035f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555795456:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788530208.336171:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788530208.336254:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e035f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555795456:12345-0@lo:41:osp-pre-0-1.0 Request processed in 389us (4195us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530208.336262:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788530208.337855:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e035f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555795456:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788530208.835782:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788530208.835803:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555795584:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788530208.835881:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530208.835942:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555795584 00000100:00100000:0.0:1788530208.835950:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555795584 00000100:00100000:0.0:1788530208.836001:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788530208.836012:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3735f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555795584:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788530208.836041:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788530208.836639:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3735f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555795584:12345-0@lo:13:osp-pre-1-1.0 Request processed in 628us (768us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530208.836646:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:0.0:1788530208.836676:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788530208.836713:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f3d2b8a80 x1875409555795584/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530224 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530208.836733:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555795584:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788530208.838094:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3649:1875409555795712:0@lo:400:kworker.0 00000100:00100000:1.0:1788530208.838145:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530208.838172:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875409555796224:0@lo:400:kworker.0 00000100:00100000:1.0:1788530208.838196:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530208.838213:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875409555796736:0@lo:400:kworker.0 00000100:00100000:1.0:1788530208.838232:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530208.838250:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788530208.838255:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875409555795840:0@lo:400:kworker.0 00000100:00100000:1.0:1788530208.838276:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530208.838293:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875409555796352:0@lo:400:kworker.0 00000100:00100000:1.0:1788530208.838311:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530208.838324:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875409555796864:0@lo:400:kworker.0 00000100:00100000:1.0:1788530208.838352:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530208.838388:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555796096:0@lo:400:kworker.0 00000100:00100000:1.0:1788530208.838411:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530208.838426:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555796608:0@lo:400:kworker.0 00000100:00100000:1.0:1788530208.838444:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530208.838459:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788530208.838473:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875409555795968:0@lo:400:kworker.0 00000100:00100000:1.0:1788530208.838492:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530208.838507:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555796480:0@lo:400:kworker.0 00000100:00100000:1.0:1788530208.838523:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530208.838536:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555796992:0@lo:400:kworker.0 00000100:00100000:1.0:1788530208.838554:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530208.838613:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555796224 00000100:00100000:1.0:1788530208.838619:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555796224 00000100:00100000:1.0:1788530208.838665:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555796736 00000100:00100000:1.0:1788530208.838668:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555796736 00000100:00100000:1.0:1788530208.838693:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555795840 00000100:00100000:1.0:1788530208.838695:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555795840 00000100:00100000:1.0:1788530208.838704:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555796352 00000100:00100000:1.0:1788530208.838706:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555796352 00000100:00100000:1.0:1788530208.838717:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555796864 00000100:00100000:1.0:1788530208.838719:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555796864 00000100:00100000:1.0:1788530208.838729:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555795968 00000100:00100000:1.0:1788530208.838732:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555795968 00000100:00100000:1.0:1788530208.838746:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1788530208.838753:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875409555796224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530208.838795:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875409555796224:12345-0@lo:400:kworker.0 Request processed in 42us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530208.838803:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1788530208.838818:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1788530208.838824:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875409555796736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530208.838849:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875409555796736:12345-0@lo:400:kworker.0 Request processed in 25us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530208.838855:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1788530208.839810:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1788530208.839819:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875409555795840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530208.839851:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875409555795840:12345-0@lo:400:kworker.0 Request processed in 35us (1574us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530208.839857:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1788530208.840040:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555795712 00000100:00100000:0.0:1788530208.840044:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555795712 00000100:00100000:0.0:1788530208.840084:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1788530208.840091:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:3649:x1875409555795712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530208.840121:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:3649:x1875409555795712:12345-0@lo:400:kworker.0 Request processed in 31us (1976us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530208.840127:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00080000:0.0:1788530208.840157:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788530208.840161:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788530208.840172:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555797120:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788530208.840197:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530208.840226:0:9912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555797120 00000100:00100000:0.0:1788530208.840230:0:9912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555797120 00000100:00100000:0.0:1788530208.840256:0:9912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788530208.840263:0:9912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f08db4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555797120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788530208.840276:0:9912:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788530208.840307:0:9912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f08db4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555797120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 45us (109us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530208.840313:0:9912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:0.0:1788530208.840336:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788530208.840364:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f3d2b8a80 x1875409555797120/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530224 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530208.840392:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555797120:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788530208.841760:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1788530208.841771:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875409555796352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530208.841810:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875409555796352:12345-0@lo:400:kworker.0 Request processed in 42us (3498us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530208.841817:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1788530208.841833:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1788530208.841838:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875409555796864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530208.841863:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875409555796864:12345-0@lo:400:kworker.0 Request processed in 25us (3510us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530208.842022:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555796608 00000100:00100000:0.0:1788530208.842027:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555796608 00000100:00100000:0.0:1788530208.842063:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555796480 00000100:00100000:0.0:1788530208.842066:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555796480 00000100:00100000:0.0:1788530208.842147:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555796992 00000100:00100000:0.0:1788530208.842151:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555796992 00000100:00100000:0.0:1788530208.842163:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788530208.842170:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555796608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530208.842203:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555796608:12345-0@lo:400:kworker.0 Request processed in 34us (3758us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530208.842209:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788530208.842220:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788530208.842226:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555796480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530208.842248:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555796480:12345-0@lo:400:kworker.0 Request processed in 23us (3724us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530208.842254:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788530208.842264:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788530208.842270:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555796992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530208.842294:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555796992:12345-0@lo:400:kworker.0 Request processed in 24us (3738us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530208.842299:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788530208.842317:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555796096 00000100:00100000:0.0:1788530208.842320:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555796096 00000100:00100000:1.0:1788530208.842812:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1788530208.842827:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1788530208.842834:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875409555795968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530208.842865:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875409555795968:12345-0@lo:400:kworker.0 Request processed in 33us (4372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530208.843995:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1788530208.844483:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788530208.844492:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555796096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530208.844539:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555796096:12345-0@lo:400:kworker.0 Request processed in 48us (6126us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530208.844572:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00080000:0.0:1788530208.844622:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788530208.844656:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875409555795968:0@lo:400:kworker.0 00010000:00080000:0.0:1788530208.845391:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e027dad80 x1875409555796480/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788530224 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530208.845407:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555796480:0@lo:400:kworker.0 00010000:00080000:0.0:1788530208.845425:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e027d8e00 x1875409555796992/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788530224 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530208.845433:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555796992:0@lo:400:kworker.0 00000100:00100000:0.0:1788530208.845443:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555796096:0@lo:400:kworker.0 00010000:00080000:0.0:1788530208.845452:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e027db100 x1875409555796608/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788530224 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530208.845459:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555796608:0@lo:400:kworker.0 00000100:00100000:1.0:1788530208.846047:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875409555795840:0@lo:400:kworker.0 00010000:00080000:1.0:1788530208.846060:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e027d9c00 x1875409555796352/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530224 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530208.846083:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875409555796352:0@lo:400:kworker.0 00010000:00080000:1.0:1788530208.846106:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e027d8700 x1875409555796864/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530224 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530208.846114:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875409555796864:0@lo:400:kworker.0 00000100:00100000:1.0:1788530208.846124:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3649:1875409555795712:0@lo:400:kworker.0 00000100:00100000:1.0:1788530208.846134:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875409555796224:0@lo:400:kworker.0 00000100:00100000:1.0:1788530208.846145:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875409555796736:0@lo:400:kworker.0 00000100:00100000:1.0:1788530208.848736:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d25bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555797376:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788530208.848796:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530208.848831:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788530208.848838:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d25a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555797248:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788530208.848860:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530208.848906:0:9912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555797376 00000100:00100000:1.0:1788530208.848913:0:9912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555797376 00000100:00100000:1.0:1788530208.848951:0:9912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555797248 00000100:00100000:1.0:1788530208.848954:0:9912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555797248 00000100:00100000:1.0:1788530208.848966:0:9912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788530208.848975:0:9912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555797376:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788530208.849002:0:9912:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788530208.849039:0:9912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555797376:12345-0@lo:13:osp-pre-0-1.0 Request processed in 65us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530208.849045:0:9912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788530208.849059:0:9912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788530208.849064:0:9912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555797248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788530208.849072:0:9912:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788530208.849102:0:9912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555797248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 37us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530208.849107:0:9912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00010000:00080000:1.0:1788530208.849133:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f3d25a680 x1875409555797248/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530224 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530208.849151:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d25a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555797248:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1788530208.849160:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f3d25bb80 x1875409555797376/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530224 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530208.849169:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d25bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555797376:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788530208.961185:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788530209.777284:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530209.777341:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530209.777373:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530209.777397:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530209.777423:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530209.777454:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531587072 00000100:00100000:3.0:1788530209.777474:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531587072 00000100:00100000:3.0:1788530209.777522:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 358 00000100:00100000:3.0:1788530209.777544:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f442bcd-b742-4e76-ad7b-709f731358a0+14:2399:x1875409531587072:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1788530209.777657:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f442bcd-b742-4e76-ad7b-709f731358a0+14:2399:x1875409531587072:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 114us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530209.777675:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 358 00000100:00100000:0.0:1788530209.778154:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531587200 00000100:00100000:0.0:1788530209.778161:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531587200 00000100:00100000:0.0:1788530209.778221:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531587456 00000100:00100000:0.0:1788530209.778224:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531587456 00000100:00100000:0.0:1788530209.778243:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531587328 00000100:00100000:0.0:1788530209.778246:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531587328 00000100:00100000:0.0:1788530209.778258:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531587584 00000100:00100000:0.0:1788530209.778261:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531587584 00000100:00100000:0.0:1788530209.778275:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 211 00000100:00100000:0.0:1788530209.778282:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e035f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:2399:x1875409531587200:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1788530209.778323:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e035f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:2399:x1875409531587200:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 41us (1050us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530209.778336:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 211 00000100:00100000:0.0:1788530209.778349:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 212 00000100:00100000:0.0:1788530209.778355:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f328e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2399:x1875409531587456:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1788530209.778379:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f328e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2399:x1875409531587456:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 24us (1037us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530209.778384:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 212 00000100:00100000:0.0:1788530209.778395:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 213 00000100:00100000:0.0:1788530209.778401:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f328e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2399:x1875409531587328:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1788530209.778422:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f328e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2399:x1875409531587328:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 22us (1024us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530209.778428:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 213 00000100:00100000:0.0:1788530209.778438:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 214 00000100:00100000:0.0:1788530209.778444:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37373800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2399:x1875409531587584:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1788530209.778478:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37373800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2399:x1875409531587584:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 34us (1054us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530209.778484:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 214 00000100:00080000:3.0:1788530209.779168:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788530209.779173:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788530209.860976:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788530209.861004:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d25bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555797504:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788530209.861093:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530209.861171:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555797504 00000100:00100000:2.0:1788530209.861181:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555797504 00000100:00100000:2.0:1788530209.861239:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788530209.861248:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d25a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555797504:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788530209.861282:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446453248 avail 1300213760 00000100:00100000:2.0:1788530209.861327:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d25a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555797504:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530209.861334:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788530209.861377:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d25bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555797504:0@lo:41:osp-pre-1-0.0 00000001:00100000:1.0:1788530209.871102:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc 00000020:00000080:1.0:1788530209.871125:0:9518:0:(genops.c:885:class_export_put()) final put ffff9a9e03345800/5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc 00000020:00000080:3.0:1788530209.871260:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9e03345800/5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc for lustre-OST0001 00000020:00000080:3.0:1788530209.871320:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a9e03342800 for lustre-OST0001 00000001:00100000:3.0:1788530209.871635:0:8431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc 00000020:00000080:3.0:1788530209.871639:0:8431:0:(genops.c:885:class_export_put()) final put ffff9a9e03346000/5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc 00000020:00000080:1.0:1788530209.871773:0:12493:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9e03346000/5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc for lustre-OST0000 00000020:00000080:1.0:1788530209.871805:0:12493:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a9e03344800 for lustre-OST0000 00000020:00000004:0.0:1788530209.981498:0:12909:0:(tgt_mount.c:2429:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788530209.983475:0:12909:0:(tgt_mount.c:2444:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788530209.985260:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530211.008738:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530212.040047:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530213.060634:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788530213.463842:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788530213.463867:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555797632:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788530213.463940:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530213.465584:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555797632 00000100:00100000:0.0:1788530213.465602:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555797632 00000100:00100000:0.0:1788530213.465665:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788530213.465678:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555797632:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788530213.465742:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788530213.465819:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555797632:12345-0@lo:41:osp-pre-0-1.0 Request processed in 145us (1878us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530213.465838:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788530213.465899:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555797632:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788530213.952744:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555797760:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788530213.952835:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530213.952921:0:9912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555797760 00000100:00100000:1.0:1788530213.952930:0:9912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555797760 00000100:00100000:1.0:1788530213.952984:0:9912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788530213.952994:0:9912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37377480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555797760:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788530213.953027:0:9912:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788530213.953086:0:9912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37377480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555797760:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530213.953093:0:9912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00010000:00080000:1.0:1788530213.953141:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f3d2a1180 x1875409555797760/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530229 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530213.953160:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555797760:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788530213.953266:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788530213.953285:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788530213.953294:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03359880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555797888:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788530213.953322:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530213.953354:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555797888 00000100:00100000:3.0:1788530213.953358:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555797888 00000100:00100000:3.0:1788530213.953386:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788530213.953392:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0335aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555797888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788530213.953403:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788530213.953431:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0335aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555797888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 39us (109us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530213.953437:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:3.0:1788530213.953449:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788530213.953466:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e03359880 x1875409555797888/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530229 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530213.953478:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03359880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555797888:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788530213.957209:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37374a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555798400:0@lo:400:kworker.0 00000100:00100000:1.0:1788530213.957292:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530213.957330:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37377800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875409555798912:0@lo:400:kworker.0 00000100:00100000:1.0:1788530213.957356:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530213.957382:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788530213.957388:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37377100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875409555798272:0@lo:400:kworker.0 00000100:00100000:1.0:1788530213.957410:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530213.957427:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37374380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875409555798784:0@lo:400:kworker.0 00000100:00100000:1.0:1788530213.957448:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530213.957488:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555798400 00000100:00100000:1.0:1788530213.957495:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555798400 00000100:00100000:1.0:1788530213.957539:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788530213.957548:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37375500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555798400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530213.957627:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37375500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555798400:12345-0@lo:400:kworker.0 Request processed in 78us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530213.957634:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788530213.957660:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555798912 00000100:00100000:1.0:1788530213.957664:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555798912 00000100:00100000:1.0:1788530213.957709:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555798272 00000100:00100000:1.0:1788530213.957712:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555798272 00000100:00100000:1.0:1788530213.957746:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555798784 00000100:00100000:1.0:1788530213.957749:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555798784 00000100:00100000:1.0:1788530213.957772:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1788530213.957779:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37374e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875409555798912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530213.957809:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37374e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875409555798912:12345-0@lo:400:kworker.0 Request processed in 31us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530213.957815:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1788530213.958025:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37376a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3647:1875409555798016:0@lo:400:kworker.0 00000100:00100000:2.0:1788530213.958064:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530213.958090:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37376680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875409555798528:0@lo:400:kworker.0 00000100:00100000:2.0:1788530213.958112:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530213.958124:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37377b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555799040:0@lo:400:kworker.0 00000100:00100000:2.0:1788530213.958143:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530213.958163:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788530213.958169:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37376d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875409555798144:0@lo:400:kworker.0 00000100:00100000:2.0:1788530213.958188:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530213.958198:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37375180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875409555798656:0@lo:400:kworker.0 00000100:00100000:2.0:1788530213.958217:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530213.958227:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37376300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555799168:0@lo:400:kworker.0 00000100:00100000:2.0:1788530213.958244:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530213.958288:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555798528 00000100:00100000:2.0:1788530213.958292:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555798528 00000100:00100000:2.0:1788530213.958320:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555798144 00000100:00100000:2.0:1788530213.958323:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555798144 00000100:00100000:2.0:1788530213.958334:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555798656 00000100:00100000:2.0:1788530213.958336:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555798656 00000100:00100000:2.0:1788530213.958349:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1788530213.958355:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37375880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875409555798272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530213.958385:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37375880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875409555798272:12345-0@lo:400:kworker.0 Request processed in 30us (974us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530213.958391:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1788530213.958404:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1788530213.958410:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37375c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875409555798784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530213.958433:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37375c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875409555798784:12345-0@lo:400:kworker.0 Request processed in 24us (985us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530213.958439:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1788530213.958449:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1788530213.958454:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d25bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875409555798528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530213.958484:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d25bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875409555798528:12345-0@lo:400:kworker.0 Request processed in 30us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530213.958489:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1788530213.958501:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1788530213.958506:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d258e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875409555798144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530213.958530:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d258e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875409555798144:12345-0@lo:400:kworker.0 Request processed in 24us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530213.958536:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1788530213.958546:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1788530213.958552:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d25aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875409555798656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530213.958615:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d25aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875409555798656:12345-0@lo:400:kworker.0 Request processed in 63us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530213.958620:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1788530213.958639:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555798016 00000100:00100000:2.0:1788530213.958643:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555798016 00000100:00100000:2.0:1788530213.958667:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:2.0:1788530213.958672:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:3647:x1875409555798016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530213.958699:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:3647:x1875409555798016:12345-0@lo:400:kworker.0 Request processed in 27us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530213.958705:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:2.0:1788530213.958731:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555799040 00000100:00100000:2.0:1788530213.958734:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555799040 00000100:00100000:2.0:1788530213.958757:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555799168 00000100:00100000:2.0:1788530213.958760:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555799168 00000100:00100000:2.0:1788530213.958779:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788530213.958785:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d25ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555799040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530213.958813:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d25ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555799040:12345-0@lo:400:kworker.0 Request processed in 28us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530213.958818:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788530213.958839:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788530213.958845:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d259c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555799168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530213.958870:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d259c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555799168:12345-0@lo:400:kworker.0 Request processed in 26us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530213.958876:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788530213.958915:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37376d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875409555798144:0@lo:400:kworker.0 00010000:00080000:2.0:1788530213.958929:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f37375180 x1875409555798656/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530213.958946:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37375180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875409555798656:0@lo:400:kworker.0 00010000:00080000:2.0:1788530213.958958:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f37376300 x1875409555799168/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788530229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530213.958966:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37376300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555799168:0@lo:400:kworker.0 00000100:00100000:2.0:1788530213.958975:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37376a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3647:1875409555798016:0@lo:400:kworker.0 00000100:00100000:2.0:1788530213.958984:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37376680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875409555798528:0@lo:400:kworker.0 00010000:00080000:2.0:1788530213.958992:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f37377b80 x1875409555799040/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788530229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530213.958999:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37377b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555799040:0@lo:400:kworker.0 00000100:00100000:2.0:1788530213.959074:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37377100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875409555798272:0@lo:400:kworker.0 00000100:00100000:2.0:1788530213.959085:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37374380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875409555798784:0@lo:400:kworker.0 00000100:00100000:2.0:1788530213.959094:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37374a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555798400:0@lo:400:kworker.0 00010000:00080000:2.0:1788530213.959105:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f37377800 x1875409555798912/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530213.959113:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37377800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875409555798912:0@lo:400:kworker.0 00000100:00080000:2.0:1788530213.959155:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788530213.959159:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788530213.959162:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788530213.967734:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32a54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555799424:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788530213.967813:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530213.967897:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788530213.967907:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37377800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555799296:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788530213.967933:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530213.967976:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555799424 00000100:00100000:2.0:1788530213.967987:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555799424 00000100:00100000:2.0:1788530213.968040:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555799296 00000100:00100000:2.0:1788530213.968043:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555799296 00000100:00100000:2.0:1788530213.968060:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788530213.968069:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37409f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555799424:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788530213.968108:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788530213.968156:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37409f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555799424:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530213.968165:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788530213.968184:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788530213.968191:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3740ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555799296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788530213.968201:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788530213.968223:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3740ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555799296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 34us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530213.968229:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00010000:00080000:2.0:1788530213.968272:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f37377800 x1875409555799296/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530229 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530213.968292:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37377800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555799296:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1788530213.968306:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f32a54e00 x1875409555799424/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530229 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530213.968316:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32a54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555799424:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788530214.097086:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788530214.895009:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530214.895098:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530214.895142:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530214.895163:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530214.895197:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530214.895423:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531587712 00000100:00100000:0.0:1788530214.895439:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531587712 00000100:00100000:0.0:1788530214.895516:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 360 00000100:00100000:0.0:1788530214.895527:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f442bcd-b742-4e76-ad7b-709f731358a0+14:2399:x1875409531587712:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1788530214.895698:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f442bcd-b742-4e76-ad7b-709f731358a0+14:2399:x1875409531587712:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 172us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530214.895708:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 360 00000100:00100000:2.0:1788530214.896403:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531587968 00000100:00100000:2.0:1788530214.896424:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531587968 00000100:00100000:2.0:1788530214.896509:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531588224 00000100:00100000:2.0:1788530214.896513:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531588224 00000100:00100000:2.0:1788530214.896532:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531587840 00000100:00100000:2.0:1788530214.896535:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531587840 00000100:00100000:2.0:1788530214.896555:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531588096 00000100:00100000:2.0:1788530214.896597:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531588096 00000100:00100000:2.0:1788530214.896635:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 221 00000100:00100000:2.0:1788530214.896644:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03359880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2399:x1875409531587968:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1788530214.896701:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03359880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2399:x1875409531587968:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 58us (1602us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530214.896708:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 221 00000100:00100000:2.0:1788530214.896724:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 222 00000100:00100000:2.0:1788530214.896731:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0335a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2399:x1875409531588224:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1788530214.896755:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0335a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2399:x1875409531588224:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 25us (1613us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530214.896761:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 222 00000100:00100000:2.0:1788530214.896772:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 223 00000100:00100000:2.0:1788530214.896779:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0335ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:2399:x1875409531587840:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1788530214.896802:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0335ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:2399:x1875409531587840:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 24us (1638us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530214.896809:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 223 00000100:00100000:2.0:1788530214.896819:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 224 00000100:00100000:2.0:1788530214.896825:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03358a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2399:x1875409531588096:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1788530214.896849:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03358a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2399:x1875409531588096:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 25us (1652us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530214.896861:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 224 00000100:00080000:0.0:1788530214.898188:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788530214.898203:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788530214.978372:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788530214.978408:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37409180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555799552:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788530214.978524:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530214.978716:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555799552 00000100:00100000:1.0:1788530214.978727:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555799552 00000100:00100000:1.0:1788530214.978780:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788530214.978790:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03358380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555799552:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788530214.978826:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446453248 avail 1300213760 00000100:00100000:1.0:1788530214.978887:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03358380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555799552:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530214.978895:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788530214.980507:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37409180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555799552:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788530215.105452:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530216.131833:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788530216.623694:0:13054:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1788530217.153115:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530218.176760:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788530218.563688:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0335b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555799680:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788530218.563786:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530218.563892:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555799680 00000100:00100000:0.0:1788530218.563900:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555799680 00000100:00100000:0.0:1788530218.563969:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788530218.563978:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555799680:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788530218.564011:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788530218.564057:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555799680:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530218.564071:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788530218.564115:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0335b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555799680:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788530219.072938:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03359500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555799808:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788530219.073141:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530219.073713:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555799808 00000100:00100000:3.0:1788530219.073723:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555799808 00000100:00100000:3.0:1788530219.073807:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788530219.073861:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555799808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788530219.073909:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788530219.073965:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555799808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (825us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530219.073973:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00010000:00080000:3.0:1788530219.074038:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e03359500 x1875409555799808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530235 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530219.074059:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03359500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555799808:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788530219.074619:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788530219.076696:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37374a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3650:1875409555799936:0@lo:400:kworker.0 00000100:00100000:1.0:1788530219.076799:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530219.076848:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37376680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875409555800448:0@lo:400:kworker.0 00000100:00100000:1.0:1788530219.076880:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530219.076905:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37376d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875409555800960:0@lo:400:kworker.0 00000100:00100000:1.0:1788530219.076927:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530219.076955:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37364700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555801472:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788530219.076980:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530219.077009:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788530219.077016:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37377b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555800320:0@lo:400:kworker.0 00000100:00100000:1.0:1788530219.077062:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530219.077084:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37375180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875409555800832:0@lo:400:kworker.0 00000100:00100000:1.0:1788530219.077108:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530219.077127:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555801344:0@lo:400:kworker.0 00000100:00100000:1.0:1788530219.077152:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530219.077184:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37374380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875409555800064:0@lo:400:kworker.0 00000100:00100000:1.0:1788530219.077209:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530219.077238:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37376a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875409555800576:0@lo:400:kworker.0 00000100:00100000:1.0:1788530219.077260:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530219.077277:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555801216:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788530219.077298:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530219.077316:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788530219.077321:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37377100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875409555800192:0@lo:400:kworker.0 00000100:00100000:1.0:1788530219.077341:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530219.077357:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37376300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555800704:0@lo:400:kworker.0 00000100:00100000:1.0:1788530219.077376:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530219.077393:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37377800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555801088:0@lo:400:kworker.0 00000100:00100000:1.0:1788530219.077411:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530219.077442:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555800448 00000100:00100000:3.0:1788530219.078817:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03359500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555801600:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788530219.078896:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530219.078969:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555801472 00000100:00100000:3.0:1788530219.078979:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555801472 00000100:00100000:3.0:1788530219.079069:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555801216 00000100:00100000:3.0:1788530219.079072:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555801216 00000100:00100000:3.0:1788530219.079087:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555801600 00000100:00100000:3.0:1788530219.079105:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555801600 00000100:00100000:3.0:1788530219.079126:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788530219.079136:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37364380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555801472:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788530219.079171:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788530219.079228:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37364380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555801472:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (2246us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530219.079235:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788530219.079266:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788530219.079273:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37365180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555801216:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788530219.079290:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788530219.079333:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37365180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555801216:12345-0@lo:13:osp-pre-1-1.0 Request processed in 60us (2033us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530219.079339:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788530219.079351:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788530219.079357:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0335b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555801600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788530219.079366:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788530219.079387:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0335b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555801600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 31us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530219.079392:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:3.0:1788530219.079409:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788530219.079413:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788530219.079446:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e03359500 x1875409555801600/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530235 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530219.079467:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03359500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555801600:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1788530219.079482:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e027d8700 x1875409555801216/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530235 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530219.079505:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555801216:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1788530219.079556:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f37364700 x1875409555801472/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530235 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530219.079595:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37364700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555801472:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788530219.080126:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555799936 00000100:00100000:0.0:1788530219.080133:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555799936 00000100:00100000:0.0:1788530219.080219:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:0.0:1788530219.080228:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:3650:x1875409555799936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530219.080291:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:3650:x1875409555799936:12345-0@lo:400:kworker.0 Request processed in 64us (3492us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530219.080298:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:1.0:1788530219.084806:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555800448 00000100:00100000:1.0:1788530219.084919:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555800960 00000100:00100000:1.0:1788530219.084922:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555800960 00000100:00100000:1.0:1788530219.084938:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555800832 00000100:00100000:1.0:1788530219.084940:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555800832 00000100:00100000:1.0:1788530219.084952:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555800064 00000100:00100000:1.0:1788530219.084954:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555800064 00000100:00100000:1.0:1788530219.084979:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555800576 00000100:00100000:1.0:1788530219.084981:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555800576 00000100:00100000:1.0:1788530219.084991:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555800192 00000100:00100000:1.0:1788530219.084993:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555800192 00000100:00100000:1.0:1788530219.085009:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1788530219.085020:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37366a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875409555800448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530219.085136:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37366a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875409555800448:12345-0@lo:400:kworker.0 Request processed in 117us (8255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530219.085145:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1788530219.085164:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1788530219.085169:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37365500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875409555800960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530219.085193:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37365500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875409555800960:12345-0@lo:400:kworker.0 Request processed in 24us (8265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530219.085199:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1788530219.085208:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1788530219.085213:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37367480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875409555800832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530219.085233:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37367480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875409555800832:12345-0@lo:400:kworker.0 Request processed in 20us (8125us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530219.085240:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1788530219.085250:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1788530219.085255:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37366300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875409555800064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530219.085304:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37366300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875409555800064:12345-0@lo:400:kworker.0 Request processed in 48us (8094us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530219.085520:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37374380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875409555800064:0@lo:400:kworker.0 00000100:00100000:3.0:1788530219.085583:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37375180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875409555800832:0@lo:400:kworker.0 00000100:00100000:3.0:1788530219.085598:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37374a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3650:1875409555799936:0@lo:400:kworker.0 00000100:00100000:3.0:1788530219.085612:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37376680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875409555800448:0@lo:400:kworker.0 00010000:00080000:3.0:1788530219.085627:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f37376d80 x1875409555800960/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530235 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530219.085638:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37376d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875409555800960:0@lo:400:kworker.0 00000100:00080000:2.0:1788530219.088608:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788530219.088625:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788530219.091011:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1788530219.091083:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1788530219.091108:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37367100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875409555800576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530219.091309:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37367100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875409555800576:12345-0@lo:400:kworker.0 Request processed in 216us (14046us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530219.091316:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1788530219.091331:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1788530219.091338:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37366680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875409555800192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530219.091366:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37366680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875409555800192:12345-0@lo:400:kworker.0 Request processed in 30us (14025us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530219.091372:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1788530219.091409:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555800320 00000100:00100000:1.0:1788530219.091420:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555800320 00000100:00100000:1.0:1788530219.091474:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788530219.091481:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37364000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555800320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530219.091756:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37364000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555800320:12345-0@lo:400:kworker.0 Request processed in 275us (14692us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530219.091762:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788530219.091793:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555801344 00000100:00100000:1.0:1788530219.091797:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555801344 00000100:00100000:1.0:1788530219.091827:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555800704 00000100:00100000:1.0:1788530219.091830:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555800704 00000100:00100000:1.0:1788530219.091843:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555801088 00000100:00100000:1.0:1788530219.091846:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555801088 00000100:00100000:1.0:1788530219.091858:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788530219.091865:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37364a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555801344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530219.091919:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37364a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555801344:12345-0@lo:400:kworker.0 Request processed in 54us (14765us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530219.091926:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788530219.091938:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788530219.091951:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37364e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555800704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530219.091980:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37364e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555800704:12345-0@lo:400:kworker.0 Request processed in 31us (14604us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530219.091985:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788530219.091996:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788530219.092002:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d3f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555801088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530219.092025:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d3f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555801088:12345-0@lo:400:kworker.0 Request processed in 25us (14614us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530219.092030:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788530219.095486:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37377100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875409555800192:0@lo:400:kworker.0 00010000:00080000:3.0:1788530219.095526:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f37376300 x1875409555800704/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788530235 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530219.095539:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37376300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555800704:0@lo:400:kworker.0 00010000:00080000:3.0:1788530219.095555:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f37377800 x1875409555801088/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788530235 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530219.095589:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37377800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555801088:0@lo:400:kworker.0 00010000:00080000:3.0:1788530219.095603:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f37376a00 x1875409555800576/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530235 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530219.095631:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37376a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875409555800576:0@lo:400:kworker.0 00000100:00100000:3.0:1788530219.095684:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37377b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555800320:0@lo:400:kworker.0 00010000:00080000:3.0:1788530219.095697:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f3d2a1180 x1875409555801344/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788530235 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530219.095707:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555801344:0@lo:400:kworker.0 00010000:00010000:0.0:1788530219.215364:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788530220.007047:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530220.007097:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530220.007138:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530220.007168:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530220.007205:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530220.007251:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531588352 00000100:00100000:3.0:1788530220.007260:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531588352 00000100:00100000:3.0:1788530220.007324:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 362 00000100:00100000:3.0:1788530220.007338:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f442bcd-b742-4e76-ad7b-709f731358a0+14:2399:x1875409531588352:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1788530220.007416:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f442bcd-b742-4e76-ad7b-709f731358a0+14:2399:x1875409531588352:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 80us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530220.007427:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 362 00000100:00100000:1.0:1788530220.012119:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531588480 00000100:00100000:1.0:1788530220.012134:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531588480 00000100:00100000:1.0:1788530220.012211:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531588736 00000100:00100000:1.0:1788530220.012215:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531588736 00000100:00100000:1.0:1788530220.012697:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531588608 00000100:00100000:1.0:1788530220.012702:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531588608 00000100:00100000:1.0:1788530220.012720:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531588864 00000100:00100000:1.0:1788530220.012723:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531588864 00000100:00100000:1.0:1788530220.012744:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 231 00000100:00100000:1.0:1788530220.012755:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03359500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:2399:x1875409531588480:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1788530220.012853:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03359500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:2399:x1875409531588480:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 99us (5817us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530220.012862:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 231 00000100:00100000:1.0:1788530220.012886:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 232 00000100:00100000:1.0:1788530220.012893:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2399:x1875409531588736:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1788530220.012919:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2399:x1875409531588736:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 26us (5825us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530220.012943:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 232 00000100:00100000:1.0:1788530220.012957:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 233 00000100:00100000:1.0:1788530220.012963:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37377b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2399:x1875409531588608:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1788530220.012989:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37377b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2399:x1875409531588608:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 26us (5823us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530220.012995:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 233 00000100:00100000:1.0:1788530220.013006:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 234 00000100:00100000:1.0:1788530220.013013:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37376a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2399:x1875409531588864:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1788530220.013036:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37376a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2399:x1875409531588864:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 24us (5834us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530220.013042:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 234 00000100:00080000:1.0:1788530220.013078:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788530220.013083:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788530220.096910:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37409180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555801728:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788530220.096993:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530220.097172:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555801728 00000100:00100000:0.0:1788530220.097183:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555801728 00000100:00100000:0.0:1788530220.097260:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788530220.097282:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d3fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555801728:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788530220.097342:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446453248 avail 1300213760 00000100:00100000:0.0:1788530220.097422:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d3fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555801728:12345-0@lo:41:osp-pre-1-0.0 Request processed in 150us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530220.097431:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788530220.097892:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37409180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555801728:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788530220.227696:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530221.253907:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530222.276544:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788530222.509601:0:13202:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffea98d86e0 20000000:00000080:1.0:1788530222.509622:0:13202:0:(mgs_handler.c:1172:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a9e037e0400 uarg=0000000000000000 20000000:01000000:1.0:1788530222.509666:0:13202:0:(mgs_llog.c:6198:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788530222.509672:0:13202:0:(mgs_llog.c:4653:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788530222.509677:0:13202:0:(mgs_llog.c:1385:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788530222.520766:0:13203:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1788530222.520939:0:13202:0:(mgs_llog.c:1456:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788530222.540694:0:13202:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788530222.558596:0:13202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a9f18140a00/0xb28d70e12575068d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530222.558622:0:13202:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a9f18141800/0xb28d70e12575061d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125750616 expref: 28 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530222.558630:0:13202:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a9e025dc800/0xb28d70e12575062b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125750624 expref: 28 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530222.558638:0:13202:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a9e025dde00/0xb28d70e125750639 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125750632 expref: 28 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530222.558644:0:13202:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a9e025dd600/0xb28d70e125750647 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125750640 expref: 28 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530222.558654:0:13202:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a9f18140e00/0xb28d70e12575064e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a55076f expref: 13 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530222.558661:0:13202:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a9f42166000/0xb28d70e12575066a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5507b5 expref: 13 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530222.558669:0:13202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a9f18140a00/0xb28d70e12575068d lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530222.558722:0:13202:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a9f42166000/0xb28d70e12575066a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a5507b5 expref: 13 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530222.558770:0:13202:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a9f42166000/0xb28d70e12575066a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a5507b5 expref: 13 pid: 6516 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530222.558787:0:13202:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37409180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13202:1875409555801856:192.168.202.41@tcp:104: 00010000:00010000:2.0:1788530222.558898:0:13202:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a9f18140e00/0xb28d70e12575064e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a55076f expref: 13 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530222.558907:0:13202:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a9f18140e00/0xb28d70e12575064e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a55076f expref: 13 pid: 6517 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530222.558916:0:13202:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32a54e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13202:1875409555801984:192.168.202.41@tcp:104: 00010000:00010000:2.0:1788530222.558947:0:13202:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a9e025dd600/0xb28d70e125750647 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb28d70e125750640 expref: 28 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530222.558955:0:13202:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a9e025dd600/0xb28d70e125750647 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb28d70e125750640 expref: 28 pid: 6517 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530222.558963:0:13202:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0231fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13202:1875409555802112:0@lo:104: 00000100:00100000:2.0:1788530222.559003:0:13202:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788530222.559038:0:13202:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a9e025dde00/0xb28d70e125750639 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb28d70e125750632 expref: 28 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530222.559046:0:13202:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a9e025dde00/0xb28d70e125750639 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb28d70e125750632 expref: 28 pid: 6516 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530222.559054:0:13202:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0231e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13202:1875409555802240:0@lo:104: 00000100:00100000:2.0:1788530222.559074:0:13202:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788530222.559104:0:13202:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a9e025dc800/0xb28d70e12575062b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb28d70e125750624 expref: 28 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530222.559112:0:13202:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a9e025dc800/0xb28d70e12575062b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb28d70e125750624 expref: 28 pid: 6518 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530222.559121:0:13202:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0231dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13202:1875409555802368:0@lo:104: 00000100:00100000:2.0:1788530222.559146:0:13202:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530222.559197:0:6507:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788530222.559210:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555802112 00000100:00100000:2.0:1788530222.559217:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555802112 00000100:00100000:2.0:1788530222.559267:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555802240 00000100:00100000:2.0:1788530222.559271:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555802240 00000100:00100000:0.0:1788530222.559506:0:9537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555802368 00000100:00100000:0.0:1788530222.559511:0:9537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555802368 00000100:00100000:0.0:1788530222.559540:0:9537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788530222.559550:0:9537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0231d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+5:13202:x1875409555802112:12345-0@lo:104: 00010000:00010000:0.0:1788530222.559579:0:9537:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff9a9e025dcc00/0xb28d70e125750640 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e125750647 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530222.559630:0:9537:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788530222.559636:0:9537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0231d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+5:13202:x1875409555802112:12345-0@lo:104: Request processed in 88us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530222.559643:0:9537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788530222.559661:0:9537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788530222.559667:0:9537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f2c0ff450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+4:13202:x1875409555802368:12345-0@lo:104: 00010000:00010000:0.0:1788530222.559675:0:9537:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff9a9e025dc600/0xb28d70e125750624 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e12575062b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530222.559706:0:9537:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788530222.559712:0:9537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f2c0ff450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+4:13202:x1875409555802368:12345-0@lo:104: Request processed in 46us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530222.559718:0:9537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00010000:0.0:1788530222.559739:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788530222.559745:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9e025dcc00/0xb28d70e125750640 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e125750647 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530222.559753:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9e025dcc00 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:0.0:1788530222.559757:0:6512:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9e025dcc00/0xb28d70e125750640 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xb28d70e125750647 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530222.559767:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9e025dcc00/0xb28d70e125750640 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xb28d70e125750647 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788530222.559785:0:6512:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9e025dcc00/0xb28d70e125750640 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xb28d70e125750647 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788530222.559791:0:6512:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788530222.559821:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9e025dcc00/0xb28d70e125750640 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125750647 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530222.559828:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788530222.559845:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9e025dcc00/0xb28d70e125750640 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125750647 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530222.559852:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9e025dcc00/0xb28d70e125750640 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125750647 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530222.559864:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788530222.559868:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9e025dc600/0xb28d70e125750624 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e12575062b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530222.559873:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9e025dc600 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:0.0:1788530222.559875:0:6512:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9e025dc600/0xb28d70e125750624 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb28d70e12575062b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530222.559882:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9e025dc600/0xb28d70e125750624 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb28d70e12575062b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788530222.559888:0:6512:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9e025dc600/0xb28d70e125750624 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb28d70e12575062b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788530222.559893:0:6512:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788530222.559913:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9e025dc600/0xb28d70e125750624 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e12575062b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530222.559920:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788530222.559927:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9e025dc600/0xb28d70e125750624 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e12575062b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530222.559933:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9e025dc600/0xb28d70e125750624 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e12575062b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530222.559943:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530222.559944:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530222.559946:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530222.559953:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788530222.560299:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3650:1875409555802624:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788530222.560334:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530222.560375:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788530222.560382:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3650:1875409555802496:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788530222.560403:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530222.560437:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555802624 00000100:00100000:3.0:1788530222.560441:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555802624 00010000:00010000:3.0:1788530222.560461:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a9e025dc800/0xb28d70e12575062b lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e125750624 expref: 29 pid: 6518 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530222.560492:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555802496 00000100:00100000:3.0:1788530222.560495:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555802496 00010000:00010000:3.0:1788530222.560506:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a9e025dd600/0xb28d70e125750647 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e125750640 expref: 30 pid: 6517 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530222.560520:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788530222.560526:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37377800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+30:3650:x1875409555802624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788530222.560535:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788530222.560540:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a9e025dc800/0xb28d70e12575062b lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e125750624 expref: 30 pid: 6518 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530222.560548:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a9e025dc800/0xb28d70e12575062b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb28d70e125750624 expref: 30 pid: 6518 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530222.560587:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788530222.560614:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37377800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+30:3650:x1875409555802624:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530222.560620:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788530222.560633:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788530222.560639:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37376300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:3650:x1875409555802496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788530222.560645:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788530222.560649:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a9e025dd600/0xb28d70e125750647 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e125750640 expref: 29 pid: 6517 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530222.560657:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a9e025dd600/0xb28d70e125750647 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb28d70e125750640 expref: 29 pid: 6517 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530222.560672:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788530222.560695:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37376300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:3650:x1875409555802496:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530222.560700:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788530222.560737:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3650:1875409555802496:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788530222.560758:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3650:1875409555802624:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788530222.560890:0:13202:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a9f18141800/0xb28d70e12575061d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb28d70e125750616 expref: 28 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530222.560900:0:13202:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a9f18141800/0xb28d70e12575061d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb28d70e125750616 expref: 28 pid: 6517 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530222.560909:0:13202:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37377100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13202:1875409555802752:0@lo:104: 00000100:00100000:3.0:1788530222.560933:0:13202:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530222.560949:0:13202:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e0335d9c0 going to sleep for 11 seconds 00010000:00010000:3.0:1788530222.560965:0:13202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9e025dd600/0xb28d70e125750647 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb28d70e125750640 expref: 28 pid: 6517 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530222.560978:0:13202:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0231fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13202:1875409555802112:0@lo:104: 00010000:00010000:3.0:1788530222.560987:0:13202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9e025dc800/0xb28d70e12575062b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb28d70e125750624 expref: 27 pid: 6518 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530222.560994:0:13202:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0231dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13202:1875409555802368:0@lo:104: 00000100:00100000:1.0:1788530222.561438:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555802752 00000100:00100000:1.0:1788530222.561464:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555802752 00000100:00100000:1.0:1788530222.561514:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788530222.561522:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37376d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+4:13202:x1875409555802752:12345-0@lo:104: 00010000:00010000:1.0:1788530222.561533:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b800/0xb28d70e125750616 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e12575061d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530222.561601:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788530222.561607:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37376d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+4:13202:x1875409555802752:12345-0@lo:104: Request processed in 87us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530222.561613:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00010000:1.0:1788530222.561636:0:10348:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788530222.561641:0:10348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b800/0xb28d70e125750616 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e12575061d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530222.561647:0:10348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d36b800 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:1.0:1788530222.561651:0:10348:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b800/0xb28d70e125750616 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb28d70e12575061d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530222.561658:0:10348:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b800/0xb28d70e125750616 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb28d70e12575061d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788530222.561665:0:10348:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b800/0xb28d70e125750616 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb28d70e12575061d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788530222.561670:0:10348:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788530222.561695:0:10348:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b800/0xb28d70e125750616 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e12575061d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530222.561701:0:10348:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788530222.561718:0:10348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b800/0xb28d70e125750616 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e12575061d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530222.561731:0:10348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b800/0xb28d70e125750616 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e12575061d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530222.561754:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530222.561757:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530222.561759:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788530222.561774:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d3fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3647:1875409555802880:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788530222.561812:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530222.561860:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555802880 00000100:00100000:1.0:1788530222.561865:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555802880 00010000:00010000:1.0:1788530222.561879:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a9f18141800/0xb28d70e12575061d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e125750616 expref: 27 pid: 6517 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530222.561899:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788530222.561906:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d3fb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+27:3647:x1875409555802880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788530222.561914:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788530222.561918:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a9f18141800/0xb28d70e12575061d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e125750616 expref: 27 pid: 6517 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530222.561926:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a9f18141800/0xb28d70e12575061d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb28d70e125750616 expref: 27 pid: 6517 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530222.561938:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788530222.561965:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d3fb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+27:3647:x1875409555802880:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530222.561971:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788530222.562001:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d3fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3647:1875409555802880:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788530222.563425:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788530222.563447:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0231c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+3:13202:x1875409555802240:12345-0@lo:104: 00010000:00010000:2.0:1788530222.563472:0:6507:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff9a9e025dce00/0xb28d70e125750632 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e125750639 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530222.563602:0:6507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788530222.563608:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0231c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+3:13202:x1875409555802240:12345-0@lo:104: Request processed in 172us (4533us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530222.563617:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00010000:1.0:1788530222.563795:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788530222.563806:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9e025dce00/0xb28d70e125750632 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e125750639 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530222.563815:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9e025dce00 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:1.0:1788530222.563820:0:6512:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9e025dce00/0xb28d70e125750632 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb28d70e125750639 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530222.563830:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9e025dce00/0xb28d70e125750632 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb28d70e125750639 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788530222.563839:0:6512:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9e025dce00/0xb28d70e125750632 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb28d70e125750639 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788530222.563844:0:6512:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788530222.563891:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9e025dce00/0xb28d70e125750632 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125750639 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530222.563897:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788530222.563916:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9e025dce00/0xb28d70e125750632 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125750639 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530222.563923:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9e025dce00/0xb28d70e125750632 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125750639 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530222.563942:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530222.563944:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530222.563945:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788530222.563961:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d3fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3648:1875409555803008:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788530222.564004:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530222.564087:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555803008 00000100:00100000:1.0:1788530222.564097:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555803008 00010000:00010000:1.0:1788530222.564133:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a9e025dde00/0xb28d70e125750639 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e125750632 expref: 27 pid: 6516 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530222.564161:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788530222.564167:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d3fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+27:3648:x1875409555803008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788530222.564180:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788530222.564185:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a9e025dde00/0xb28d70e125750639 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e125750632 expref: 27 pid: 6516 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530222.564195:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a9e025dde00/0xb28d70e125750639 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb28d70e125750632 expref: 27 pid: 6516 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530222.564214:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788530222.564241:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d3fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+27:3648:x1875409555803008:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530222.564248:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788530222.564396:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d3fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3648:1875409555803008:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788530222.571139:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530222.571183:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530222.571213:0:10347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531588992 00000100:00100000:1.0:1788530222.571221:0:10347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531588992 00010000:00010000:1.0:1788530222.571285:0:10347:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a9f42166000/0xb28d70e12575066a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a5507b5 expref: 14 pid: 6516 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530222.571314:0:10347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531589120 00000100:00100000:1.0:1788530222.571317:0:10347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531589120 00010000:00010000:1.0:1788530222.571329:0:10347:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a9f18140e00/0xb28d70e12575064e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a55076f expref: 15 pid: 6517 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530222.571369:0:10347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 53 00000100:00100000:1.0:1788530222.571379:0:10347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d3fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f442bcd-b742-4e76-ad7b-709f731358a0+15:2399:x1875409531588992:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788530222.571395:0:10347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788530222.571400:0:10347:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a9f42166000/0xb28d70e12575066a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a5507b5 expref: 15 pid: 6516 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530222.571412:0:10347:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a9f42166000/0xb28d70e12575066a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a5507b5 expref: 15 pid: 6516 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530222.571433:0:10347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788530222.571493:0:10347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d3fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f442bcd-b742-4e76-ad7b-709f731358a0+15:2399:x1875409531588992:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 115us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530222.571501:0:10347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 53 00000100:00100000:1.0:1788530222.571521:0:10347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 54 00000100:00100000:1.0:1788530222.571528:0:10347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d3f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f442bcd-b742-4e76-ad7b-709f731358a0+14:2399:x1875409531589120:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788530222.571536:0:10347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788530222.571541:0:10347:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a9f18140e00/0xb28d70e12575064e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a55076f expref: 14 pid: 6517 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530222.571550:0:10347:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a9f18140e00/0xb28d70e12575064e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a55076f expref: 14 pid: 6517 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530222.571583:0:10347:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a9f18140a00/0xb28d70e12575068d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530222.571592:0:10347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f18140a00/0xb28d70e12575068d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530222.571615:0:10347:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a9f18140a00/0xb28d70e12575068d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530222.571622:0:10347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a9f18140a00/0xb28d70e12575068d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530222.571630:0:10347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a9f18140a00/0xb28d70e12575068d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530222.571637:0:10347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a9f18140a00/0xb28d70e12575068d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530222.571644:0:10347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f18140a00 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:1.0:1788530222.571648:0:10347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a9f18140a00/0xb28d70e12575068d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530222.571656:0:10347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a9f18140a00/0xb28d70e12575068d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530222.571665:0:10347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a9f18140a00/0xb28d70e12575068d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530222.571674:0:10347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788530222.571696:0:10347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d3f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f442bcd-b742-4e76-ad7b-709f731358a0+14:2399:x1875409531589120:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 168us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530222.571703:0:10347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 54 00010000:00010000:3.0:1788530222.584445:0:13202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f42166000/0xb28d70e12575066a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a5507b5 expref: 13 pid: 6516 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530222.584468:0:13202:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37409180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13202:1875409555801856:192.168.202.41@tcp:104: 00010000:00010000:3.0:1788530222.584513:0:13202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f18140e00/0xb28d70e12575064e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a55076f expref: 12 pid: 6517 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530222.584524:0:13202:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32a54e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13202:1875409555801984:192.168.202.41@tcp:104: 00010000:00010000:3.0:1788530222.584538:0:13202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9e025dde00/0xb28d70e125750639 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb28d70e125750632 expref: 26 pid: 6516 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530222.584547:0:13202:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0231e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13202:1875409555802240:0@lo:104: 00010000:00010000:3.0:1788530222.584586:0:13202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f18141800/0xb28d70e12575061d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb28d70e125750616 expref: 25 pid: 6517 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530222.584596:0:13202:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37377100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13202:1875409555802752:0@lo:104: 00010000:00010000:3.0:1788530222.584629:0:13202:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a9f18140a00/0xb28d70e12575068d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530222.584640:0:13202:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a9f18140a00/0xb28d70e12575068d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530222.584646:0:13202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a9f18140a00/0xb28d70e12575068d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530222.584652:0:13202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f18140a00/0xb28d70e12575068d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530223.300198:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788530223.680852:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37377100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555803136:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788530223.680945:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530223.681082:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555803136 00000100:00100000:0.0:1788530223.681093:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555803136 00000100:00100000:0.0:1788530223.681159:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788530223.681178:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d3f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555803136:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788530223.681216:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788530223.691070:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d3f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555803136:12345-0@lo:41:osp-pre-0-1.0 Request processed in 9885us (10109us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530223.691088:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788530223.692927:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37377100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555803136:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788530223.731113:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530223.731395:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531589248 00000100:00100000:3.0:1788530223.731410:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531589248 00000100:00100000:3.0:1788530223.731509:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 363 00000100:00100000:3.0:1788530223.731526:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f442bcd-b742-4e76-ad7b-709f731358a0+12:6178:x1875409531589248:12345-192.168.202.41@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788530223.731552:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788530223.731653:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9e025dde00/0xb28d70e125750694 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1406819a5507e6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530223.731689:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9e025dde00/0xb28d70e125750694 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5507e6 expref: 13 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530223.731704:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9e025dde00/0xb28d70e125750694 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5507e6 expref: 13 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530223.731716:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9e025dde00, rc 0) 00000100:00100000:3.0:1788530223.731778:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f442bcd-b742-4e76-ad7b-709f731358a0+13:6178:x1875409531589248:12345-192.168.202.41@tcp:101:ll_cfg_requeue.0 Request processed in 257us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530223.731785:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 363 00000100:00100000:1.0:1788530223.742843:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530223.750103:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531589376 00000100:00100000:3.0:1788530223.750138:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531589376 00000100:00100000:2.0:1788530223.750773:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 364 00000100:00100000:2.0:1788530223.750785:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f442bcd-b742-4e76-ad7b-709f731358a0+13:6178:x1875409531589376:12345-192.168.202.41@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788530223.750988:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f442bcd-b742-4e76-ad7b-709f731358a0+13:6178:x1875409531589376:12345-192.168.202.41@tcp:501:ll_cfg_requeue.0 Request processed in 204us (8160us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530223.750999:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 364 00000100:00100000:1.0:1788530223.758883:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530223.765652:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531589504 00000100:00100000:0.0:1788530223.765673:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531589504 00000100:00100000:0.0:1788530223.765896:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 365 00000100:00100000:0.0:1788530223.765910:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f442bcd-b742-4e76-ad7b-709f731358a0+13:6178:x1875409531589504:12345-192.168.202.41@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788530223.767739:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f442bcd-b742-4e76-ad7b-709f731358a0+13:6178:x1875409531589504:12345-192.168.202.41@tcp:503:ll_cfg_requeue.0 Request processed in 1810us (8844us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530223.767775:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 365 00000100:00100000:2.0:1788530223.808120:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530223.808626:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531589632 00000100:00100000:3.0:1788530223.808639:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531589632 00000100:00100000:3.0:1788530223.808739:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 366 00000100:00100000:3.0:1788530223.808752:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f442bcd-b742-4e76-ad7b-709f731358a0+13:6178:x1875409531589632:12345-192.168.202.41@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788530223.808778:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788530223.808805:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9e025dc800/0xb28d70e12575069b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1406819a5507ed expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530223.808847:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9e025dc800/0xb28d70e12575069b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5507ed expref: 14 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530223.808864:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9e025dc800/0xb28d70e12575069b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5507ed expref: 14 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530223.808874:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9e025dc800, rc 0) 00000100:00100000:3.0:1788530223.809111:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f442bcd-b742-4e76-ad7b-709f731358a0+14:6178:x1875409531589632:12345-192.168.202.41@tcp:101:ll_cfg_requeue.0 Request processed in 361us (1000us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530223.809120:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 366 00000100:00100000:1.0:1788530223.813826:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530223.813940:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531589760 00000100:00100000:0.0:1788530223.813952:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531589760 00000100:00100000:0.0:1788530223.814031:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 367 00000100:00100000:0.0:1788530223.814042:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f442bcd-b742-4e76-ad7b-709f731358a0+14:6178:x1875409531589760:12345-192.168.202.41@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788530223.814239:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f442bcd-b742-4e76-ad7b-709f731358a0+14:6178:x1875409531589760:12345-192.168.202.41@tcp:501:ll_cfg_requeue.0 Request processed in 198us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530223.814247:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 367 00000100:00100000:1.0:1788530223.824486:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530223.830080:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531589888 00000100:00100000:2.0:1788530223.830107:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531589888 00000100:00100000:2.0:1788530223.830209:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 368 00000100:00100000:2.0:1788530223.830221:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f442bcd-b742-4e76-ad7b-709f731358a0+14:6178:x1875409531589888:12345-192.168.202.41@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788530223.830389:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f442bcd-b742-4e76-ad7b-709f731358a0+14:6178:x1875409531589888:12345-192.168.202.41@tcp:503:ll_cfg_requeue.0 Request processed in 169us (5925us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530223.830398:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 368 00000100:00100000:3.0:1788530224.193355:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37376680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555803264:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788530224.193475:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530224.193601:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555803264 00000100:00100000:3.0:1788530224.193609:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555803264 00000100:00100000:3.0:1788530224.193673:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788530224.193683:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37374a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555803264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788530224.197817:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788530224.198018:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37374a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555803264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4323us (4530us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530224.198032:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00010000:00080000:3.0:1788530224.198162:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f37376680 x1875409555803264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530240 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530224.198200:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37376680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555803264:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788530224.199591:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788530224.199612:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0231d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555803392:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788530224.199682:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530224.199748:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788530224.200036:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555803520:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788530224.200075:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530224.200121:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555803392 00000100:00100000:1.0:1788530224.200129:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555803392 00000100:00100000:1.0:1788530224.200196:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555803520 00000100:00100000:1.0:1788530224.200200:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555803520 00000100:00100000:1.0:1788530224.200233:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788530224.200242:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d3f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555803392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788530224.200274:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788530224.200318:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d3f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555803392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530224.200325:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788530224.200345:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788530224.200351:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d3f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555803520:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788530224.200362:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788530224.200389:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d3f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555803520:12345-0@lo:13:osp-pre-1-1.0 Request processed in 38us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530224.200395:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:1.0:1788530224.200432:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788530224.200435:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788530224.200475:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e027d8e00 x1875409555803520/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530240 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530224.200497:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555803520:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1788530224.200510:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e0231d180 x1875409555803392/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530240 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530224.200521:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0231d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555803392:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788530224.200804:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d3f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555803648:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788530224.200840:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530224.200875:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555803648 00000100:00100000:1.0:1788530224.200880:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555803648 00000100:00100000:1.0:1788530224.200913:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788530224.200921:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d3fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555803648:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788530224.200935:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788530224.200969:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d3fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555803648:12345-0@lo:13:osp-pre-0-1.0 Request processed in 48us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530224.200976:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:1.0:1788530224.200990:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788530224.201011:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f3d3f8380 x1875409555803648/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530240 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530224.201026:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d3f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555803648:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788530224.204764:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37374380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555804032:0@lo:400:kworker.0 00000100:00100000:3.0:1788530224.204855:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530224.204890:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37364700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875409555804544:0@lo:400:kworker.0 00000100:00100000:3.0:1788530224.204913:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530224.204947:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788530224.204952:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37375180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875409555803904:0@lo:400:kworker.0 00000100:00100000:3.0:1788530224.204969:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530224.204981:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37409180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875409555804416:0@lo:400:kworker.0 00000100:00100000:3.0:1788530224.204999:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530224.205264:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555804032 00000100:00100000:2.0:1788530224.205273:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555804032 00000100:00100000:2.0:1788530224.205326:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788530224.205334:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37424380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555804032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530224.205399:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37424380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555804032:12345-0@lo:400:kworker.0 Request processed in 66us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530224.205407:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788530224.205431:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37376680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3650:1875409555803776:0@lo:400:kworker.0 00000100:00100000:2.0:1788530224.205470:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530224.205491:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32a54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555804288:0@lo:400:kworker.0 00000100:00100000:2.0:1788530224.205511:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530224.205524:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37424a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875409555804800:0@lo:400:kworker.0 00000100:00100000:2.0:1788530224.205539:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530224.205553:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788530224.205558:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37377100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875409555804160:0@lo:400:kworker.0 00000100:00100000:2.0:1788530224.205608:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530224.205624:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37424700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875409555804672:0@lo:400:kworker.0 00000100:00100000:2.0:1788530224.205640:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530224.205673:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555804544 00000100:00100000:2.0:1788530224.205677:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555804544 00000100:00100000:2.0:1788530224.205721:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555803904 00000100:00100000:2.0:1788530224.205734:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555803904 00000100:00100000:2.0:1788530224.205745:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555804416 00000100:00100000:2.0:1788530224.205748:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555804416 00000100:00100000:2.0:1788530224.205761:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555804800 00000100:00100000:2.0:1788530224.205763:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555804800 00000100:00100000:2.0:1788530224.205774:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555804160 00000100:00100000:2.0:1788530224.205776:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555804160 00000100:00100000:2.0:1788530224.205784:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555804672 00000100:00100000:2.0:1788530224.205786:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555804672 00000100:00100000:2.0:1788530224.205798:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1788530224.205803:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37427b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875409555804544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530224.205832:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37427b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875409555804544:12345-0@lo:400:kworker.0 Request processed in 29us (917us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530224.205837:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1788530224.205848:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1788530224.205853:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37427100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875409555803904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530224.205875:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37427100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875409555803904:12345-0@lo:400:kworker.0 Request processed in 22us (905us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530224.205880:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1788530224.205889:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1788530224.205894:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37425500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875409555804416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530224.205914:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37425500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875409555804416:12345-0@lo:400:kworker.0 Request processed in 20us (914us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530224.205920:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1788530224.205929:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1788530224.205934:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0231d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875409555804800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530224.205966:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0231d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875409555804800:12345-0@lo:400:kworker.0 Request processed in 32us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530224.205971:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1788530224.205981:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1788530224.205986:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0231f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875409555804160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530224.206006:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0231f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875409555804160:12345-0@lo:400:kworker.0 Request processed in 20us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530224.206012:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1788530224.206020:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1788530224.206025:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0231ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875409555804672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530224.206045:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0231ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875409555804672:12345-0@lo:400:kworker.0 Request processed in 20us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530224.206050:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00080000:2.0:1788530224.206070:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788530224.206073:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788530224.206079:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555804288 00000100:00100000:2.0:1788530224.206082:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555804288 00000100:00100000:2.0:1788530224.206095:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788530224.206100:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0231c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555804288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530224.206139:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0231c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555804288:12345-0@lo:400:kworker.0 Request processed in 38us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530224.206255:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788530224.206291:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37375180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875409555803904:0@lo:400:kworker.0 00000100:00100000:2.0:1788530224.206303:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37409180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875409555804416:0@lo:400:kworker.0 00000100:00100000:2.0:1788530224.206311:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37374380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555804032:0@lo:400:kworker.0 00010000:00080000:2.0:1788530224.206328:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f37364700 x1875409555804544/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530240 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530224.206338:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37364700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875409555804544:0@lo:400:kworker.0 00000100:00100000:2.0:1788530224.206367:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37377100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875409555804160:0@lo:400:kworker.0 00000100:00100000:2.0:1788530224.206375:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37424700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875409555804672:0@lo:400:kworker.0 00000100:00100000:2.0:1788530224.206383:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32a54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555804288:0@lo:400:kworker.0 00010000:00080000:2.0:1788530224.206392:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f37424a80 x1875409555804800/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530240 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530224.206400:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37424a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875409555804800:0@lo:400:kworker.0 00000100:00100000:3.0:1788530224.208024:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555803776 00000100:00100000:3.0:1788530224.208043:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555803776 00000100:00100000:3.0:1788530224.208138:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:3.0:1788530224.208389:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+25:3650:x1875409555803776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530224.208898:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+25:3650:x1875409555803776:12345-0@lo:400:kworker.0 Request processed in 515us (3435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530224.208907:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:0.0:1788530224.217013:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37376680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3650:1875409555803776:0@lo:400:kworker.0 00010000:00010000:1.0:1788530224.326955:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788530224.517928:0:6521:0:(mgc_request.c:715:do_requeue()) updating log params 10000000:01000000:3.0:1788530224.517937:0:6521:0:(mgc_request.c:2194:mgc_process_log()) Process log params-ffff9a9e01aa6000 from 7 10000000:01000000:3.0:1788530224.517943:0:6521:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788530224.518009:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9e025dd600/0xb28d70e1257506a2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530224.518020:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9e025dd600/0xb28d70e1257506a2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530224.518032:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9e025dd600/0xb28d70e1257506a2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530224.518057:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37426a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555804928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788530224.518136:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530224.518200:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e036390c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788530224.520985:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555804928 00000100:00100000:0.0:1788530224.521012:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555804928 00000100:00100000:0.0:1788530224.521134:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:0.0:1788530224.521150:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+25:6521:x1875409555804928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788530224.521189:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530224.521215:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f3d36b000/0xb28d70e1257506a9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e1257506a2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530224.521251:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f3d36b000/0xb28d70e1257506a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e1257506a2 expref: 26 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530224.521266:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f3d36b000/0xb28d70e1257506a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e1257506a2 expref: 26 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530224.521277:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d36b000, rc 0) 00000100:00100000:0.0:1788530224.521356:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+26:6521:x1875409555804928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 209us (3220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530224.521379:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:3.0:1788530224.522267:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37426a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555804928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788530224.522294:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9e025dd600/0xb28d70e1257506a2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257506a9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530224.522306:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9e025dd600/0xb28d70e1257506a2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e1257506a9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788530224.522492:0:6521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 7 00000040:00080000:3.0:1788530224.532255:0:6521:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788530224.532797:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1788530224.532860:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 112 off8528 00000040:00080000:3.0:1788530224.532893:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 224 off8752 00000040:00080000:3.0:1788530224.532934:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8976 00000040:00080000:3.0:1788530224.532949:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 112 off9088 00000040:00080000:3.0:1788530224.533000:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 224 off9312 00000040:00080000:3.0:1788530224.533007:0:6521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 6 count 7 00000100:00100000:3.0:1788530224.533239:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37426a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555805056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788530224.533325:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530224.533372:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e036390c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788530224.533406:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555805056 00000100:00100000:3.0:1788530224.533414:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555805056 00000100:00100000:3.0:1788530224.533480:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:3.0:1788530224.533494:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f396c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+26:6521:x1875409555805056:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788530224.533697:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f396c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+26:6521:x1875409555805056:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 189us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530224.533706:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:3.0:1788530224.533794:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37426a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555805056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788530224.533892:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37426a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555805184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788530224.533977:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530224.534001:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e036390c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788530224.534717:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555805184 00000100:00100000:0.0:1788530224.534727:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555805184 00000100:00100000:0.0:1788530224.534781:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:0.0:1788530224.534793:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f396c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+26:6521:x1875409555805184:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788530224.534946:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f396c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+26:6521:x1875409555805184:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 154us (967us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530224.534954:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:3.0:1788530224.536346:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37426a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555805184:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788530224.545556:0:6521:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788530224.546029:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37426a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555805312:0@lo:502:ll_cfg_requeue.0 00000100:00100000:3.0:1788530224.546151:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530224.546325:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e036390c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788530224.549166:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555805312 00000100:00100000:0.0:1788530224.549192:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555805312 00000100:00100000:0.0:1788530224.549287:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:0.0:1788530224.549300:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f396c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+26:6521:x1875409555805312:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:0.0:1788530224.550186:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f396c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+26:6521:x1875409555805312:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 886us (4032us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530224.550197:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:3.0:1788530224.558968:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37426a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555805312:0@lo:502:ll_cfg_requeue.0 00000040:00080000:3.0:1788530224.559203:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1788530224.559242:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 112 off8528 00000040:00080000:3.0:1788530224.559256:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 224 off8752 00000040:00080000:3.0:1788530224.559270:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8976 00000040:00080000:3.0:1788530224.559283:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 112 off9088 00000100:00100000:3.0:1788530224.559321:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37426a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555805440:0@lo:502:ll_cfg_requeue.0 00000100:00100000:3.0:1788530224.559392:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530224.559429:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e036390c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788530224.559964:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555805440 00000100:00100000:1.0:1788530224.559975:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555805440 00000100:00100000:1.0:1788530224.560044:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:1.0:1788530224.560055:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f396c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+26:6521:x1875409555805440:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788530224.560222:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f396c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+26:6521:x1875409555805440:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 169us (829us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530224.560230:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:3.0:1788530224.560534:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37426a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555805440:0@lo:502:ll_cfg_requeue.0 00000040:00080000:3.0:1788530224.560650:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 224 off9312 00000040:00080000:3.0:1788530224.560665:0:6521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 6 count 7 00000040:00080000:3.0:1788530224.567786:0:13222:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 64768 count 7 00000020:01000000:2.0:1788530224.574660:0:6521:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788530224.574689:0:6521:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788530224.574704:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9e025dd600/0xb28d70e1257506a2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257506a9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530224.574717:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9e025dd600/0xb28d70e1257506a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257506a9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788530224.574738:0:6521:0:(mgc_request.c:715:do_requeue()) updating log params 10000000:01000000:2.0:1788530224.574741:0:6521:0:(mgc_request.c:2194:mgc_process_log()) Process log params-ffff9a9f33b6f800 from 7 10000000:01000000:2.0:1788530224.574744:0:6521:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788530224.574805:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f18140e00/0xb28d70e1257506b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530224.574813:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f18140e00/0xb28d70e1257506b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530224.574850:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f18140e00/0xb28d70e1257506b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530224.574896:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0231d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555805568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788530224.574993:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530224.575040:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e0335dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788530224.575200:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555805568 00000100:00100000:0.0:1788530224.575210:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555805568 00000100:00100000:0.0:1788530224.575272:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:0.0:1788530224.575282:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f396c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+26:6521:x1875409555805568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788530224.575296:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530224.575310:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f3d36ac00/0xb28d70e1257506b7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e1257506b0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530224.575333:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f3d36ac00/0xb28d70e1257506b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e1257506b0 expref: 27 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530224.575343:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f3d36ac00/0xb28d70e1257506b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e1257506b0 expref: 27 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530224.575359:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d36ac00, rc 0) 00000100:00100000:0.0:1788530224.575414:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f396c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+27:6521:x1875409555805568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530224.575421:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:2.0:1788530224.577203:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0231d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555805568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788530224.577235:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f18140e00/0xb28d70e1257506b0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257506b7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530224.577250:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f18140e00/0xb28d70e1257506b0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e1257506b7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788530224.577443:0:6521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 7 count 7 00000040:00080000:2.0:1788530224.578158:0:6521:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788530224.578369:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:2.0:1788530224.578397:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:2.0:1788530224.578413:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:2.0:1788530224.578429:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:2.0:1788530224.578443:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:2.0:1788530224.579676:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:2.0:1788530224.579693:0:6521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 6 count 7 00000100:00100000:2.0:1788530224.581061:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0231d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555805696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788530224.581745:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530224.581907:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e0335dd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788530224.587341:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555805696 00000100:00100000:1.0:1788530224.587363:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555805696 00000100:00100000:0.0:1788530224.587573:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1788530224.587588:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f396c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+27:6521:x1875409555805696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788530224.587832:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f396c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+27:6521:x1875409555805696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 246us (6087us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530224.587841:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:3.0:1788530224.588100:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0231d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555805696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788530224.588171:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37426a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555805824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788530224.588232:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530224.588264:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555805824 00000100:00100000:2.0:1788530224.588270:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555805824 00000100:00100000:3.0:1788530224.588276:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e03639480 going to sleep for 11 seconds 00000100:00100000:2.0:1788530224.588313:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:2.0:1788530224.588330:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f396c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+27:6521:x1875409555805824:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788530224.588424:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f396c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+27:6521:x1875409555805824:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 96us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530224.588431:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:3.0:1788530224.588474:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37426a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555805824:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788530224.590004:0:6521:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788530224.590109:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555805952:0@lo:502:ll_cfg_requeue.0 00000100:00100000:0.0:1788530224.590185:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530224.590229:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e02768c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788530224.590531:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555805952 00000100:00100000:2.0:1788530224.590548:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555805952 00000100:00100000:2.0:1788530224.590634:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:2.0:1788530224.590646:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f396c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+27:6521:x1875409555805952:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:2.0:1788530224.590787:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f396c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+27:6521:x1875409555805952:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 143us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530224.590795:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:0.0:1788530224.591112:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555805952:0@lo:502:ll_cfg_requeue.0 00000040:00080000:0.0:1788530224.591469:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:0.0:1788530224.591502:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:0.0:1788530224.591520:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:0.0:1788530224.592055:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:0.0:1788530224.592079:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000100:00100000:0.0:1788530224.592195:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555806080:0@lo:502:ll_cfg_requeue.0 00000100:00100000:0.0:1788530224.592276:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530224.592315:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e02768c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788530224.592391:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555806080 00000100:00100000:2.0:1788530224.592398:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555806080 00000100:00100000:2.0:1788530224.592450:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:2.0:1788530224.592469:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f396c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+27:6521:x1875409555806080:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:2.0:1788530224.593361:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f396c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+27:6521:x1875409555806080:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 889us (1081us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530224.593371:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:0.0:1788530224.593497:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555806080:0@lo:502:ll_cfg_requeue.0 00000040:00080000:0.0:1788530224.593856:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:0.0:1788530224.594094:0:6521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 6 count 7 00000040:00080000:0.0:1788530224.598008:0:13223:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 64768 count 7 00000020:01000000:2.0:1788530224.598268:0:6521:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788530224.598288:0:6521:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788530224.598300:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f18140e00/0xb28d70e1257506b0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257506b7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530224.598313:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f18140e00/0xb28d70e1257506b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257506b7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788530224.598328:0:6521:0:(mgc_request.c:715:do_requeue()) updating log params 10000000:01000000:2.0:1788530224.598346:0:6521:0:(mgc_request.c:2194:mgc_process_log()) Process log params-ffff9a9f32bea000 from 7 10000000:01000000:2.0:1788530224.598349:0:6521:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788530224.598392:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f18141800/0xb28d70e1257506be lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530224.598400:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f18141800/0xb28d70e1257506be lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530224.598412:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f18141800/0xb28d70e1257506be lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530224.598442:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0231e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555806208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788530224.598531:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530224.598909:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e0335d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788530224.599023:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555806208 00000100:00100000:0.0:1788530224.599037:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555806208 00000100:00100000:0.0:1788530224.599213:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:0.0:1788530224.599227:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f396c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+27:6521:x1875409555806208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788530224.599247:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530224.599267:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f3d36ae00/0xb28d70e1257506c5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e1257506be expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530224.599295:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f3d36ae00/0xb28d70e1257506c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e1257506be expref: 28 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530224.599307:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f3d36ae00/0xb28d70e1257506c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e1257506be expref: 28 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530224.599316:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d36ae00, rc 0) 00000100:00100000:0.0:1788530224.599378:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f396c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+28:6521:x1875409555806208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 153us (846us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530224.599385:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:2.0:1788530224.599475:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0231e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555806208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788530224.599492:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f18141800/0xb28d70e1257506be lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257506c5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530224.599502:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f18141800/0xb28d70e1257506be lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e1257506c5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788530224.599688:0:6521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x16:0x0] index 7 count 7 00000040:00080000:2.0:1788530224.600212:0:6521:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788530224.600435:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].1, 224 off8416 00000040:00080000:2.0:1788530224.600473:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].2, 112 off8528 00000040:00080000:2.0:1788530224.600488:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].3, 224 off8752 00000040:00080000:2.0:1788530224.600502:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].4, 224 off8976 00000040:00080000:2.0:1788530224.600514:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].5, 112 off9088 00000040:00080000:2.0:1788530224.600529:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].6, 224 off9312 00000040:00080000:2.0:1788530224.600534:0:6521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x16:0x0] index 6 count 7 00000100:00100000:2.0:1788530224.601232:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0231e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555806336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788530224.601304:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530224.601371:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e0335d9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788530224.602074:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555806336 00000100:00100000:1.0:1788530224.602096:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555806336 00000100:00100000:1.0:1788530224.602164:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:1.0:1788530224.602176:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f396c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+28:6521:x1875409555806336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788530224.602324:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f396c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+28:6521:x1875409555806336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 150us (1019us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530224.602332:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:1.0:1788530224.602435:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0231e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555806336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788530224.602521:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d3f8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555806464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788530224.602636:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530224.602968:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555806464 00000100:00100000:1.0:1788530224.602973:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555806464 00000100:00100000:1.0:1788530224.602998:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:1.0:1788530224.603004:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f396c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+28:6521:x1875409555806464:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788530224.603081:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f396c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+28:6521:x1875409555806464:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 77us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530224.603088:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:1.0:1788530224.603777:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e0247f240 going to sleep for 11 seconds 00000100:00100000:1.0:1788530224.603814:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d3f8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555806464:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788530224.606362:0:6521:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788530224.606591:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d3f8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555806592:0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788530224.606701:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530224.606750:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555806592 00000100:00100000:1.0:1788530224.606758:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555806592 00000100:00100000:1.0:1788530224.606821:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:1.0:1788530224.606834:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f396c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+28:6521:x1875409555806592:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788530224.606978:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f396c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+28:6521:x1875409555806592:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 146us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530224.606986:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:1.0:1788530224.607039:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e0247f240 going to sleep for 11 seconds 00000100:00100000:1.0:1788530224.607063:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d3f8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555806592:0@lo:502:ll_cfg_requeue.0 00000040:00080000:1.0:1788530224.607285:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].1, 224 off8416 00000040:00080000:1.0:1788530224.607313:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].2, 112 off8528 00000040:00080000:1.0:1788530224.607324:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].3, 224 off8752 00000040:00080000:1.0:1788530224.607335:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].4, 224 off8976 00000040:00080000:1.0:1788530224.607346:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].5, 112 off9088 00000100:00100000:1.0:1788530224.607366:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d3f8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555806720:0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788530224.607403:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530224.607433:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e0247f240 going to sleep for 11 seconds 00000100:00100000:3.0:1788530224.607478:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555806720 00000100:00100000:3.0:1788530224.607484:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555806720 00000100:00100000:3.0:1788530224.607521:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:3.0:1788530224.607530:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+28:6521:x1875409555806720:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:3.0:1788530224.607692:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+28:6521:x1875409555806720:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 162us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530224.607701:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:1.0:1788530224.608445:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d3f8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555806720:0@lo:502:ll_cfg_requeue.0 00000040:00080000:1.0:1788530224.608622:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].6, 224 off9312 00000040:00080000:1.0:1788530224.608633:0:6521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 6 count 7 00000040:00080000:1.0:1788530224.610430:0:13224:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x18:0x0] index 64768 count 7 00000020:01000000:3.0:1788530224.610789:0:6521:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788530224.610805:0:6521:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788530224.610817:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f18141800/0xb28d70e1257506be lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257506c5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530224.610831:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f18141800/0xb28d70e1257506be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257506c5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788530224.610846:0:6521:0:(mgc_request.c:715:do_requeue()) updating log params 10000000:01000000:3.0:1788530224.610848:0:6521:0:(mgc_request.c:2194:mgc_process_log()) Process log params-ffff9a9f0aaed800 from 7 10000000:01000000:3.0:1788530224.610851:0:6521:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788530224.610900:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9e025dca00/0xb28d70e1257506cc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530224.610910:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9e025dca00/0xb28d70e1257506cc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530224.610923:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9e025dca00/0xb28d70e1257506cc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530224.610956:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37426a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555806848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788530224.611043:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530224.611091:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e03639480 going to sleep for 11 seconds 00000100:00100000:1.0:1788530224.611500:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555806848 00000100:00100000:1.0:1788530224.611511:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555806848 00000100:00100000:1.0:1788530224.611606:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:1.0:1788530224.611617:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+28:6521:x1875409555806848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788530224.611633:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530224.611647:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f42167c00/0xb28d70e1257506d3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e1257506cc expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530224.611673:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f42167c00/0xb28d70e1257506d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e1257506cc expref: 29 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530224.611685:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f42167c00/0xb28d70e1257506d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e1257506cc expref: 29 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530224.611695:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f42167c00, rc 0) 00000100:00100000:1.0:1788530224.611746:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:6521:x1875409555806848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530224.611753:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:1.0:1788530224.611803:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37426a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555806848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788530224.611819:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9e025dca00/0xb28d70e1257506cc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257506d3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530224.611828:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9e025dca00/0xb28d70e1257506cc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e1257506d3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530224.611875:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d3f8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555806976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788530224.611903:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530224.611929:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555806976 00000100:00100000:1.0:1788530224.611932:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555806976 00000100:00100000:1.0:1788530224.611955:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:1.0:1788530224.611970:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:6521:x1875409555806976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788530224.612084:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:6521:x1875409555806976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 115us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530224.612090:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:1.0:1788530224.612434:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e0247f840 going to sleep for 11 seconds 00000100:00100000:1.0:1788530224.612451:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d3f8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555806976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788530224.612493:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d3f8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555807104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788530224.612538:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530224.612639:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e0247f840 going to sleep for 11 seconds 00000100:00100000:3.0:1788530224.621406:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555807104 00000100:00100000:3.0:1788530224.621421:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555807104 00000100:00100000:0.0:1788530224.621925:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:0.0:1788530224.621940:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:6521:x1875409555807104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788530224.622162:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:6521:x1875409555807104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 226us (9623us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530224.622171:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:1.0:1788530224.622263:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d3f8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555807104:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788530224.629383:0:13225:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788530224.631630:0:6521:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788530224.631652:0:6521:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788530224.631667:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9e025dca00/0xb28d70e1257506cc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257506d3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530224.631683:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9e025dca00/0xb28d70e1257506cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257506d3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530225.147340:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530225.147378:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530225.147417:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530225.147437:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530225.147467:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530225.147495:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531590272 00000100:00100000:0.0:1788530225.147504:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531590272 00000100:00100000:0.0:1788530225.147592:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531590528 00000100:00100000:0.0:1788530225.147594:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531590528 00000100:00100000:0.0:1788530225.147610:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531590144 00000100:00100000:0.0:1788530225.147612:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531590144 00000100:00100000:0.0:1788530225.147623:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531590400 00000100:00100000:0.0:1788530225.147625:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531590400 00000100:00100000:0.0:1788530225.147638:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 241 00000100:00100000:0.0:1788530225.147646:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2402:x1875409531590272:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1788530225.147718:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2402:x1875409531590272:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 72us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530225.147725:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 241 00000100:00100000:0.0:1788530225.147739:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 242 00000100:00100000:0.0:1788530225.147744:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2402:x1875409531590528:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1788530225.147762:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2402:x1875409531590528:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 18us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530225.147768:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 242 00000100:00100000:0.0:1788530225.147776:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 243 00000100:00100000:0.0:1788530225.147781:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:2402:x1875409531590144:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1788530225.147796:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:2402:x1875409531590144:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 15us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530225.147802:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 243 00000100:00100000:0.0:1788530225.147816:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 244 00000100:00100000:0.0:1788530225.147822:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2402:x1875409531590400:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1788530225.147839:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2402:x1875409531590400:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 17us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530225.147845:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 244 00000100:00080000:0.0:1788530225.147864:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788530225.147868:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788530225.148649:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531590016 00000100:00100000:3.0:1788530225.148671:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531590016 00000100:00100000:3.0:1788530225.148752:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 388 00000100:00100000:3.0:1788530225.148761:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f442bcd-b742-4e76-ad7b-709f731358a0+14:2402:x1875409531590016:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1788530225.148812:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f442bcd-b742-4e76-ad7b-709f731358a0+14:2402:x1875409531590016:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 53us (1482us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530225.148819:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 388 00000100:00100000:1.0:1788530225.216927:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788530225.216963:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d3f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555807232:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788530225.217079:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530225.217210:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555807232 00000100:00100000:1.0:1788530225.217233:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555807232 00000100:00100000:1.0:1788530225.217302:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788530225.217322:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03691c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555807232:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788530225.217400:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446453248 avail 1300213760 00000100:00100000:1.0:1788530225.217464:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03691c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555807232:12345-0@lo:41:osp-pre-1-0.0 Request processed in 153us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530225.217471:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788530225.217522:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d3f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555807232:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788530225.345153:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530226.369971:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530227.395169:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788530228.303522:0:13401:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg241-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788530228.416945:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788530228.801145:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788530228.801171:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37427480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555807360:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788530228.801250:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530228.804613:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555807360 00000100:00100000:2.0:1788530228.804632:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555807360 00000100:00100000:2.0:1788530228.804995:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788530228.805007:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555807360:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788530228.805045:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788530228.805134:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555807360:12345-0@lo:41:osp-pre-0-1.0 Request processed in 130us (3883us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530228.805199:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788530228.805427:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37427480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555807360:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788530229.312833:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555807616:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788530229.312909:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530229.312987:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788530229.312993:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03692a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555807488:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788530229.313016:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530229.313165:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788530229.313174:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37426680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555807744:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788530229.313203:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530229.313250:0:9912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555807616 00000100:00100000:3.0:1788530229.313266:0:9912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555807616 00000100:00100000:3.0:1788530229.313308:0:9912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555807488 00000100:00100000:3.0:1788530229.313311:0:9912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555807488 00000100:00100000:3.0:1788530229.313325:0:9912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555807744 00000100:00100000:3.0:1788530229.313327:0:9912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555807744 00000100:00100000:3.0:1788530229.313341:0:9912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788530229.313349:0:9912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555807616:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788530229.313378:0:9912:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788530229.313441:0:9912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555807616:12345-0@lo:13:osp-pre-1-1.0 Request processed in 91us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530229.313449:0:9912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788530229.313468:0:9912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788530229.313475:0:9912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555807488:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788530229.313489:0:9912:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788530229.313516:0:9912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555807488:12345-0@lo:13:osp-pre-0-1.0 Request processed in 43us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530229.313539:0:9912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788530229.313553:0:9912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788530229.313582:0:9912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37425c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555807744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788530229.313593:0:9912:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788530229.313624:0:9912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37425c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555807744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530229.313630:0:9912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00010000:00080000:3.0:1788530229.313665:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f37426680 x1875409555807744/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530245 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530229.313685:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37426680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555807744:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1788530229.313716:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e03692a00 x1875409555807488/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530245 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530229.313728:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03692a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555807488:0@lo:13:osp-pre-0-1.0 00010000:00080000:3.0:1788530229.313738:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e037d1c00 x1875409555807616/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530245 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530229.313747:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555807616:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788530229.314164:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788530229.314177:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0231dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555807872:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788530229.314216:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530229.314402:0:9912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555807872 00000100:00100000:2.0:1788530229.314409:0:9912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555807872 00000100:00100000:2.0:1788530229.314465:0:9912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788530229.314476:0:9912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03691500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555807872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788530229.314493:0:9912:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788530229.314540:0:9912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03691500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555807872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530229.314546:0:9912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00010000:00080000:2.0:1788530229.314638:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e0231dc00 x1875409555807872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530245 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530229.314657:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0231dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555807872:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788530229.314799:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788530229.314806:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788530229.315508:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3649:1875409555808000:0@lo:400:kworker.0 00000100:00100000:3.0:1788530229.315607:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530229.315645:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03736d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555808512:0@lo:400:kworker.0 00000100:00100000:3.0:1788530229.315671:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530229.315689:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03737480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875409555809024:0@lo:400:kworker.0 00000100:00100000:3.0:1788530229.315719:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530229.315754:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788530229.315762:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875409555808128:0@lo:400:kworker.0 00000100:00100000:3.0:1788530229.315788:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530229.315805:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03735f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875409555808640:0@lo:400:kworker.0 00000100:00100000:3.0:1788530229.315829:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530229.315863:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875409555808384:0@lo:400:kworker.0 00000100:00100000:3.0:1788530229.315891:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530229.315908:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03734000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875409555808896:0@lo:400:kworker.0 00000100:00100000:3.0:1788530229.315928:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530229.315944:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788530229.315950:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555808256:0@lo:400:kworker.0 00000100:00100000:3.0:1788530229.315987:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530229.316007:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03734700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875409555808768:0@lo:400:kworker.0 00000100:00100000:3.0:1788530229.316033:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530229.316276:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555809024 00000100:00100000:1.0:1788530229.316288:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555809024 00000100:00100000:1.0:1788530229.316365:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555808128 00000100:00100000:1.0:1788530229.316368:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555808128 00000100:00100000:1.0:1788530229.316381:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555808640 00000100:00100000:1.0:1788530229.316383:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555808640 00000100:00100000:1.0:1788530229.316408:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555808384 00000100:00100000:1.0:1788530229.316419:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555808384 00000100:00100000:1.0:1788530229.316430:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555808896 00000100:00100000:1.0:1788530229.316432:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555808896 00000100:00100000:1.0:1788530229.316443:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555808768 00000100:00100000:1.0:1788530229.316445:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555808768 00000100:00100000:1.0:1788530229.316459:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1788530229.316467:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37427800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875409555809024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530229.316528:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37427800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875409555809024:12345-0@lo:400:kworker.0 Request processed in 61us (808us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530229.316535:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1788530229.316591:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1788530229.316598:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37427480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875409555808128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530229.316628:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37427480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875409555808128:12345-0@lo:400:kworker.0 Request processed in 30us (839us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530229.316634:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1788530229.316645:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1788530229.316651:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37426a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875409555808640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530229.316693:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37426a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875409555808640:12345-0@lo:400:kworker.0 Request processed in 42us (863us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530229.316698:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1788530229.316709:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1788530229.316715:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37424a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875409555808384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530229.316746:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37424a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875409555808384:12345-0@lo:400:kworker.0 Request processed in 31us (854us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530229.316752:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1788530229.316763:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1788530229.316769:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37424700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875409555808896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530229.316796:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37424700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875409555808896:12345-0@lo:400:kworker.0 Request processed in 27us (866us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530229.316802:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1788530229.316813:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1788530229.316819:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875409555808768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530229.316842:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875409555808768:12345-0@lo:400:kworker.0 Request processed in 24us (809us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530229.316848:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00010000:00080000:1.0:1788530229.316895:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e03734700 x1875409555808768/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530245 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530229.316910:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03734700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875409555808768:0@lo:400:kworker.0 00000100:00100000:1.0:1788530229.316925:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875409555808384:0@lo:400:kworker.0 00000100:00100000:1.0:1788530229.316934:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03734000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875409555808896:0@lo:400:kworker.0 00000100:00100000:1.0:1788530229.316993:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875409555808128:0@lo:400:kworker.0 00000100:00100000:1.0:1788530229.317005:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03735f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875409555808640:0@lo:400:kworker.0 00010000:00080000:1.0:1788530229.317015:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e03737480 x1875409555809024/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530245 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530229.317023:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03737480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875409555809024:0@lo:400:kworker.0 00000100:00100000:2.0:1788530229.317709:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555808512 00000100:00100000:2.0:1788530229.317715:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555808512 00000100:00100000:2.0:1788530229.317745:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555808256 00000100:00100000:2.0:1788530229.317749:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555808256 00000100:00100000:2.0:1788530229.317763:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788530229.317771:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37426680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555808512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530229.317852:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37426680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555808512:12345-0@lo:400:kworker.0 Request processed in 81us (2179us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530229.317859:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788530229.317873:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788530229.317879:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555808256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530229.317915:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555808256:12345-0@lo:400:kworker.0 Request processed in 36us (1928us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530229.317921:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788530229.317953:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555808256:0@lo:400:kworker.0 00000100:00100000:0.0:1788530229.318049:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555808000 00000100:00100000:0.0:1788530229.318054:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555808000 00000100:00100000:0.0:1788530229.318092:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:0.0:1788530229.318099:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:3649:x1875409555808000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530229.318145:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:3649:x1875409555808000:12345-0@lo:400:kworker.0 Request processed in 46us (2538us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530229.318152:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:1.0:1788530229.318537:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3649:1875409555808000:0@lo:400:kworker.0 00000100:00100000:1.0:1788530229.318552:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03736d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555808512:0@lo:400:kworker.0 00000100:00080000:3.0:1788530229.318910:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788530229.318916:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1788530229.441703:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788530230.252035:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530230.252067:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531590656 00000100:00100000:0.0:1788530230.252076:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531590656 00000100:00100000:0.0:1788530230.252131:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 390 00000100:00100000:0.0:1788530230.252140:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f442bcd-b742-4e76-ad7b-709f731358a0+14:2399:x1875409531590656:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1788530230.252214:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f442bcd-b742-4e76-ad7b-709f731358a0+14:2399:x1875409531590656:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 74us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530230.252222:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 390 00000100:00100000:0.0:1788530230.252279:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530230.252444:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530230.252464:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530230.252486:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530230.252506:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531590912 00000100:00100000:0.0:1788530230.252510:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531590912 00000100:00100000:0.0:1788530230.252590:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531591168 00000100:00100000:0.0:1788530230.252594:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531591168 00000100:00100000:0.0:1788530230.252611:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531590784 00000100:00100000:0.0:1788530230.252614:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531590784 00000100:00100000:0.0:1788530230.252627:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531591040 00000100:00100000:0.0:1788530230.252629:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531591040 00000100:00100000:0.0:1788530230.252643:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 251 00000100:00100000:0.0:1788530230.252650:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03735c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2399:x1875409531590912:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1788530230.252692:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03735c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2399:x1875409531590912:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 42us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530230.252700:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 251 00000100:00100000:0.0:1788530230.252714:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 252 00000100:00100000:0.0:1788530230.252720:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03736a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2399:x1875409531591168:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1788530230.252743:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03736a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2399:x1875409531591168:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 23us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530230.252749:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 252 00000100:00100000:0.0:1788530230.252771:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 253 00000100:00100000:0.0:1788530230.252777:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03735500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:2400:x1875409531590784:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1788530230.252802:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03735500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:2400:x1875409531590784:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 26us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530230.252808:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 253 00000100:00100000:0.0:1788530230.252820:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 254 00000100:00100000:0.0:1788530230.252826:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03737800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2400:x1875409531591040:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1788530230.252848:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03737800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2400:x1875409531591040:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 23us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530230.252854:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 254 00000100:00080000:0.0:1788530230.260780:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788530230.260792:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788530230.336881:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788530230.336906:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03693800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555809152:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788530230.336982:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530230.337277:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555809152 00000100:00100000:0.0:1788530230.337285:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555809152 00000100:00100000:0.0:1788530230.337354:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788530230.337367:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0231dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555809152:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788530230.337416:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446453248 avail 1300213760 00000100:00100000:0.0:1788530230.337483:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0231dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555809152:12345-0@lo:41:osp-pre-1-0.0 Request processed in 117us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530230.337492:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788530230.337660:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03693800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555809152:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788530230.471212:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530231.489901:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530232.513779:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530233.536882:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788530233.922846:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788530233.922876:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555809280:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788530233.922948:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530233.923300:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555809280 00000100:00100000:3.0:1788530233.923312:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555809280 00000100:00100000:3.0:1788530233.923387:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788530233.923399:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0231fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555809280:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788530233.923799:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788530233.923881:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0231fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555809280:12345-0@lo:41:osp-pre-0-1.0 Request processed in 483us (932us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530233.923889:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788530233.924156:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555809280:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788530234.433732:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555809408:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788530234.433810:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530234.438964:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0231e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3647:1875409555809792:0@lo:400:kworker.0 00000100:00100000:1.0:1788530234.439052:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530234.440011:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555809792 00000100:00100000:2.0:1788530234.440024:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555809792 00000100:00100000:2.0:1788530234.440078:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:2.0:1788530234.440087:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:3647:x1875409555809792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530234.440142:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:3647:x1875409555809792:12345-0@lo:400:kworker.0 Request processed in 56us (1091us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530234.440149:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:3.0:1788530234.440491:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0231d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875409555809920:0@lo:400:kworker.0 00000100:00100000:3.0:1788530234.440548:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530234.440619:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37409180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875409555810432:0@lo:400:kworker.0 00000100:00100000:3.0:1788530234.440654:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530234.440679:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37375180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875409555810944:0@lo:400:kworker.0 00000100:00100000:3.0:1788530234.440704:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530234.440748:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03735880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555809664:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788530234.440783:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530234.440809:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32a54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875409555810176:0@lo:400:kworker.0 00000100:00100000:3.0:1788530234.440836:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530234.440852:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37377100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555810688:0@lo:400:kworker.0 00000100:00100000:3.0:1788530234.440877:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530234.440915:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e035f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555811200:0@lo:400:kworker.0 00000100:00100000:3.0:1788530234.440936:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530234.440960:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:3.0:1788530234.440967:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555809536:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788530234.440985:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530234.441001:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555810048:0@lo:400:kworker.0 00000100:00100000:3.0:1788530234.441025:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530234.441045:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37376680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875409555810560:0@lo:400:kworker.0 00000100:00100000:3.0:1788530234.441066:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530234.441083:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e035f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555811072:0@lo:400:kworker.0 00000100:00100000:3.0:1788530234.441103:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530234.441134:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555809920 00000100:00100000:3.0:1788530234.441153:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555809920 00000100:00100000:3.0:1788530234.441219:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555810432 00000100:00100000:3.0:1788530234.441222:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555810432 00000100:00100000:3.0:1788530234.441248:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555810944 00000100:00100000:3.0:1788530234.441250:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555810944 00000100:00100000:3.0:1788530234.441264:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555810176 00000100:00100000:3.0:1788530234.441266:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555810176 00000100:00100000:3.0:1788530234.441275:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555810560 00000100:00100000:3.0:1788530234.441277:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555810560 00000100:00100000:3.0:1788530234.441293:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1788530234.441300:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875409555809920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530234.441357:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875409555809920:12345-0@lo:400:kworker.0 Request processed in 56us (808us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530234.441372:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1788530234.441389:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1788530234.441396:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875409555810432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530234.441427:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875409555810432:12345-0@lo:400:kworker.0 Request processed in 32us (773us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530234.441433:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1788530234.441444:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1788530234.441450:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875409555810944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530234.441474:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875409555810944:12345-0@lo:400:kworker.0 Request processed in 25us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530234.441479:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1788530234.441491:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1788530234.441496:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875409555810176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530234.441526:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875409555810176:12345-0@lo:400:kworker.0 Request processed in 29us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530234.441543:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1788530234.441557:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1788530234.441594:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875409555810560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530234.441622:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875409555810560:12345-0@lo:400:kworker.0 Request processed in 29us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530234.441627:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1788530234.441649:0:9912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555809408 00000100:00100000:3.0:1788530234.441653:0:9912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555809408 00000100:00100000:3.0:1788530234.441672:0:9912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555809664 00000100:00100000:3.0:1788530234.441674:0:9912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555809664 00000100:00100000:3.0:1788530234.441685:0:9912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555809536 00000100:00100000:3.0:1788530234.441687:0:9912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555809536 00000100:00100000:3.0:1788530234.441700:0:9912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788530234.441706:0:9912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555809408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788530234.441732:0:9912:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788530234.441764:0:9912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555809408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 58us (7954us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530234.441770:0:9912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788530234.441781:0:9912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788530234.441788:0:9912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555809664:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788530234.441804:0:9912:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788530234.441830:0:9912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555809664:12345-0@lo:13:osp-pre-1-1.0 Request processed in 43us (1046us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530234.441836:0:9912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788530234.441846:0:9912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788530234.441851:0:9912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555809536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788530234.441869:0:9912:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788530234.441897:0:9912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555809536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 45us (911us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530234.441903:0:9912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788530234.441929:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555810048 00000100:00100000:3.0:1788530234.441934:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555810048 00000100:00100000:3.0:1788530234.441961:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788530234.441967:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555810048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530234.442018:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555810048:12345-0@lo:400:kworker.0 Request processed in 50us (991us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530234.442024:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788530234.442048:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555810688 00000100:00100000:3.0:1788530234.442052:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555810688 00000100:00100000:3.0:1788530234.442075:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555811200 00000100:00100000:3.0:1788530234.442078:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555811200 00000100:00100000:3.0:1788530234.442085:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555811072 00000100:00100000:3.0:1788530234.442088:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555811072 00000100:00100000:3.0:1788530234.442097:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788530234.442102:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555810688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530234.442134:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555810688:12345-0@lo:400:kworker.0 Request processed in 32us (1256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530234.442140:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788530234.442152:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788530234.442158:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555811200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530234.442180:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555811200:12345-0@lo:400:kworker.0 Request processed in 24us (1243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530234.442186:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788530234.442205:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788530234.442211:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555811072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530234.442239:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555811072:12345-0@lo:400:kworker.0 Request processed in 29us (1135us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530234.442245:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:3.0:1788530234.442260:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788530234.442265:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788530234.442267:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788530234.442269:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788530234.442308:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e03d41c00 x1875409555809536/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530250 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530234.442328:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555809536:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788530234.442340:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555810048:0@lo:400:kworker.0 00010000:00080000:3.0:1788530234.442350:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f37376680 x1875409555810560/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530250 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530234.442359:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37376680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875409555810560:0@lo:400:kworker.0 00010000:00080000:3.0:1788530234.442384:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e035f7800 x1875409555811072/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788530250 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530234.442392:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e035f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555811072:0@lo:400:kworker.0 00010000:00080000:3.0:1788530234.442401:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e03735880 x1875409555809664/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530250 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530234.442411:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03735880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555809664:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788530234.442423:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32a54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875409555810176:0@lo:400:kworker.0 00010000:00080000:3.0:1788530234.442447:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f37377100 x1875409555810688/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788530250 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530234.442454:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37377100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555810688:0@lo:400:kworker.0 00010000:00080000:3.0:1788530234.442464:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e035f7480 x1875409555811200/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788530250 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530234.442471:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e035f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555811200:0@lo:400:kworker.0 00000100:00100000:3.0:1788530234.442528:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0231d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875409555809920:0@lo:400:kworker.0 00000100:00100000:3.0:1788530234.442541:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37409180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875409555810432:0@lo:400:kworker.0 00010000:00080000:3.0:1788530234.442551:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f37375180 x1875409555810944/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530250 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530234.442581:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37375180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875409555810944:0@lo:400:kworker.0 00010000:00080000:3.0:1788530234.442595:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e03d43480 x1875409555809408/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530250 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530234.442605:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555809408:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788530234.448488:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788530234.448530:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e035f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555811328:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788530234.449114:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530234.459813:0:9912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555811328 00000100:00100000:2.0:1788530234.459839:0:9912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555811328 00000100:00100000:2.0:1788530234.459971:0:9912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788530234.459984:0:9912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555811328:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788530234.460029:0:9912:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788530234.460154:0:9912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555811328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 172us (11042us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530234.460159:0:9912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00010000:00080000:2.0:1788530234.460246:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e035f4380 x1875409555811328/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530250 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530234.460268:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e035f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555811328:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788530234.460690:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0231e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3647:1875409555809792:0@lo:400:kworker.0 00000100:00100000:3.0:1788530234.460707:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37364700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555810304:0@lo:400:kworker.0 00000100:00100000:3.0:1788530234.460752:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530234.460780:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555810304 00000100:00100000:3.0:1788530234.460791:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555810304 00000100:00100000:3.0:1788530234.460817:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788530234.460822:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555810304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530234.460853:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555810304:12345-0@lo:400:kworker.0 Request processed in 31us (102us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530234.460858:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788530234.460879:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37364700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555810304:0@lo:400:kworker.0 00000100:00100000:3.0:1788530234.461275:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37374380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875409555810816:0@lo:400:kworker.0 00000100:00100000:3.0:1788530234.461310:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530234.461338:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555810816 00000100:00100000:3.0:1788530234.461342:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555810816 00000100:00100000:3.0:1788530234.461416:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1788530234.461424:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875409555810816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530234.461458:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875409555810816:12345-0@lo:400:kworker.0 Request processed in 35us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530234.461465:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00080000:3.0:1788530234.461483:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788530234.461510:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37374380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875409555810816:0@lo:400:kworker.0 00000001:02000400:2.0:1788530234.533219:0:13550:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 09:57:12 (1788530232) === 00010000:00010000:1.0:1788530234.561461:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788530234.996704:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530234.996759:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530234.996933:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531591424 00000100:00100000:2.0:1788530234.996946:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531591424 00000100:00100000:2.0:1788530234.997047:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 2 00000100:00100000:2.0:1788530234.997060:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03736300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:10503:x1875409531591424:12345-192.168.202.41@tcp:700:mkdir.0 00000100:00100000:2.0:1788530234.997171:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03736300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:10503:x1875409531591424:12345-192.168.202.41@tcp:700:mkdir.0 Request processed in 114us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530234.997194:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 2 00000100:00100000:3.0:1788530234.997457:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531591296 00000100:00100000:3.0:1788530234.997462:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531591296 00000100:00100000:3.0:1788530234.997519:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 22 00000100:00100000:3.0:1788530234.997528:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03734a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:2400:x1875409531591296:12345-192.168.202.41@tcp:41:mkdir.0 00000004:00000024:3.0:1788530234.997609:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788530234.997686:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03734a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:2400:x1875409531591296:12345-192.168.202.41@tcp:41:mkdir.0 Request processed in 159us (996us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530234.997693:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 22 00000100:00080000:0.0:1788530234.999505:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788530235.004970:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530235.005092:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531591680 00000100:00100000:2.0:1788530235.005106:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531591680 00000100:00100000:2.0:1788530235.005188:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 23 00000100:00100000:2.0:1788530235.005200:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03693800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:10503:x1875409531591680:12345-192.168.202.41@tcp:36:mkdir.0 00010000:00010000:2.0:1788530235.005262:0:8678:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788530235.005338:0:8678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140000/0xb28d70e12575054b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a55075a expref: 6 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530235.005368:0:8678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a9f2b994f00) 00010000:00010000:2.0:1788530235.005412:0:8678:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788530235.005516:0:8678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140a00/0xb28d70e1257506da lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530235.005531:0:8678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140a00/0xb28d70e1257506da lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530235.005542:0:8678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140a00/0xb28d70e1257506da lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530235.005619:0:8678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141400/0xb28d70e1257506e1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530235.005634:0:8678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141400/0xb28d70e1257506e1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530235.005642:0:8678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141400/0xb28d70e1257506e1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530235.006301:0:8678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c600/0xb28d70e1257506e8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530235.006313:0:8678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c600/0xb28d70e1257506e8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530235.006320:0:8678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c600/0xb28d70e1257506e8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788530235.006335:0:8678:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002ceeff76 reply state 0000000011b2e94d transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c600/0xb28d70e1257506e8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530235.006347:0:8678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c600/0xb28d70e1257506e8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530235.006381:0:8678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9a9f2b992500) 00010000:00010000:2.0:1788530235.006383:0:8678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788530235.006387:0:8678:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788530235.006391:0:8678:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788530235.006399:0:8678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140a00/0xb28d70e1257506da lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530235.006406:0:8678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140a00/0xb28d70e1257506da lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530235.006412:0:8678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140a00/0xb28d70e1257506da lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530235.006418:0:8678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f18140a00 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:2.0:1788530235.006423:0:8678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140a00/0xb28d70e1257506da lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530235.006430:0:8678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140a00/0xb28d70e1257506da lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530235.006440:0:8678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a9f2b992800) 00010000:00010000:2.0:1788530235.006442:0:8678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788530235.006446:0:8678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140a00/0xb28d70e1257506da lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530235.006451:0:8678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140a00/0xb28d70e1257506da lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788530235.006465:0:8678:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002ceeff76 reply state 0000000011b2e94d transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141400/0xb28d70e1257506e1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530235.006483:0:8678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141400/0xb28d70e1257506e1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530235.006489:0:8678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9a9f2b992b00) 00010000:00010000:2.0:1788530235.006491:0:8678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788530235.006493:0:8678:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1788530235.006615:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03693800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+7:10503:x1875409531591680:12345-192.168.202.41@tcp:36:mkdir.0 Request processed in 1415us (1656us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788530235.006624:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 23 00000100:00100000:0.0:1788530235.018735:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530235.019239:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531591808 00000100:00100000:3.0:1788530235.019251:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531591808 00000100:00100000:3.0:1788530235.019334:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 24 00000100:00100000:3.0:1788530235.019345:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03734380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+7:10504:x1875409531591808:12345-192.168.202.41@tcp:101:chmod.0 00010000:00010000:3.0:1788530235.019379:0:10720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788530235.019413:0:10720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e025dce00/0xb28d70e1257506ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a5507f4 expref: -99 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530235.019499:0:10720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e025dc600/0xb28d70e1257506f6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530235.019514:0:10720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e025dc600/0xb28d70e1257506f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530235.019526:0:10720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e025dc600/0xb28d70e1257506f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788530235.020041:0:10720:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788530235.020046:0:10720:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788530235.020086:0:10720:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e025dc600/0xb28d70e1257506f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530235.020115:0:10720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e025dce00/0xb28d70e1257506ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5507f4 expref: 9 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530235.020133:0:10720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e025dc600/0xb28d70e1257506f6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5507f4 expref: 8 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530235.020141:0:10720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a9f32acf400) 00010000:00010000:3.0:1788530235.020144:0:10720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788530235.020159:0:10720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9e025dc600, rc 0) 00000100:00100000:3.0:1788530235.020306:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03734380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+8:10504:x1875409531591808:12345-192.168.202.41@tcp:101:chmod.0 Request processed in 950us (1572us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530235.020315:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 24 00000100:00100000:1.0:1788530235.033084:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530235.033457:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531592064 00000100:00100000:3.0:1788530235.033468:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531592064 00000100:00100000:3.0:1788530235.033555:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 25 00000100:00100000:3.0:1788530235.033612:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03691880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+8:10504:x1875409531592064:12345-192.168.202.41@tcp:36:chmod.0 00010000:00010000:3.0:1788530235.033692:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788530235.033725:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e025dc600/0xb28d70e1257506f6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5507f4 expref: 8 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530235.033747:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a9f32acf400) 00010000:00010000:3.0:1788530235.033759:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788530235.033785:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e025dce00/0xb28d70e1257506fd lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530235.033799:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e025dce00/0xb28d70e1257506fd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530235.033810:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e025dce00/0xb28d70e1257506fd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788530235.034052:0:6523:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000257be104 reply state 00000000afa9c26d transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e025dce00/0xb28d70e1257506fd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530235.034066:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e025dce00/0xb28d70e1257506fd lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530235.034073:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a9f32acfd00) 00010000:00010000:3.0:1788530235.034083:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788530235.034086:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788530235.034094:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788530235.034186:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03691880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+9:10504:x1875409531592064:12345-192.168.202.41@tcp:36:chmod.0 Request processed in 565us (1110us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788530235.034194:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 25 00000100:00100000:1.0:1788530235.089461:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530235.089593:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531592192 00000100:00100000:2.0:1788530235.089604:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531592192 00000100:00100000:2.0:1788530235.089702:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 26 00000100:00100000:2.0:1788530235.089713:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03690a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+9:10505:x1875409531592192:12345-192.168.202.41@tcp:101:chown.0 00010000:00010000:2.0:1788530235.089745:0:8678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530235.089774:0:8678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c800/0xb28d70e125750704 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a5507fb expref: -99 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530235.089859:0:8678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d600/0xb28d70e12575070b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530235.090047:0:8678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d600/0xb28d70e12575070b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530235.090063:0:8678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d600/0xb28d70e12575070b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788530235.090115:0:8678:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788530235.090119:0:8678:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788530235.090172:0:8678:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d600/0xb28d70e12575070b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530235.090208:0:8678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c800/0xb28d70e125750704 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5507fb expref: 11 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530235.090227:0:8678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d600/0xb28d70e12575070b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5507fb expref: 10 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530235.090236:0:8678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a9f32acfd00) 00010000:00010000:2.0:1788530235.090239:0:8678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788530235.090242:0:8678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d20d600, rc 0) 00000100:00100000:2.0:1788530235.090328:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03690a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+10:10505:x1875409531592192:12345-192.168.202.41@tcp:101:chown.0 Request processed in 616us (880us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530235.090337:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 26 00000100:00100000:0.0:1788530235.109235:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530235.116378:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531592320 00000100:00100000:3.0:1788530235.116408:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531592320 00000100:00100000:2.0:1788530235.119961:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 27 00000100:00100000:2.0:1788530235.119983:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03734e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+10:10505:x1875409531592320:12345-192.168.202.41@tcp:101:chown.0 00010000:00010000:2.0:1788530235.120012:0:10720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530235.120048:0:10720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c800/0xb28d70e125750712 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550802 expref: -99 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530235.120159:0:10720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d400/0xb28d70e125750719 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530235.120174:0:10720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d400/0xb28d70e125750719 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530235.120188:0:10720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d400/0xb28d70e125750719 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530235.120220:0:10720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d200/0xb28d70e125750720 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530235.120229:0:10720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d200/0xb28d70e125750720 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530235.120234:0:10720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d200/0xb28d70e125750720 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530235.120310:0:10720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20de00/0xb28d70e125750727 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530235.120319:0:10720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20de00/0xb28d70e125750727 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530235.120325:0:10720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20de00/0xb28d70e125750727 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788530235.120378:0:10720:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788530235.120382:0:10720:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788530235.120401:0:10720:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20de00/0xb28d70e125750727 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530235.120413:0:10720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d400/0xb28d70e125750719 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530235.120419:0:10720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d400/0xb28d70e125750719 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530235.120426:0:10720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d400/0xb28d70e125750719 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530235.120445:0:10720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d20d400 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:2.0:1788530235.120450:0:10720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d400/0xb28d70e125750719 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530235.120458:0:10720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d400/0xb28d70e125750719 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530235.120472:0:10720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a9f32acfd00) 00010000:00010000:2.0:1788530235.120475:0:10720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788530235.120480:0:10720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d400/0xb28d70e125750719 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530235.120486:0:10720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d400/0xb28d70e125750719 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530235.120501:0:10720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d200/0xb28d70e125750720 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530235.120506:0:10720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d200/0xb28d70e125750720 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530235.120511:0:10720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d200/0xb28d70e125750720 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530235.120516:0:10720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d20d200 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:2.0:1788530235.120518:0:10720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d200/0xb28d70e125750720 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530235.120524:0:10720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d200/0xb28d70e125750720 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530235.120540:0:10720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9a9f2b992b00) 00010000:00010000:2.0:1788530235.120542:0:10720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788530235.120546:0:10720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d200/0xb28d70e125750720 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530235.120552:0:10720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d200/0xb28d70e125750720 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530235.120650:0:10720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c800/0xb28d70e125750712 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550802 expref: 12 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530235.120665:0:10720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20de00/0xb28d70e125750727 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550802 expref: 11 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530235.120673:0:10720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9a9f2b992500) 00010000:00010000:2.0:1788530235.120675:0:10720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788530235.120677:0:10720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d20de00, rc 0) 00000100:00100000:2.0:1788530235.120772:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03734e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+11:10505:x1875409531592320:12345-192.168.202.41@tcp:101:chown.0 Request processed in 793us (11549us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530235.120780:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 27 00000100:00100000:1.0:1788530235.128831:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530235.129229:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531592448 00000100:00100000:0.0:1788530235.129241:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531592448 00000100:00100000:0.0:1788530235.129321:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 6 00000100:00100000:0.0:1788530235.129333:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03692300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+11:10505:x1875409531592448:12345-192.168.202.41@tcp:900:chown.0 00000100:00100000:0.0:1788530235.129472:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03692300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+11:10505:x1875409531592448:12345-192.168.202.41@tcp:900:chown.0 Request processed in 141us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530235.129481:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 6 00000100:00100000:3.0:1788530235.133179:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530235.133417:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531592704 00000100:00100000:0.0:1788530235.133429:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531592704 00000100:00100000:0.0:1788530235.133514:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 28 00000100:00100000:0.0:1788530235.133525:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+11:10505:x1875409531592704:12345-192.168.202.41@tcp:36:chown.0 00010000:00010000:0.0:1788530235.133635:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788530235.133670:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20de00/0xb28d70e125750727 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550802 expref: 11 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530235.133692:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9a9f2b992500) 00010000:00010000:0.0:1788530235.133698:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788530235.133727:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e12575072e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530235.133744:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e12575072e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530235.133755:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e12575072e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788530235.137473:0:6502:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00000004:00010000:3.0:1788530235.138432:0:6523:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e74a094b reply state 00000000bbe92515 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e12575072e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530235.138460:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e12575072e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530235.138470:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9a9f2b992500) 00010000:00010000:3.0:1788530235.138474:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788530235.138480:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788530235.138494:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:3.0:1788530235.139535:0:6523:0:(ldlm_lib.c:3496:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1788530235.139589:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+9:10505:x1875409531592704:12345-192.168.202.41@tcp:36:chown.0 Request processed in 6034us (6391us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788530235.139599:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 28 00010000:00010000:1.0:1788530235.140678:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141400/0xb28d70e1257506e1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530235.140692:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141400/0xb28d70e1257506e1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530235.140701:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141400/0xb28d70e1257506e1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530235.140708:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f18141400 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:1.0:1788530235.140713:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141400/0xb28d70e1257506e1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530235.140721:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141400/0xb28d70e1257506e1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530235.140743:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9a9f2b992b00) 00010000:00010000:1.0:1788530235.140746:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788530235.140751:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141400/0xb28d70e1257506e1 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530235.140757:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141400/0xb28d70e1257506e1 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530235.140783:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c600/0xb28d70e1257506e8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530235.140791:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c600/0xb28d70e1257506e8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530235.140796:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c600/0xb28d70e1257506e8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530235.140817:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d20c600 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:1.0:1788530235.140820:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c600/0xb28d70e1257506e8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530235.140827:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c600/0xb28d70e1257506e8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530235.140836:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9a9f2b992500) 00010000:00010000:1.0:1788530235.140838:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788530235.140842:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c600/0xb28d70e1257506e8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530235.140847:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c600/0xb28d70e1257506e8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530235.140860:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e025dce00/0xb28d70e1257506fd lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530235.140866:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e025dce00/0xb28d70e1257506fd lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530235.140871:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e025dce00/0xb28d70e1257506fd lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530235.140876:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9e025dce00 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:1.0:1788530235.140951:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e025dce00/0xb28d70e1257506fd lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530235.140959:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e025dce00/0xb28d70e1257506fd lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530235.140979:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a9f32acfd00) 00010000:00010000:1.0:1788530235.140982:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788530235.140985:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e025dce00/0xb28d70e1257506fd lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530235.140991:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e025dce00/0xb28d70e1257506fd lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530235.141151:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e12575072e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530235.141159:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e12575072e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530235.141165:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e12575072e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530235.141180:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d36b800 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:2.0:1788530235.141183:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e12575072e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530235.141189:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e12575072e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530235.141198:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9a9f2b992500) 00010000:00010000:2.0:1788530235.141202:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788530235.141205:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e12575072e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530235.141210:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e12575072e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530235.175214:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530235.175378:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531592832 00000100:00100000:3.0:1788530235.175393:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531592832 00000100:00100000:3.0:1788530235.175485:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 29 00000100:00100000:3.0:1788530235.175497:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03690380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:10506:x1875409531592832:12345-192.168.202.41@tcp:101:touch.500 00010000:00010000:3.0:1788530235.175531:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788530235.175557:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e025dc600/0xb28d70e125750735 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550809 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788530235.183801:0:6525:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 3261us 00010000:00010000:0.0:1788530235.211412:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b400/0xb28d70e12575073c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530235.211445:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b400/0xb28d70e12575073c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530235.211457:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b400/0xb28d70e12575073c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530235.211475:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e125750743 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530235.211482:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e125750743 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530235.211489:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e125750743 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530235.211710:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36be00/0xb28d70e12575074a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530235.211720:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36be00/0xb28d70e12575074a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530235.211729:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36be00/0xb28d70e12575074a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788530235.211769:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788530235.211775:0:6525:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788530235.211823:0:6525:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36be00/0xb28d70e12575074a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530235.211849:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b400/0xb28d70e12575073c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530235.211857:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b400/0xb28d70e12575073c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530235.211864:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b400/0xb28d70e12575073c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530235.211870:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d36b400 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:0.0:1788530235.211875:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b400/0xb28d70e12575073c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530235.212718:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b400/0xb28d70e12575073c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530235.212737:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a9f32acfd00) 00010000:00010000:0.0:1788530235.212740:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788530235.212746:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b400/0xb28d70e12575073c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530235.212754:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b400/0xb28d70e12575073c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530235.212768:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e125750743 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530235.212776:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e125750743 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530235.212783:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e125750743 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530235.212796:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d36b200 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:0.0:1788530235.212800:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e125750743 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530235.212806:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e125750743 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530235.212815:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9a9f3d32c900) 00010000:00010000:0.0:1788530235.212818:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788530235.212821:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e125750743 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530235.212828:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e125750743 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530235.212875:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e025dc600/0xb28d70e125750735 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550809 expref: 8 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530235.213239:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36be00/0xb28d70e12575074a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550809 expref: 7 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530235.213249:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9a9f3d32ce00) 00010000:00010000:0.0:1788530235.213251:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788530235.213254:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d36be00, rc 0) 00000100:00100000:0.0:1788530235.213352:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03690380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+7:10506:x1875409531592832:12345-192.168.202.41@tcp:101:touch.500 Request processed in 37855us (38148us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530235.213371:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 29 00000100:00100000:0.0:1788530235.223031:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530235.223257:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531593088 00000100:00100000:3.0:1788530235.223269:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531593088 00000100:00100000:3.0:1788530235.223372:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 30 00000100:00100000:3.0:1788530235.223384:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03737100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+7:10506:x1875409531593088:12345-192.168.202.41@tcp:101:touch.500 00010000:00010000:3.0:1788530235.223414:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788530235.223441:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e025dcc00/0xb28d70e125750751 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550810 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530235.225760:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e025dce00/0xb28d70e125750758 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530235.225788:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e025dce00/0xb28d70e125750758 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530235.225802:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e025dce00/0xb28d70e125750758 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530235.225821:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91d600/0xb28d70e12575075f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530235.225828:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91d600/0xb28d70e12575075f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530235.225835:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91d600/0xb28d70e12575075f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788530235.228527:0:6524:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:3.0:1788530235.230412:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e125750766 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530235.230463:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e125750766 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530235.230478:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e125750766 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530235.230529:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e025dce00/0xb28d70e125750758 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530235.230537:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e025dce00/0xb28d70e125750758 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530235.230545:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e025dce00/0xb28d70e125750758 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530235.230553:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9e025dce00 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:3.0:1788530235.231779:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e025dce00/0xb28d70e125750758 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530235.231801:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e025dce00/0xb28d70e125750758 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530235.231825:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9a9f3d32ce00) 00010000:00010000:3.0:1788530235.231828:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788530235.231835:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e025dce00/0xb28d70e125750758 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530235.231842:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e025dce00/0xb28d70e125750758 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788530235.231867:0:6524:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a37c1d59 reply state 00000000bd031f43 transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91d600/0xb28d70e12575075f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530235.232057:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91d600/0xb28d70e12575075f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530235.232064:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x9bf3a51d (ffff9a9f32acf400) 00010000:00010000:3.0:1788530235.232067:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788530235.232071:0:6524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788530235.242479:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e025dcc00/0xb28d70e125750751 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550810 expref: 10 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530235.242527:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e125750766 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550810 expref: 9 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530235.242540:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9a9f32acf000) 00010000:00010000:2.0:1788530235.242544:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788530235.242549:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f00031e00, rc 0) 00000100:00100000:2.0:1788530235.245451:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03737100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+10:10506:x1875409531593088:12345-192.168.202.41@tcp:101:touch.500 Request processed in 22046us (22407us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1788530235.245470:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 30 00000100:00100000:2.0:1788530235.252092:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530235.252301:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531593344 00000100:00100000:3.0:1788530235.252312:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531593344 00000100:00100000:3.0:1788530235.252407:0:10719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 31 00000100:00100000:3.0:1788530235.252418:0:10719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e035f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+10:10506:x1875409531593344:12345-192.168.202.41@tcp:36:touch.500 00010000:00010000:3.0:1788530235.252481:0:10719:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788530235.252523:0:10719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e125750766 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550810 expref: 10 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530235.252554:0:10719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9a9f32acf000) 00010000:00010000:3.0:1788530235.252604:0:10719:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788530235.252685:0:10719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e125750774 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530235.252703:0:10719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e125750774 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530235.252716:0:10719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e125750774 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788530235.252893:0:10719:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e3cdee65 reply state 0000000052729f69 transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e125750774 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530235.252910:0:10719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e125750774 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530235.252933:0:10719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9a9f32acfb00) 00010000:00010000:3.0:1788530235.252936:0:10719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788530235.252941:0:10719:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788530235.253095:0:10719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e035f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+11:10506:x1875409531593344:12345-192.168.202.41@tcp:36:touch.500 Request processed in 678us (1026us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1788530235.253104:0:10719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 31 00000100:00100000:1.0:1788530235.260522:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530235.260668:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531593472 00000100:00100000:2.0:1788530235.260680:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531593472 00000100:00100000:2.0:1788530235.260754:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 32 00000100:00100000:2.0:1788530235.260765:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03690e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+11:10506:x1875409531593472:12345-192.168.202.41@tcp:101:touch.500 00010000:00010000:2.0:1788530235.260791:0:8678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530235.260819:0:8678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d400/0xb28d70e12575077b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550817 expref: -99 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530235.260908:0:8678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d400/0xb28d70e12575077b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550817 expref: 12 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530235.260924:0:8678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d400/0xb28d70e12575077b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550817 expref: 12 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530235.260945:0:8678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9a9f32acfb00) 00010000:00010000:2.0:1788530235.260948:0:8678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788530235.260953:0:8678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d20d400, rc 0) 00000100:00100000:2.0:1788530235.261084:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03690e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+12:10506:x1875409531593472:12345-192.168.202.41@tcp:101:touch.500 Request processed in 319us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530235.261092:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 32 00000100:00100000:2.0:1788530235.264849:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530235.265050:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531593600 00000100:00100000:3.0:1788530235.265060:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531593600 00000100:00100000:3.0:1788530235.265277:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 24 00000100:00100000:3.0:1788530235.265288:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e035f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2398:x1875409531593600:12345-192.168.202.41@tcp:8:touch.500 00010000:00080000:3.0:1788530235.265329:0:8436:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-OST0001: connection from aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41@192.168.202.41@tcp t0 exp 0000000000000000 cur 443 last 0 00000020:00000080:3.0:1788530235.265376:0:8436:0:(genops.c:1385:class_connect()) connect: client aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41, cookie 0xb28d70e125750782 00002000:00100000:3.0:1788530235.265391:0:8436:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41/ffff9a9f373f3000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a05 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788530235.265407:0:8436:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788530235.265520:0:8436:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788530235.265552:0:8436:0:(import.c:65:import_set_state_nolock()) ffff9a9f37415000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788530235.265685:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e035f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:2398:x1875409531593600:12345-192.168.202.41@tcp:8:touch.500 Request processed in 397us (846us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530235.265694:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 24 00000100:00100000:2.0:1788530235.271807:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530235.275743:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531593728 00000100:00100000:1.0:1788530235.275764:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531593728 00000100:00100000:1.0:1788530235.276045:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 25 00000100:00100000:1.0:1788530235.276059:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e035f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:0:x1875409531593728:12345-192.168.202.41@tcp:2:touch.500 00000100:00080000:0.0:1788530235.277739:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1788530235.279782:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000001:00100000:3.0:1788530235.279800:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41 00000100:00100000:1.0:1788530235.281949:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e035f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:0:x1875409531593728:12345-192.168.202.41@tcp:2:touch.500 Request processed in 5878us (10137us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788530235.281967:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 25 00000100:00100000:1.0:1788530235.287972:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530235.288193:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531593984 00000100:00100000:0.0:1788530235.288209:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531593984 00000100:00100000:0.0:1788530235.288277:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 2 00000100:00100000:0.0:1788530235.288287:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03693100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+12:10506:x1875409531593984:12345-192.168.202.41@tcp:35:touch.500 00000100:00100000:0.0:1788530235.288670:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03693100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+13:10506:x1875409531593984:12345-192.168.202.41@tcp:35:touch.500 Request processed in 384us (710us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788530235.288679:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 2 00000100:00100000:0.0:1788530235.304306:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530235.304959:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531594112 00000100:00100000:2.0:1788530235.304974:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531594112 00000100:00100000:2.0:1788530235.305057:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 33 00000100:00100000:2.0:1788530235.305068:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03737b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+13:10507:x1875409531594112:12345-192.168.202.41@tcp:101:rm.0 00010000:00010000:2.0:1788530235.305107:0:10720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530235.305145:0:10720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ce00/0xb28d70e125750789 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a55081e expref: -99 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530235.305218:0:10720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d000/0xb28d70e125750790 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530235.305232:0:10720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d000/0xb28d70e125750790 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530235.305245:0:10720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d000/0xb28d70e125750790 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788530235.305286:0:10720:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788530235.305289:0:10720:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788530235.305326:0:10720:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d000/0xb28d70e125750790 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530235.305365:0:10720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ce00/0xb28d70e125750789 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a55081e expref: 15 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530235.305386:0:10720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d000/0xb28d70e125750790 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a55081e expref: 14 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530235.305396:0:10720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9a9f3d32ce00) 00010000:00010000:2.0:1788530235.305399:0:10720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788530235.305403:0:10720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d20d000, rc 0) 00000100:00100000:2.0:1788530235.308851:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03737b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+14:10507:x1875409531594112:12345-192.168.202.41@tcp:101:rm.0 Request processed in 3759us (4533us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530235.308872:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 33 00000100:00100000:2.0:1788530235.315390:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530235.315527:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531594368 00000100:00100000:3.0:1788530235.315538:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531594368 00000100:00100000:3.0:1788530235.315656:0:10719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 34 00000100:00100000:3.0:1788530235.315668:0:10719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e035f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+14:10507:x1875409531594368:12345-192.168.202.41@tcp:101:rm.0 00010000:00010000:3.0:1788530235.315700:0:10719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788530235.315719:0:10719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030400/0xb28d70e125750797 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550825 expref: -99 pid: 10719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788530235.315854:0:10719:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788530235.316215:0:10719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030400/0xb28d70e125750797 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550825 expref: 16 pid: 10719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530235.316235:0:10719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a9f32acfd00) 00010000:00010000:3.0:1788530235.316238:0:10719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788530235.316245:0:10719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030400/0xb28d70e125750797 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550825 expref: 16 pid: 10719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530235.316266:0:10719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f00030400, rc 0) 00000100:00100000:3.0:1788530235.316342:0:10719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e035f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+15:10507:x1875409531594368:12345-192.168.202.41@tcp:101:rm.0 Request processed in 677us (964us total) trans 4294967305 rc 301/301 00000100:00100000:3.0:1788530235.316351:0:10719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 34 00000100:00100000:1.0:1788530235.326510:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530235.327178:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531594496 00000100:00100000:0.0:1788530235.327194:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531594496 00000100:00100000:0.0:1788530235.327309:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 3 00000100:00100000:0.0:1788530235.327322:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03693b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+15:10507:x1875409531594496:12345-192.168.202.41@tcp:37:rm.0 00000100:00100000:0.0:1788530235.332263:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03693b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+15:10507:x1875409531594496:12345-192.168.202.41@tcp:37:rm.0 Request processed in 4930us (5753us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530235.332281:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 3 00000100:00100000:2.0:1788530235.334954:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530235.335114:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531594752 00000100:00100000:1.0:1788530235.335126:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531594752 00000100:00100000:1.0:1788530235.335173:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 4 00000100:00100000:1.0:1788530235.335183:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3959e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+15:10507:x1875409531594752:12345-192.168.202.41@tcp:35:rm.0 00000100:00100000:1.0:1788530235.335443:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3959e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+16:10507:x1875409531594752:12345-192.168.202.41@tcp:35:rm.0 Request processed in 260us (497us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788530235.335452:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 4 00000100:00100000:2.0:1788530235.352944:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530235.353054:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531595008 00000100:00100000:0.0:1788530235.353064:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531595008 00000100:00100000:0.0:1788530235.353153:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 35 00000100:00100000:0.0:1788530235.353164:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0263e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+16:10507:x1875409531595008:12345-192.168.202.41@tcp:101:rm.0 00010000:00010000:0.0:1788530235.353187:0:8678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530235.353208:0:8678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b400/0xb28d70e1257507a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a55082c expref: -99 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530235.353317:0:8678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e1257507ac lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530235.353350:0:8678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e1257507ac lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530235.353374:0:8678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e1257507ac lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788530235.353387:0:8678:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788530235.353527:0:8678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b400/0xb28d70e1257507a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a55082c expref: 19 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530235.353547:0:8678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e1257507ac lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a55082c expref: 18 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530235.353557:0:8678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9a9f3d32ce00) 00010000:00010000:0.0:1788530235.353991:0:8678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788530235.353996:0:8678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d36b800, rc 0) 00000100:00100000:0.0:1788530235.354235:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0263e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+18:10507:x1875409531595008:12345-192.168.202.41@tcp:101:rm.0 Request processed in 1072us (1302us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788530235.354244:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 35 00000100:00100000:3.0:1788530235.362513:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530235.365970:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531595136 00000100:00100000:0.0:1788530235.366001:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531595136 00000100:00100000:0.0:1788530235.366922:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 36 00000100:00100000:0.0:1788530235.366944:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37364700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+18:10507:x1875409531595136:12345-192.168.202.41@tcp:41:rm.0 00000004:00000024:0.0:1788530235.367040:0:10720:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847026688 avail 7383982080 00000100:00100000:0.0:1788530235.367162:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37364700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+18:10507:x1875409531595136:12345-192.168.202.41@tcp:41:rm.0 Request processed in 227us (4666us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530235.367171:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 36 00000100:00100000:3.0:1788530235.370307:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530235.370373:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530235.370439:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531595264 00000100:00100000:1.0:1788530235.370452:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531595264 00000100:00100000:1.0:1788530235.370519:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 392 00000100:00100000:1.0:1788530235.370530:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f442bcd-b742-4e76-ad7b-709f731358a0+14:2401:x1875409531595264:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1788530235.370647:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f442bcd-b742-4e76-ad7b-709f731358a0+14:2401:x1875409531595264:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 119us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530235.370654:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 392 00000100:00100000:3.0:1788530235.371848:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530235.375979:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531595520 00000100:00100000:2.0:1788530235.376008:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531595520 00000100:00100000:2.0:1788530235.376343:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 261 00000100:00100000:2.0:1788530235.376370:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37409180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2401:x1875409531595520:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1788530235.376487:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37409180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2401:x1875409531595520:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 130us (6112us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530235.376495:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 261 00000100:00100000:3.0:1788530235.381002:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00080000:1.0:1788530235.381083:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788530235.381809:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530235.385687:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531595392 00000100:00100000:0.0:1788530235.385709:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531595392 00000100:00100000:0.0:1788530235.385855:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531595648 00000100:00100000:0.0:1788530235.385859:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531595648 00000100:00080000:1.0:1788530235.386070:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788530235.386215:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 262 00000100:00100000:0.0:1788530235.386228:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0231e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2401:x1875409531595392:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1788530235.386343:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0231e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2401:x1875409531595392:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 117us (14501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530235.386351:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 262 00000100:00100000:0.0:1788530235.386386:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 263 00000100:00100000:0.0:1788530235.386393:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0231d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2401:x1875409531595648:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1788530235.386421:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0231d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2401:x1875409531595648:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 28us (5433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530235.386428:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 263 00000100:00100000:0.0:1788530235.387947:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531595776 00000100:00100000:0.0:1788530235.387961:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531595776 00000100:00100000:0.0:1788530235.388032:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 37 00000100:00100000:0.0:1788530235.388041:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+18:10507:x1875409531595776:12345-192.168.202.41@tcp:101:rm.0 00010000:00010000:0.0:1788530235.388058:0:10720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530235.388364:0:10720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e1257507ba lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550833 expref: -99 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530235.388450:0:10720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100200/0xb28d70e1257507c1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530235.388470:0:10720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100200/0xb28d70e1257507c1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530235.388514:0:10720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100200/0xb28d70e1257507c1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530235.388529:0:10720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101600/0xb28d70e1257507c8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530235.388537:0:10720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101600/0xb28d70e1257507c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530235.388543:0:10720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101600/0xb28d70e1257507c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530235.389025:0:10720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100800/0xb28d70e1257507cf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530235.389036:0:10720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100800/0xb28d70e1257507cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530235.389044:0:10720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100800/0xb28d70e1257507cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788530235.389268:0:10720:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788530235.389274:0:10720:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788530235.389303:0:10720:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100800/0xb28d70e1257507cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530235.389319:0:10720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100800/0xb28d70e1257507cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530235.389330:0:10720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100200/0xb28d70e1257507c1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530235.389351:0:10720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100200/0xb28d70e1257507c1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530235.389372:0:10720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100200/0xb28d70e1257507c1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530235.389380:0:10720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d100200 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:0.0:1788530235.389386:0:10720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100200/0xb28d70e1257507c1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530235.389397:0:10720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100200/0xb28d70e1257507c1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530235.389416:0:10720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9a9f3d32ce00) 00010000:00010000:0.0:1788530235.389420:0:10720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788530235.389427:0:10720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100200/0xb28d70e1257507c1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530235.389433:0:10720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100200/0xb28d70e1257507c1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530235.389453:0:10720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101600/0xb28d70e1257507c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530235.389460:0:10720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101600/0xb28d70e1257507c8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530235.389466:0:10720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101600/0xb28d70e1257507c8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530235.389473:0:10720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d101600 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:0.0:1788530235.389483:0:10720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101600/0xb28d70e1257507c8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530235.389490:0:10720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101600/0xb28d70e1257507c8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530235.389500:0:10720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x9bf3a51d (ffff9a9f32acf400) 00010000:00010000:0.0:1788530235.389503:0:10720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788530235.389507:0:10720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101600/0xb28d70e1257507c8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530235.389514:0:10720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101600/0xb28d70e1257507c8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530235.390263:0:10720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e1257507ba lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550833 expref: 20 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530235.390297:0:10720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100800/0xb28d70e1257507cf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550833 expref: 19 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530235.390306:0:10720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9a9f32acfb00) 00010000:00010000:0.0:1788530235.390309:0:10720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788530235.390312:0:10720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d100800, rc 0) 00000100:00100000:1.0:1788530235.392822:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+19:10507:x1875409531595776:12345-192.168.202.41@tcp:101:rm.0 Request processed in 4766us (11001us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530235.392838:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 37 00000100:00100000:1.0:1788530235.405834:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530235.408862:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531596032 00000100:00100000:0.0:1788530235.408950:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531596032 00000100:00100000:1.0:1788530235.411929:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 38 00000100:00100000:1.0:1788530235.411946:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03693100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+19:10507:x1875409531596032:12345-192.168.202.41@tcp:36:rm.0 00010000:00010000:1.0:1788530235.412013:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788530235.412044:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100800/0xb28d70e1257507cf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550833 expref: 19 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530235.412069:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d400/0xb28d70e12575077b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550817 expref: 18 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530235.413837:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9a9f32acfb00) 00010000:00010000:1.0:1788530235.413901:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d000/0xb28d70e125750790 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a55081e expref: 17 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530235.413915:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9a9f3d32ce00) 00010000:00010000:1.0:1788530235.413938:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788530235.413968:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167e00/0xb28d70e1257507d6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530235.413983:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167e00/0xb28d70e1257507d6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530235.413995:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167e00/0xb28d70e1257507d6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530235.414006:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167600/0xb28d70e1257507dd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530235.414013:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167600/0xb28d70e1257507dd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530235.414019:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167600/0xb28d70e1257507dd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530235.414151:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166000/0xb28d70e1257507e4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530235.414162:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166000/0xb28d70e1257507e4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530235.414170:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166000/0xb28d70e1257507e4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788530235.414487:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:1.0:1788530235.414501:0:6525:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 443316938719ns, next at 444316935431ns, rc = 0 00010000:00010000:1.0:1788530235.414854:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166400/0xb28d70e1257507eb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530235.415389:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166400/0xb28d70e1257507eb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530235.415404:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166400/0xb28d70e1257507eb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530235.415414:0:6525:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166400/0xb28d70e1257507eb lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530235.415420:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166400/0xb28d70e1257507eb lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530235.415427:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166400/0xb28d70e1257507eb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530235.415531:0:6525:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788530235.415556:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166000/0xb28d70e1257507e4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530235.415590:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166000/0xb28d70e1257507e4 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530235.415597:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166000/0xb28d70e1257507e4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530235.415604:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f42166000 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:1.0:1788530235.415609:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166000/0xb28d70e1257507e4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530235.415692:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166000/0xb28d70e1257507e4 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530235.415717:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9a9f32acfb00) 00010000:00010000:1.0:1788530235.415721:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788530235.415726:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166000/0xb28d70e1257507e4 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530235.415732:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166000/0xb28d70e1257507e4 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530235.415756:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167e00/0xb28d70e1257507d6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530235.415762:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167e00/0xb28d70e1257507d6 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530235.415769:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167e00/0xb28d70e1257507d6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530235.415774:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f42167e00 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:1.0:1788530235.415778:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167e00/0xb28d70e1257507d6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530235.415784:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167e00/0xb28d70e1257507d6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530235.415792:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9a9f3d32ce00) 00010000:00010000:1.0:1788530235.415794:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788530235.415797:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167e00/0xb28d70e1257507d6 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530235.415803:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167e00/0xb28d70e1257507d6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788530235.415824:0:6525:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000abcc7ca4 reply state 00000000b03b0c37 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167600/0xb28d70e1257507dd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530235.415836:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167600/0xb28d70e1257507dd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530235.415843:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x9bf3a51d (ffff9a9f32acf400) 00010000:00010000:1.0:1788530235.415845:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788530235.415848:0:6525:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788530235.415971:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03693100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+18:10507:x1875409531596032:12345-192.168.202.41@tcp:36:rm.0 Request processed in 4024us (10148us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1788530235.415982:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 38 00010000:00010000:3.0:1788530235.420094:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788530235.420113:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166400/0xb28d70e1257507eb lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530235.420128:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f42166400 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:3.0:1788530235.420152:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166400/0xb28d70e1257507eb lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530235.420164:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166400/0xb28d70e1257507eb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530235.420184:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9a9f32acfb00) 00010000:00010000:3.0:1788530235.420187:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788530235.420192:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166400/0xb28d70e1257507eb lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530235.420198:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166400/0xb28d70e1257507eb lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530235.420217:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530235.420220:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530235.420221:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788530235.424950:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530235.425293:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531596288 00000100:00100000:1.0:1788530235.425304:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531596288 00000100:00100000:1.0:1788530235.425364:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 5 00000100:00100000:1.0:1788530235.425376:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03735180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+18:10507:x1875409531596288:12345-192.168.202.41@tcp:35:rm.0 00000100:00100000:1.0:1788530235.425765:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03735180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+19:10507:x1875409531596288:12345-192.168.202.41@tcp:35:rm.0 Request processed in 389us (829us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788530235.425772:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 5 00000100:00100000:2.0:1788530235.431813:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530235.432058:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531596544 00000100:00100000:1.0:1788530235.432070:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531596544 00000100:00100000:1.0:1788530235.432211:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 39 00000100:00100000:1.0:1788530235.432222:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0263fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+19:10507:x1875409531596544:12345-192.168.202.41@tcp:36:rm.0 00010000:00010000:1.0:1788530235.432284:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788530235.432323:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e1257507ac lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a55082c expref: 19 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530235.432387:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36be00/0xb28d70e12575074a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550809 expref: 18 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530235.432399:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9a9f3d32ce00) 00010000:00010000:1.0:1788530235.432416:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d600/0xb28d70e12575070b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5507fb expref: 17 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530235.432425:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a9f32acfd00) 00010000:00010000:1.0:1788530235.432435:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788530235.432464:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167e00/0xb28d70e1257507f2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530235.432477:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167e00/0xb28d70e1257507f2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530235.432486:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167e00/0xb28d70e1257507f2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530235.432498:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166000/0xb28d70e1257507f9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530235.432504:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166000/0xb28d70e1257507f9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530235.432510:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166000/0xb28d70e1257507f9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530235.434144:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167200/0xb28d70e125750800 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530235.434188:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167200/0xb28d70e125750800 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530235.434200:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167200/0xb28d70e125750800 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788530235.434499:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788530235.434515:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167200/0xb28d70e125750800 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530235.434523:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167200/0xb28d70e125750800 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530235.434529:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167200/0xb28d70e125750800 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530235.434536:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f42167200 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:1.0:1788530235.434540:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167200/0xb28d70e125750800 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530235.434548:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167200/0xb28d70e125750800 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530235.434597:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9a9f32abdd00) 00010000:00010000:1.0:1788530235.434600:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788530235.434605:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167200/0xb28d70e125750800 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530235.434611:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167200/0xb28d70e125750800 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530235.435760:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167e00/0xb28d70e1257507f2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530235.435788:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167e00/0xb28d70e1257507f2 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530235.435796:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167e00/0xb28d70e1257507f2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530235.435804:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f42167e00 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:1.0:1788530235.435810:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167e00/0xb28d70e1257507f2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530235.435818:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167e00/0xb28d70e1257507f2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530235.435834:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a9f32abd400) 00010000:00010000:1.0:1788530235.435837:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788530235.435841:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167e00/0xb28d70e1257507f2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530235.435848:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167e00/0xb28d70e1257507f2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788530235.435864:0:6524:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000082d03399 reply state 0000000077940b9f transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166000/0xb28d70e1257507f9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530235.436138:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166000/0xb28d70e1257507f9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530235.436149:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9a9f32abd000) 00010000:00010000:1.0:1788530235.436152:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788530235.436157:0:6524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788530235.440875:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0263fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+18:10507:x1875409531596544:12345-192.168.202.41@tcp:36:rm.0 Request processed in 8633us (9050us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1788530235.440911:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 39 00000100:00100000:2.0:1788530235.457396:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37374380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555811456:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788530235.457507:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530235.457919:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555811456 00000100:00100000:3.0:1788530235.457935:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555811456 00000100:00100000:3.0:1788530235.458015:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788530235.458029:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0263ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555811456:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788530235.458226:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446453248 avail 1300213760 00000100:00100000:3.0:1788530235.458309:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0263ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555811456:12345-0@lo:41:osp-pre-1-0.0 Request processed in 282us (803us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530235.458318:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788530235.458591:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37374380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555811456:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788530235.584895:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530236.609445:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530237.632727:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530238.657855:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788530239.050809:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788530239.050833:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37375180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555811584:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788530239.050920:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530239.051390:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555811584 00000100:00100000:3.0:1788530239.051399:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555811584 00000100:00100000:3.0:1788530239.051461:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788530239.051473:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03736680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555811584:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788530239.051540:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788530239.051775:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03736680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555811584:12345-0@lo:41:osp-pre-0-1.0 Request processed in 304us (855us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530239.051783:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788530239.051897:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37375180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555811584:0@lo:41:osp-pre-0-1.0 00000004:00080000:3.0:1788530239.553381:0:9907:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 447455816700ns, next at 448455813679ns, rc = 0 00000100:00100000:3.0:1788530239.553414:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37376680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555811968:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788530239.554143:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530239.554268:0:9912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555811968 00000100:00100000:2.0:1788530239.554282:0:9912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555811968 00000100:00100000:2.0:1788530239.554383:0:9912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788530239.554398:0:9912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37375180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555811968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788530239.554438:0:9912:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788530239.554509:0:9912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37375180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555811968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530239.554517:0:9912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00010000:00080000:3.0:1788530239.555842:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f37376680 x1875409555811968/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530255 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530239.555872:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37376680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555811968:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788530239.555904:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0263d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555812480:0@lo:400:kworker.0 00000100:00100000:3.0:1788530239.555965:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530239.556007:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0263c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875409555812992:0@lo:400:kworker.0 00000100:00100000:3.0:1788530239.556048:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530239.556071:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3960dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875409555813504:0@lo:400:kworker.0 00000100:00100000:3.0:1788530239.556095:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530239.556119:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:3.0:1788530239.556126:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37377100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555811840:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788530239.556180:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530239.556205:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0263c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875409555812352:0@lo:400:kworker.0 00000100:00100000:3.0:1788530239.556229:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530239.556247:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0263ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875409555812864:0@lo:400:kworker.0 00000100:00100000:3.0:1788530239.556269:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530239.556297:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3960d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875409555813376:0@lo:400:kworker.0 00000100:00100000:3.0:1788530239.556332:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530239.556369:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555811840 00000100:00100000:3.0:1788530239.556377:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555811840 00000100:00100000:3.0:1788530239.556426:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788530239.556436:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555811840:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788530239.556458:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788530239.556514:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555811840:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530239.556521:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788530239.556548:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555812992 00000100:00100000:3.0:1788530239.556552:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555812992 00000100:00100000:3.0:1788530239.556653:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555813504 00000100:00100000:3.0:1788530239.556657:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555813504 00000100:00100000:3.0:1788530239.556673:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555812352 00000100:00100000:3.0:1788530239.556676:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555812352 00000100:00100000:3.0:1788530239.556688:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555812864 00000100:00100000:3.0:1788530239.556690:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555812864 00000100:00100000:3.0:1788530239.556703:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555813376 00000100:00100000:3.0:1788530239.556705:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555813376 00000100:00100000:3.0:1788530239.556720:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1788530239.556727:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37374380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875409555812992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530239.556759:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37374380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875409555812992:12345-0@lo:400:kworker.0 Request processed in 32us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530239.556766:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1788530239.556777:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1788530239.556783:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875409555813504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530239.556811:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875409555813504:12345-0@lo:400:kworker.0 Request processed in 28us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530239.556823:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1788530239.556836:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1788530239.556842:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875409555812352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530239.556875:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875409555812352:12345-0@lo:400:kworker.0 Request processed in 33us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530239.556881:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1788530239.556892:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1788530239.556898:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875409555812864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530239.556926:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875409555812864:12345-0@lo:400:kworker.0 Request processed in 28us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530239.556933:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1788530239.556943:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1788530239.556949:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875409555813376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530239.556976:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875409555813376:12345-0@lo:400:kworker.0 Request processed in 28us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530239.556983:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00010000:00080000:3.0:1788530239.557032:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f37377100 x1875409555811840/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530255 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530239.557055:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37377100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555811840:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788530239.557070:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0263c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875409555812352:0@lo:400:kworker.0 00000100:00100000:3.0:1788530239.557081:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0263ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875409555812864:0@lo:400:kworker.0 00000100:00100000:3.0:1788530239.557090:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3960d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875409555813376:0@lo:400:kworker.0 00010000:00080000:3.0:1788530239.557101:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e0263c000 x1875409555812992/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530255 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530239.557118:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0263c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875409555812992:0@lo:400:kworker.0 00010000:00080000:3.0:1788530239.557130:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f3960dc00 x1875409555813504/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530255 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530239.557139:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3960dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875409555813504:0@lo:400:kworker.0 00000100:00100000:2.0:1788530239.561061:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555812480 00000100:00100000:2.0:1788530239.561088:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555812480 00000100:00100000:2.0:1788530239.561220:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788530239.561235:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37376680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555812480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530239.561384:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37376680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555812480:12345-0@lo:400:kworker.0 Request processed in 152us (5419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530239.561405:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:2.0:1788530239.562024:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788530239.562033:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788530239.562048:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788530239.562075:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0263ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555812096:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788530239.562126:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530239.562166:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0263f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875409555812608:0@lo:400:kworker.0 00000100:00100000:2.0:1788530239.562191:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530239.562208:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0263d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555813120:0@lo:400:kworker.0 00000100:00100000:2.0:1788530239.562231:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530239.562250:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3960fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555813632:0@lo:400:kworker.0 00000100:00100000:2.0:1788530239.562267:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530239.562286:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1788530239.562292:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0263df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555811712:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788530239.562309:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530239.562337:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0263d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3649:1875409555812224:0@lo:400:kworker.0 00000100:00100000:2.0:1788530239.562366:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530239.562388:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0263e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555812736:0@lo:400:kworker.0 00000100:00100000:2.0:1788530239.562412:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530239.562429:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0263f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555813248:0@lo:400:kworker.0 00000100:00100000:2.0:1788530239.562446:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530239.562739:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555812224 00000100:00100000:2.0:1788530239.562746:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555812224 00000100:00100000:2.0:1788530239.562800:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:2.0:1788530239.562811:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:3649:x1875409555812224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530239.562888:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:3649:x1875409555812224:12345-0@lo:400:kworker.0 Request processed in 78us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530239.562897:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:2.0:1788530239.562933:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555812736 00000100:00100000:2.0:1788530239.562937:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555812736 00000100:00100000:2.0:1788530239.562958:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788530239.562965:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3960f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555812736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530239.563000:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3960f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555812736:12345-0@lo:400:kworker.0 Request processed in 36us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530239.563007:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788530239.563029:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555813120 00000100:00100000:2.0:1788530239.563033:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555813120 00000100:00100000:2.0:1788530239.563146:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555813632 00000100:00100000:2.0:1788530239.563151:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555813632 00000100:00100000:2.0:1788530239.563167:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555813248 00000100:00100000:2.0:1788530239.563170:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555813248 00000100:00100000:2.0:1788530239.563189:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788530239.563196:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3960c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555813120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530239.563235:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3960c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555813120:12345-0@lo:400:kworker.0 Request processed in 40us (1003us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530239.563243:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788530239.563256:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788530239.563263:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3960ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555813632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530239.563293:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3960ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555813632:12345-0@lo:400:kworker.0 Request processed in 31us (1025us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530239.563299:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788530239.563309:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788530239.563338:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3960d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555813248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530239.563371:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3960d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555813248:12345-0@lo:400:kworker.0 Request processed in 37us (924us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530239.563377:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788530239.563418:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0263d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3649:1875409555812224:0@lo:400:kworker.0 00000100:00100000:2.0:1788530239.563433:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0263e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555812736:0@lo:400:kworker.0 00010000:00080000:2.0:1788530239.563446:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e0263f100 x1875409555813248/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788530255 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530239.563456:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0263f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555813248:0@lo:400:kworker.0 00010000:00080000:2.0:1788530239.563466:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e0263d880 x1875409555813120/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788530255 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530239.563747:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555812096 00000100:00100000:3.0:1788530239.563752:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555812096 00000100:00100000:3.0:1788530239.563776:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555811712 00000100:00100000:3.0:1788530239.563779:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555811712 00000100:00100000:3.0:1788530239.563792:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788530239.563799:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3960ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555812096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788530239.563832:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788530239.563882:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3960ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555812096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (1757us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530239.563889:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788530239.563903:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788530239.563909:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3960f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555811712:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788530239.563920:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788530239.563945:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3960f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555811712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 36us (1634us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530239.563950:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788530239.563971:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555812608 00000100:00100000:3.0:1788530239.563974:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555812608 00000100:00100000:3.0:1788530239.564017:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1788530239.564023:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3960e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875409555812608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530239.564103:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3960e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875409555812608:12345-0@lo:400:kworker.0 Request processed in 79us (1909us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530239.564110:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1788530239.564157:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0263d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555812480:0@lo:400:kworker.0 00000100:00100000:2.0:1788530239.564311:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0263d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555813120:0@lo:400:kworker.0 00010000:00080000:2.0:1788530239.564339:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f3960fb80 x1875409555813632/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788530255 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530239.564348:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3960fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555813632:0@lo:400:kworker.0 00010000:00080000:2.0:1788530239.564375:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e0263df80 x1875409555811712/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530255 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530239.564391:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0263df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555811712:0@lo:13:osp-pre-0-1.0 00010000:00080000:2.0:1788530239.564401:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e0263ca80 x1875409555812096/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530255 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530239.564412:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0263ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555812096:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788530239.564422:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0263f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875409555812608:0@lo:400:kworker.0 00000100:00080000:2.0:1788530239.564454:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788530239.684919:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788530240.489970:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530240.490017:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530240.490054:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530240.490090:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530240.490111:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530240.490140:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530240.490175:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531597056 00000100:00100000:2.0:1788530240.490191:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531597056 00000100:00100000:2.0:1788530240.490277:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 78 00000100:00100000:2.0:1788530240.490290:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3960dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2401:x1875409531597056:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1788530240.490390:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3960dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2401:x1875409531597056:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 103us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530240.490398:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 78 00000100:00080000:2.0:1788530240.490422:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788530240.491143:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531596672 00000100:00100000:1.0:1788530240.491153:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531596672 00000100:00100000:1.0:1788530240.491198:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 394 00000100:00100000:1.0:1788530240.491206:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f442bcd-b742-4e76-ad7b-709f731358a0+14:2401:x1875409531596672:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1788530240.493132:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531596928 00000100:00100000:0.0:1788530240.493148:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531596928 00000100:00100000:0.0:1788530240.493266:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531597184 00000100:00100000:0.0:1788530240.493270:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531597184 00000100:00100000:0.0:1788530240.493295:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531596800 00000100:00100000:0.0:1788530240.493298:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531596800 00000100:00100000:0.0:1788530240.493320:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531597312 00000100:00100000:0.0:1788530240.493324:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531597312 00000100:00100000:0.0:1788530240.493341:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 270 00000100:00100000:0.0:1788530240.493350:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3960fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2401:x1875409531596928:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1788530240.493441:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 271 00000100:00100000:2.0:1788530240.493449:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3960e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2401:x1875409531597184:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1788530240.493669:0:10719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 272 00000100:00100000:3.0:1788530240.493680:0:10719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3960ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+18:2401:x1875409531596800:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1788530240.499779:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f442bcd-b742-4e76-ad7b-709f731358a0+14:2401:x1875409531596672:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 8545us (9792us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530240.499804:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 394 00000100:00100000:1.0:1788530240.500098:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 273 00000100:00100000:1.0:1788530240.500115:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3960d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2401:x1875409531597312:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1788530240.500187:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3960d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2401:x1875409531597312:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 79us (10045us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530240.500193:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 273 00000100:00080000:1.0:1788530240.500253:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788530240.500259:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788530240.501168:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3960fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2401:x1875409531596928:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 7811us (11143us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530240.501180:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 270 00000100:00100000:2.0:1788530240.501680:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3960e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2401:x1875409531597184:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 8229us (11622us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530240.501690:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 271 00000100:00100000:3.0:1788530240.507742:0:10719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3960ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+18:2401:x1875409531596800:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 14040us (17627us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530240.507766:0:10719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 272 00000100:00100000:0.0:1788530240.578581:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788530240.578609:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555813760:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788530240.578692:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530240.578857:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555813760 00000100:00100000:2.0:1788530240.578866:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555813760 00000100:00100000:2.0:1788530240.578917:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788530240.578927:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03735880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555813760:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788530240.578965:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446453248 avail 1300213760 00000100:00100000:2.0:1788530240.579024:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03735880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555813760:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530240.579046:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788530240.579394:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555813760:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788530240.705684:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788530241.090319:0:6502:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:2.0:1788530241.090366:0:6502:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:2.0:1788530241.090377:0:6502:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00010000:00010000:3.0:1788530241.090597:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91d600/0xb28d70e12575075f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530241.090611:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91d600/0xb28d70e12575075f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530241.090623:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91d600/0xb28d70e12575075f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530241.090630:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f0c91d600 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:3.0:1788530241.090637:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91d600/0xb28d70e12575075f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530241.090647:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91d600/0xb28d70e12575075f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530241.090668:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x9bf3a51d (ffff9a9f32acf400) 00010000:00010000:3.0:1788530241.090673:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788530241.090695:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91d600/0xb28d70e12575075f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530241.090703:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91d600/0xb28d70e12575075f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530241.090739:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e125750774 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530241.090747:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e125750774 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530241.090752:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e125750774 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530241.090757:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f00031800 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:3.0:1788530241.090760:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e125750774 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530241.090765:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e125750774 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530241.090775:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9a9f32acfb00) 00010000:00010000:3.0:1788530241.090777:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788530241.090780:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e125750774 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530241.090785:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e125750774 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530241.090813:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167600/0xb28d70e1257507dd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530241.090830:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167600/0xb28d70e1257507dd lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530241.090837:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167600/0xb28d70e1257507dd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530241.090842:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f42167600 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:3.0:1788530241.090845:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167600/0xb28d70e1257507dd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530241.090858:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167600/0xb28d70e1257507dd lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530241.090868:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x9bf3a51d (ffff9a9f32acf400) 00010000:00010000:3.0:1788530241.090870:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788530241.090873:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167600/0xb28d70e1257507dd lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530241.090879:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167600/0xb28d70e1257507dd lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x9bf3a51d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530241.090897:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166000/0xb28d70e1257507f9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530241.090902:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166000/0xb28d70e1257507f9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530241.090908:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166000/0xb28d70e1257507f9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530241.090913:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f42166000 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:3.0:1788530241.090920:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166000/0xb28d70e1257507f9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530241.090926:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166000/0xb28d70e1257507f9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530241.090932:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9a9f32abd000) 00010000:00010000:3.0:1788530241.090934:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788530241.090937:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166000/0xb28d70e1257507f9 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530241.090942:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166000/0xb28d70e1257507f9 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530241.090969:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788530241.090991:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03693b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555813888:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788530241.091201:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530241.091367:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555813888 00000100:00100000:1.0:1788530241.091380:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555813888 00000100:00100000:1.0:1788530241.091444:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788530241.091454:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555813888:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788530241.091494:0:8752:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:1.0:1788530241.091533:0:8752:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x6a9ace3a, atime: 0x6a9ace3a, ctime: 0x6a9ace3a, blocks: 0x0 00010000:00010000:1.0:1788530241.091540:0:8752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067543d74/0xb28d70e125750807 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530241.091555:0:8752:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=448s v=(0 0) 00010000:00010000:1.0:1788530241.091593:0:8752:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788530241.091608:0:8752:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067543d74/0xb28d70e125750807 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530241.091629:0:8752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000067543d74/0xb28d70e125750807 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530241.091638:0:8752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067543d74/0xb28d70e125750807 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530241.091646:0:8752:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000067543d74/0xb28d70e125750807 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530241.091667:0:8752:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788530241.092025:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3648:x1875409555813888:12345-0@lo:6:osp-syn-1-0.0 Request processed in 572us (951us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788530241.092033:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:1.0:1788530241.092057:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788530241.092070:0:10348:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000004:00080000:3.0:1788530241.092657:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a9e03693b80/2, rc 0, transno 4294967301 00000100:00100000:3.0:1788530241.092664:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03693b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555813888:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1788530241.092711:0:10348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000067543d74/0xb28d70e125750807 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530241.092723:0:10348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f42167800 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:1.0:1788530241.092727:0:10348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000067543d74/0xb28d70e125750807 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530241.092737:0:10348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000067543d74/0xb28d70e125750807 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530241.092767:0:10348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000067543d74/0xb28d70e125750807 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530241.092773:0:10348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000067543d74/0xb28d70e125750807 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530241.092793:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530241.092795:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530241.092797:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530241.730750:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788530241.805699:0:13698:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:3.0:1788530242.752650:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788530242.977207:0:13746:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd93c057e0 20000000:00000080:0.0:1788530242.977228:0:13746:0:(mgs_handler.c:1172:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a9e0257c400 uarg=0000000000000000 20000000:01000000:0.0:1788530242.977275:0:13746:0:(mgs_llog.c:6198:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1788530242.977293:0:13746:0:(mgs_llog.c:4653:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1788530242.977303:0:13746:0:(mgs_llog.c:1385:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1788530242.977946:0:13747:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:0.0:1788530242.978135:0:13746:0:(mgs_llog.c:4126:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:0.0:1788530242.982338:0:13746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:0.0:1788530242.982378:0:13746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:0.0:1788530242.982393:0:13746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:0.0:1788530242.982411:0:13746:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788530242.982437:0:13746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a9f3d100400/0xb28d70e12575080e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530242.982461:0:13746:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a9e025dde00/0xb28d70e125750694 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5507e6 expref: 13 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530242.982469:0:13746:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a9e025dc800/0xb28d70e12575069b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5507ed expref: 13 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530242.982479:0:13746:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a9f3d36b000/0xb28d70e1257506a9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e1257506a2 expref: 28 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530242.982486:0:13746:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a9f3d36ac00/0xb28d70e1257506b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e1257506b0 expref: 28 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530242.982492:0:13746:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a9f3d36ae00/0xb28d70e1257506c5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e1257506be expref: 28 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530242.982499:0:13746:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a9f42167c00/0xb28d70e1257506d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e1257506cc expref: 28 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530242.982506:0:13746:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a9f3d100400/0xb28d70e12575080e lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530242.982919:0:13746:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a9f42167c00/0xb28d70e1257506d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb28d70e1257506cc expref: 28 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530242.982954:0:13746:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a9f42167c00/0xb28d70e1257506d3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb28d70e1257506cc expref: 28 pid: 6516 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530242.982973:0:13746:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03736d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13746:1875409555814016:0@lo:104: 00000100:00100000:0.0:1788530242.983068:0:13746:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788530242.983152:0:13746:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a9f3d36ae00/0xb28d70e1257506c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb28d70e1257506be expref: 28 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530242.983160:0:13746:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a9f3d36ae00/0xb28d70e1257506c5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb28d70e1257506be expref: 28 pid: 6517 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530242.983169:0:13746:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03735f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13746:1875409555814144:0@lo:104: 00000100:00100000:0.0:1788530242.983193:0:13746:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788530242.983220:0:13746:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a9f3d36ac00/0xb28d70e1257506b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb28d70e1257506b0 expref: 28 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530242.983228:0:13746:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a9f3d36ac00/0xb28d70e1257506b7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb28d70e1257506b0 expref: 28 pid: 6516 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530242.983236:0:13746:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03734700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13746:1875409555814272:0@lo:104: 00000100:00100000:0.0:1788530242.983278:0:13746:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788530242.983314:0:13746:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a9f3d36b000/0xb28d70e1257506a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb28d70e1257506a2 expref: 28 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530242.983322:0:13746:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a9f3d36b000/0xb28d70e1257506a9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb28d70e1257506a2 expref: 28 pid: 6518 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530242.983331:0:13746:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03c52300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13746:1875409555814400:0@lo:104: 00000100:00100000:0.0:1788530242.983359:0:13746:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788530242.983384:0:13746:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a9e025dc800/0xb28d70e12575069b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a5507ed expref: 13 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530242.983395:0:13746:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a9e025dc800/0xb28d70e12575069b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a5507ed expref: 13 pid: 6517 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530242.983405:0:13746:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03c50e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13746:1875409555814528:192.168.202.41@tcp:104: 00010000:00010000:0.0:1788530242.983657:0:13746:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a9e025dde00/0xb28d70e125750694 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a5507e6 expref: 13 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530242.983667:0:13746:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a9e025dde00/0xb28d70e125750694 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a5507e6 expref: 13 pid: 6517 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530242.983676:0:13746:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03c53100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13746:1875409555814656:192.168.202.41@tcp:104: 00000100:00100000:0.0:1788530242.983712:0:13746:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e0328a540 going to sleep for 11 seconds 00000100:00100000:2.0:1788530242.983894:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555814016 00000100:00100000:2.0:1788530242.983903:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555814016 00000100:00100000:2.0:1788530242.983954:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555814144 00000100:00100000:2.0:1788530242.983956:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555814144 00000100:00100000:2.0:1788530242.983965:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555814272 00000100:00100000:2.0:1788530242.983967:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555814272 00000100:00100000:2.0:1788530242.983974:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555814400 00000100:00100000:2.0:1788530242.983975:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555814400 00000100:00100000:2.0:1788530242.983988:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788530242.983997:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03737480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+6:13746:x1875409555814016:12345-0@lo:104: 00010000:00010000:2.0:1788530242.984013:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff9a9e025dca00/0xb28d70e1257506cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e1257506d3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530242.984085:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788530242.984091:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03737480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+6:13746:x1875409555814016:12345-0@lo:104: Request processed in 95us (1025us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530242.984098:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788530242.984119:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788530242.984126:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03734000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+5:13746:x1875409555814144:12345-0@lo:104: 00010000:00010000:2.0:1788530242.984134:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff9a9f18141800/0xb28d70e1257506be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e1257506c5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530242.984169:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788530242.984174:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03734000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+5:13746:x1875409555814144:12345-0@lo:104: Request processed in 50us (981us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530242.984192:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788530242.984208:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788530242.984215:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c50a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+4:13746:x1875409555814272:12345-0@lo:104: 00010000:00010000:2.0:1788530242.984223:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff9a9f18140e00/0xb28d70e1257506b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e1257506b7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530242.984259:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788530242.984264:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c50a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+4:13746:x1875409555814272:12345-0@lo:104: Request processed in 51us (987us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530242.984270:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788530242.984293:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788530242.984300:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c50380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+3:13746:x1875409555814400:12345-0@lo:104: 00010000:00010000:2.0:1788530242.984308:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff9a9e025dd600/0xb28d70e1257506a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e1257506a9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530242.984349:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788530242.984354:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c50380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+3:13746:x1875409555814400:12345-0@lo:104: Request processed in 56us (995us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530242.984359:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00010000:2.0:1788530242.984382:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788530242.984388:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9e025dca00/0xb28d70e1257506cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e1257506d3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530242.984396:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9e025dca00 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:2.0:1788530242.984401:0:6512:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9e025dca00/0xb28d70e1257506cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xb28d70e1257506d3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530242.984420:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9e025dca00/0xb28d70e1257506cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xb28d70e1257506d3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788530242.984429:0:6512:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9e025dca00/0xb28d70e1257506cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xb28d70e1257506d3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788530242.984434:0:6512:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788530242.984484:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9e025dca00/0xb28d70e1257506cc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e1257506d3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530242.984491:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788530242.984516:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9e025dca00/0xb28d70e1257506cc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e1257506d3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530242.984524:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9e025dca00/0xb28d70e1257506cc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e1257506d3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530242.984539:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788530242.984542:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f18141800/0xb28d70e1257506be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e1257506c5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530242.984547:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f18141800 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:2.0:1788530242.984550:0:6512:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f18141800/0xb28d70e1257506be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb28d70e1257506c5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530242.984557:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f18141800/0xb28d70e1257506be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb28d70e1257506c5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788530242.984591:0:6512:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f18141800/0xb28d70e1257506be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb28d70e1257506c5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788530242.984602:0:6512:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788530242.984618:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9f18141800/0xb28d70e1257506be lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e1257506c5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530242.984624:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788530242.984642:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f18141800/0xb28d70e1257506be lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e1257506c5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530242.984650:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f18141800/0xb28d70e1257506be lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e1257506c5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530242.984660:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788530242.984663:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f18140e00/0xb28d70e1257506b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e1257506b7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530242.984669:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f18140e00 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:2.0:1788530242.984671:0:6512:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f18140e00/0xb28d70e1257506b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb28d70e1257506b7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530242.984678:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f18140e00/0xb28d70e1257506b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb28d70e1257506b7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788530242.984684:0:6512:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f18140e00/0xb28d70e1257506b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb28d70e1257506b7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788530242.984689:0:6512:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788530242.984699:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9f18140e00/0xb28d70e1257506b0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e1257506b7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530242.984704:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788530242.984715:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f18140e00/0xb28d70e1257506b0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e1257506b7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530242.984720:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f18140e00/0xb28d70e1257506b0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e1257506b7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530242.984729:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788530242.984732:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9e025dd600/0xb28d70e1257506a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e1257506a9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530242.984736:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9e025dd600 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:2.0:1788530242.984739:0:6512:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9e025dd600/0xb28d70e1257506a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb28d70e1257506a9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530242.984745:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9e025dd600/0xb28d70e1257506a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb28d70e1257506a9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788530242.984751:0:6512:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9e025dd600/0xb28d70e1257506a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb28d70e1257506a9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788530242.984756:0:6512:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788530242.984766:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9e025dd600/0xb28d70e1257506a2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e1257506a9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530242.984771:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788530242.984776:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9e025dd600/0xb28d70e1257506a2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e1257506a9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530242.984782:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9e025dd600/0xb28d70e1257506a2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e1257506a9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530242.984795:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530242.984802:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530242.984803:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530242.984810:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788530242.984822:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03767800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3648:1875409555814784:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788530242.984853:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530242.984875:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788530242.984881:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03766300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3648:1875409555815168:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788530242.984903:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530242.984930:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03765880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3649:1875409555814912:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788530242.984950:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530242.984967:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788530242.984972:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03764a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3649:1875409555815040:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788530242.984991:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530242.985018:0:10347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555814784 00000100:00100000:2.0:1788530242.985023:0:10347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555814784 00010000:00010000:2.0:1788530242.985044:0:10347:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a9f42167c00/0xb28d70e1257506d3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e1257506cc expref: 29 pid: 6516 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530242.985060:0:10347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555815168 00000100:00100000:2.0:1788530242.985063:0:10347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555815168 00010000:00010000:2.0:1788530242.985074:0:10347:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a9f3d36b000/0xb28d70e1257506a9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e1257506a2 expref: 30 pid: 6518 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530242.985085:0:10347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555814912 00000100:00100000:2.0:1788530242.985088:0:10347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555814912 00010000:00010000:2.0:1788530242.985100:0:10347:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a9f3d36ae00/0xb28d70e1257506c5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e1257506be expref: 31 pid: 6517 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530242.985108:0:10347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555815040 00000100:00100000:2.0:1788530242.985110:0:10347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555815040 00010000:00010000:2.0:1788530242.985126:0:10347:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a9f3d36ac00/0xb28d70e1257506b7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e1257506b0 expref: 32 pid: 6516 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530242.985139:0:10347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788530242.985145:0:10347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f396c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+32:3648:x1875409555814784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788530242.985155:0:10347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788530242.985160:0:10347:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a9f42167c00/0xb28d70e1257506d3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e1257506cc expref: 32 pid: 6516 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530242.985171:0:10347:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a9f42167c00/0xb28d70e1257506d3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb28d70e1257506cc expref: 32 pid: 6516 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530242.985189:0:10347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788530242.985215:0:10347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f396c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+32:3648:x1875409555814784:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530242.985222:0:10347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788530242.985256:0:10347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788530242.985261:0:10347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03764380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+31:3648:x1875409555815168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788530242.985267:0:10347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788530242.985271:0:10347:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a9f3d36b000/0xb28d70e1257506a9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e1257506a2 expref: 31 pid: 6518 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530242.985280:0:10347:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a9f3d36b000/0xb28d70e1257506a9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb28d70e1257506a2 expref: 31 pid: 6518 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530242.985304:0:10347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788530242.985323:0:10347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03764380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+31:3648:x1875409555815168:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530242.985329:0:10347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788530242.985346:0:10347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788530242.985351:0:10347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03764e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+30:3649:x1875409555814912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788530242.985358:0:10347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788530242.985362:0:10347:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a9f3d36ae00/0xb28d70e1257506c5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e1257506be expref: 30 pid: 6517 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530242.985368:0:10347:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a9f3d36ae00/0xb28d70e1257506c5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb28d70e1257506be expref: 30 pid: 6517 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530242.985377:0:10347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788530242.985398:0:10347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03764e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+30:3649:x1875409555814912:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530242.985404:0:10347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788530242.985414:0:10347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788530242.985419:0:10347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03767100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:3649:x1875409555815040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788530242.985425:0:10347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788530242.985428:0:10347:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a9f3d36ac00/0xb28d70e1257506b7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e1257506b0 expref: 29 pid: 6516 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530242.985437:0:10347:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a9f3d36ac00/0xb28d70e1257506b7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb28d70e1257506b0 expref: 29 pid: 6516 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530242.985445:0:10347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788530242.985460:0:10347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03767100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:3649:x1875409555815040:12345-0@lo:103:ldlm_bl.0 Request processed in 41us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530242.985466:0:10347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788530242.985498:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03764a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3649:1875409555815040:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788530242.985505:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03765880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3649:1875409555814912:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788530242.985535:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03766300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3648:1875409555815168:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788530242.985541:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03767800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3648:1875409555814784:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788530242.985942:0:13746:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f42167c00/0xb28d70e1257506d3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb28d70e1257506cc expref: 28 pid: 6516 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530242.985957:0:13746:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03736d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13746:1875409555814016:0@lo:104: 00010000:00010000:0.0:1788530242.985966:0:13746:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f3d36ae00/0xb28d70e1257506c5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb28d70e1257506be expref: 27 pid: 6517 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530242.985974:0:13746:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03735f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13746:1875409555814144:0@lo:104: 00010000:00010000:0.0:1788530242.985982:0:13746:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f3d36ac00/0xb28d70e1257506b7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb28d70e1257506b0 expref: 26 pid: 6516 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530242.985989:0:13746:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03734700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13746:1875409555814272:0@lo:104: 00010000:00010000:0.0:1788530242.985997:0:13746:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f3d36b000/0xb28d70e1257506a9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb28d70e1257506a2 expref: 25 pid: 6518 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530242.986012:0:13746:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03c52300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13746:1875409555814400:0@lo:104: 00010000:00010000:0.0:1788530242.988118:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788530242.990052:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530242.990352:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530242.990417:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531597440 00000100:00100000:2.0:1788530242.990429:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531597440 00010000:00010000:2.0:1788530242.990472:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a9e025dc800/0xb28d70e12575069b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a5507ed expref: 14 pid: 6517 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530242.990512:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531597568 00000100:00100000:2.0:1788530242.990515:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531597568 00010000:00010000:2.0:1788530242.990528:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a9e025dde00/0xb28d70e125750694 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a5507e6 expref: 15 pid: 6517 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530242.990590:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 59 00000100:00100000:2.0:1788530242.990613:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03691180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f442bcd-b742-4e76-ad7b-709f731358a0+15:2400:x1875409531597440:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788530242.990628:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788530242.990635:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a9e025dc800/0xb28d70e12575069b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a5507ed expref: 15 pid: 6517 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530242.990649:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a9e025dc800/0xb28d70e12575069b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a5507ed expref: 15 pid: 6517 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530242.990672:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788530242.990740:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03691180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f442bcd-b742-4e76-ad7b-709f731358a0+15:2400:x1875409531597440:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 141us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530242.990748:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 59 00000100:00100000:2.0:1788530242.990769:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 60 00000100:00100000:2.0:1788530242.990775:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03692680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f442bcd-b742-4e76-ad7b-709f731358a0+14:2399:x1875409531597568:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788530242.990799:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788530242.990804:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a9e025dde00/0xb28d70e125750694 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a5507e6 expref: 14 pid: 6517 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530242.990814:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a9e025dde00/0xb28d70e125750694 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a5507e6 expref: 14 pid: 6517 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530242.990828:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a9f3d100400/0xb28d70e12575080e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530242.990839:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f3d100400/0xb28d70e12575080e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530242.990858:0:6509:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a9f3d100400/0xb28d70e12575080e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530242.990865:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a9f3d100400/0xb28d70e12575080e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530242.990873:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a9f3d100400/0xb28d70e12575080e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530242.990881:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a9f3d100400/0xb28d70e12575080e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530242.990889:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d100400 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:2.0:1788530242.990895:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a9f3d100400/0xb28d70e12575080e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530242.990905:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a9f3d100400/0xb28d70e12575080e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530242.990925:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a9f3d100400/0xb28d70e12575080e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530242.990936:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788530242.990953:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03692680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f442bcd-b742-4e76-ad7b-709f731358a0+14:2399:x1875409531597568:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 179us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530242.990960:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 60 00010000:00010000:0.0:1788530242.991493:0:13746:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9e025dc800/0xb28d70e12575069b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a5507ed expref: 13 pid: 6517 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530242.991508:0:13746:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03c50e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13746:1875409555814528:192.168.202.41@tcp:104: 00010000:00010000:0.0:1788530242.991523:0:13746:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9e025dde00/0xb28d70e125750694 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a5507e6 expref: 12 pid: 6517 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530242.991533:0:13746:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03c53100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13746:1875409555814656:192.168.202.41@tcp:104: 00010000:00010000:0.0:1788530242.991745:0:13746:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a9f3d100400/0xb28d70e12575080e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530242.991755:0:13746:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a9f3d100400/0xb28d70e12575080e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530242.991762:0:13746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a9f3d100400/0xb28d70e12575080e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530242.991769:0:13746:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f3d100400/0xb28d70e12575080e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530243.778760:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788530244.084851:0:13795:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe000e61e0 20000000:00000080:2.0:1788530244.084873:0:13795:0:(mgs_handler.c:1172:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a9e03cce400 uarg=0000000000000000 20000000:01000000:2.0:1788530244.084929:0:13795:0:(mgs_llog.c:6198:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:2.0:1788530244.084937:0:13795:0:(mgs_llog.c:4653:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:2.0:1788530244.084942:0:13795:0:(mgs_llog.c:1385:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:1.0:1788530244.088369:0:13796:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:2.0:1788530244.089005:0:13795:0:(mgs_llog.c:4126:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:2.0:1788530244.089134:0:13795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:2.0:1788530244.089166:0:13795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:2.0:1788530244.089178:0:13795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:2.0:1788530244.089194:0:13795:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788530244.089225:0:13795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a9f3d20c800/0xb28d70e125750815 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530244.089248:0:13795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f3d20c800/0xb28d70e125750815 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530244.089262:0:13795:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a9f3d20c800/0xb28d70e125750815 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530244.089269:0:13795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a9f3d20c800/0xb28d70e125750815 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530244.089314:0:13795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a9f3d20c800/0xb28d70e125750815 lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530244.089323:0:13795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a9f3d20c800/0xb28d70e125750815 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530244.089329:0:13795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d20c800 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:2.0:1788530244.089334:0:13795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a9f3d20c800/0xb28d70e125750815 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530244.089344:0:13795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a9f3d20c800/0xb28d70e125750815 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530244.089363:0:13795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a9f3d20c800/0xb28d70e125750815 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530244.089372:0:13795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a9f3d20c800/0xb28d70e125750815 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530244.089378:0:13795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f3d20c800/0xb28d70e125750815 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530244.147383:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530244.149875:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531597696 00000100:00100000:1.0:1788530244.149895:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531597696 00000100:00100000:1.0:1788530244.150041:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 395 00000100:00100000:1.0:1788530244.150053:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f442bcd-b742-4e76-ad7b-709f731358a0+12:6178:x1875409531597696:12345-192.168.202.41@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788530244.150074:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530244.150100:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f42166400/0xb28d70e12575081c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1406819a55083a expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530244.150132:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f42166400/0xb28d70e12575081c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a55083a expref: 13 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530244.150143:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f42166400/0xb28d70e12575081c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a55083a expref: 13 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530244.150152:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f42166400, rc 0) 00000100:00100000:1.0:1788530244.150250:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f442bcd-b742-4e76-ad7b-709f731358a0+13:6178:x1875409531597696:12345-192.168.202.41@tcp:101:ll_cfg_requeue.0 Request processed in 198us (2884us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530244.150257:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 395 00000100:00100000:3.0:1788530244.163279:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530244.164106:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531597824 00000100:00100000:1.0:1788530244.164122:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531597824 00000100:00100000:1.0:1788530244.164214:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 396 00000100:00100000:1.0:1788530244.164229:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f442bcd-b742-4e76-ad7b-709f731358a0+13:6178:x1875409531597824:12345-192.168.202.41@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788530244.164953:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555815296:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788530244.165038:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530244.165131:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555815296 00000100:00100000:3.0:1788530244.165137:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555815296 00000100:00100000:3.0:1788530244.165174:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788530244.165182:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555815296:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788530244.165220:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788530244.165302:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555815296:12345-0@lo:41:osp-pre-0-1.0 Request processed in 119us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530244.165310:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788530244.165374:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555815296:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788530244.165873:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f442bcd-b742-4e76-ad7b-709f731358a0+13:6178:x1875409531597824:12345-192.168.202.41@tcp:501:ll_cfg_requeue.0 Request processed in 1644us (2615us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530244.165884:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 396 00000100:00100000:1.0:1788530244.170086:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530244.170256:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531597952 00000100:00100000:0.0:1788530244.170279:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531597952 00000100:00100000:0.0:1788530244.170357:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 397 00000100:00100000:0.0:1788530244.170371:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f442bcd-b742-4e76-ad7b-709f731358a0+13:6178:x1875409531597952:12345-192.168.202.41@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788530244.170594:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f442bcd-b742-4e76-ad7b-709f731358a0+13:6178:x1875409531597952:12345-192.168.202.41@tcp:503:ll_cfg_requeue.0 Request processed in 225us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530244.170603:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 397 00000100:00100000:1.0:1788530244.178367:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530244.179706:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531598080 00000100:00100000:0.0:1788530244.179723:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531598080 00000100:00100000:0.0:1788530244.179805:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 398 00000100:00100000:0.0:1788530244.179815:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f442bcd-b742-4e76-ad7b-709f731358a0+13:10791:x1875409531598080:12345-192.168.202.41@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788530244.180743:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f442bcd-b742-4e76-ad7b-709f731358a0+13:10791:x1875409531598080:12345-192.168.202.41@tcp:502:llog_process_th.0 Request processed in 914us (2375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530244.180754:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 398 00000100:00100000:0.0:1788530244.188468:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530244.188671:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531598208 00000100:00100000:1.0:1788530244.188686:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531598208 00000100:00100000:1.0:1788530244.188771:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 399 00000100:00100000:1.0:1788530244.188785:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f442bcd-b742-4e76-ad7b-709f731358a0+13:10791:x1875409531598208:12345-192.168.202.41@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788530244.189128:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f442bcd-b742-4e76-ad7b-709f731358a0+13:10791:x1875409531598208:12345-192.168.202.41@tcp:502:llog_process_th.0 Request processed in 345us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530244.189137:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 399 00000100:00100000:0.0:1788530244.196839:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530244.203997:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531598336 00000100:00100000:1.0:1788530244.204017:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531598336 00000100:00100000:0.0:1788530244.209165:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 400 00000100:00100000:0.0:1788530244.209185:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f442bcd-b742-4e76-ad7b-709f731358a0+13:6178:x1875409531598336:12345-192.168.202.41@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788530244.209208:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530244.209233:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f3d100e00/0xb28d70e125750823 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1406819a550841 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530244.209281:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f3d100e00/0xb28d70e125750823 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550841 expref: 14 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530244.209296:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f3d100e00/0xb28d70e125750823 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550841 expref: 14 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530244.209312:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d100e00, rc 0) 00000100:00100000:0.0:1788530244.209425:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f442bcd-b742-4e76-ad7b-709f731358a0+14:6178:x1875409531598336:12345-192.168.202.41@tcp:101:ll_cfg_requeue.0 Request processed in 234us (12585us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530244.209447:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 400 00000100:00100000:1.0:1788530244.222552:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530244.222758:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531598464 00000100:00100000:2.0:1788530244.222776:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531598464 00000100:00100000:2.0:1788530244.222844:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 401 00000100:00100000:2.0:1788530244.222857:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f442bcd-b742-4e76-ad7b-709f731358a0+14:6178:x1875409531598464:12345-192.168.202.41@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788530244.223064:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f442bcd-b742-4e76-ad7b-709f731358a0+14:6178:x1875409531598464:12345-192.168.202.41@tcp:501:ll_cfg_requeue.0 Request processed in 210us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530244.223072:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 401 00000100:00100000:3.0:1788530244.236801:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530244.239165:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531598592 00000100:00100000:0.0:1788530244.239190:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531598592 00000100:00100000:0.0:1788530244.240398:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 402 00000100:00100000:0.0:1788530244.240420:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f442bcd-b742-4e76-ad7b-709f731358a0+14:6178:x1875409531598592:12345-192.168.202.41@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788530244.240696:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f442bcd-b742-4e76-ad7b-709f731358a0+14:6178:x1875409531598592:12345-192.168.202.41@tcp:503:ll_cfg_requeue.0 Request processed in 281us (3903us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530244.240705:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 402 00000100:00100000:0.0:1788530244.256495:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530244.256677:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531598720 00000100:00100000:1.0:1788530244.256691:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531598720 00000100:00100000:1.0:1788530244.258182:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 403 00000100:00100000:1.0:1788530244.258204:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f442bcd-b742-4e76-ad7b-709f731358a0+14:10795:x1875409531598720:12345-192.168.202.41@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788530244.258548:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f442bcd-b742-4e76-ad7b-709f731358a0+14:10795:x1875409531598720:12345-192.168.202.41@tcp:502:llog_process_th.0 Request processed in 350us (2062us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530244.263783:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530244.268011:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531598848 00000100:00100000:2.0:1788530244.268028:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531598848 00000100:00100000:2.0:1788530244.268077:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 404 00000100:00100000:2.0:1788530244.268087:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f442bcd-b742-4e76-ad7b-709f731358a0+15:10795:x1875409531598848:12345-192.168.202.41@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788530244.268264:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f442bcd-b742-4e76-ad7b-709f731358a0+15:10795:x1875409531598848:12345-192.168.202.41@tcp:502:llog_process_th.0 Request processed in 178us (4491us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530244.268285:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 404 00000100:00100000:0.0:1788530244.268317:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 403 10000000:01000000:0.0:1788530244.608797:0:6521:0:(mgc_request.c:715:do_requeue()) updating log params 10000000:01000000:0.0:1788530244.608809:0:6521:0:(mgc_request.c:2194:mgc_process_log()) Process log params-ffff9a9e01aa6000 from 7 10000000:01000000:0.0:1788530244.608816:0:6521:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788530244.608895:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d100a00/0xb28d70e12575082a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530244.608909:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f3d100a00/0xb28d70e12575082a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530244.608922:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f3d100a00/0xb28d70e12575082a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530244.608956:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03c53100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555815424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788530244.609065:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530244.609150:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555815424 00000100:00100000:0.0:1788530244.609150:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e0328af00 going to sleep for 11 seconds 00000100:00100000:2.0:1788530244.609226:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555815424 00000100:00100000:2.0:1788530244.609316:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 405 00000100:00100000:2.0:1788530244.609328:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+25:6521:x1875409555815424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788530244.609409:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530244.609431:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f3d20c600/0xb28d70e125750831 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e12575082a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530244.609462:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f3d20c600/0xb28d70e125750831 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e12575082a expref: 26 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530244.609477:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f3d20c600/0xb28d70e125750831 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e12575082a expref: 26 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530244.609722:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d20c600, rc 0) 00000100:00100000:2.0:1788530244.609796:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+26:6521:x1875409555815424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 469us (728us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530244.609805:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 405 00000100:00100000:0.0:1788530244.609843:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03c53100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555815424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788530244.609864:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f3d100a00/0xb28d70e12575082a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125750831 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530244.609874:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f3d100a00/0xb28d70e12575082a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e125750831 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788530244.610081:0:6521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 7 count 7 00000040:00080000:0.0:1788530244.610676:0:6521:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788530244.610891:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:0.0:1788530244.610914:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:0.0:1788530244.610927:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:0.0:1788530244.610938:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:0.0:1788530244.610949:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:0.0:1788530244.610963:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:0.0:1788530244.610967:0:6521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 6 count 7 00000100:00100000:0.0:1788530244.611038:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03c53100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555815552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788530244.611092:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530244.611525:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e0328af00 going to sleep for 11 seconds 00000100:00100000:2.0:1788530244.611831:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555815552 00000100:00100000:2.0:1788530244.611840:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555815552 00000100:00100000:2.0:1788530244.611939:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 406 00000100:00100000:2.0:1788530244.611961:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+26:6521:x1875409555815552:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788530244.612122:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+26:6521:x1875409555815552:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 164us (1030us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530244.612130:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 406 00000100:00100000:1.0:1788530244.612221:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03c53100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555815552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788530244.612276:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03692d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555815680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788530244.612323:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530244.612976:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555815680 00000100:00100000:0.0:1788530244.612985:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555815680 00000100:00100000:0.0:1788530244.613019:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 407 00000100:00100000:0.0:1788530244.613027:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+26:6521:x1875409555815680:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788530244.613134:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+26:6521:x1875409555815680:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 107us (809us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530244.613141:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 407 00000100:00100000:3.0:1788530244.613256:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e0247f780 going to sleep for 11 seconds 00000100:00100000:3.0:1788530244.613285:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03692d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555815680:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788530244.614139:0:6521:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788530244.614259:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d3d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555815808:0@lo:502:ll_cfg_requeue.0 00000100:00100000:3.0:1788530244.614353:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530244.614482:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f08cd5d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788530244.615037:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555815808 00000100:00100000:0.0:1788530244.615049:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555815808 00000100:00100000:0.0:1788530244.615118:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 408 00000100:00100000:0.0:1788530244.615139:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+26:6521:x1875409555815808:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:0.0:1788530244.615323:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+26:6521:x1875409555815808:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 184us (970us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530244.615332:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 408 00000100:00100000:3.0:1788530244.615756:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d3d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555815808:0@lo:502:ll_cfg_requeue.0 00000040:00080000:3.0:1788530244.616076:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1788530244.616123:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:3.0:1788530244.616141:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:3.0:1788530244.616154:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:3.0:1788530244.616166:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:3.0:1788530244.616180:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:3.0:1788530244.616194:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:3.0:1788530244.616208:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:3.0:1788530244.616223:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:3.0:1788530244.616238:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:3.0:1788530244.616252:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:3.0:1788530244.616315:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d3d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555815936:0@lo:502:ll_cfg_requeue.0 00000100:00100000:3.0:1788530244.616396:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530244.616724:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f08cd5d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788530244.616803:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555815936 00000100:00100000:1.0:1788530244.616815:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555815936 00000100:00100000:1.0:1788530244.616863:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 409 00000100:00100000:1.0:1788530244.616875:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+27:6521:x1875409555815936:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788530244.617039:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+27:6521:x1875409555815936:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 164us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530244.617049:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 409 00000100:00100000:3.0:1788530244.617173:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d3d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555815936:0@lo:502:ll_cfg_requeue.0 00000040:00080000:3.0:1788530244.617251:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:3.0:1788530244.617264:0:6521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1788530244.619193:0:13808:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788530244.619207:0:13808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788530244.619209:0:13808:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788530244.619216:0:13808:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a9e01aa6000 00000020:00000080:0.0:1788530244.619220:0:13808:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788530244.619295:0:13808:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788530244.619299:0:13808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788530244.619300:0:13808:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788530244.619303:0:13808:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788530244.619305:0:13808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788530244.619306:0:13808:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788530244.619310:0:13808:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a9e01aa6000 00000020:00000080:0.0:1788530244.619312:0:13808:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788530244.619335:0:13808:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788530244.619338:0:13808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788530244.619339:0:13808:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788530244.619355:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:1.0:1788530244.619678:0:6521:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1788530244.619694:0:6521:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788530244.619708:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d100a00/0xb28d70e12575082a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125750831 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530244.619721:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f3d100a00/0xb28d70e12575082a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125750831 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788530244.619741:0:6521:0:(mgc_request.c:715:do_requeue()) updating log params 10000000:01000000:1.0:1788530244.619743:0:6521:0:(mgc_request.c:2194:mgc_process_log()) Process log params-ffff9a9f33b6f800 from 7 10000000:01000000:1.0:1788530244.619746:0:6521:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788530244.619796:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f42167200/0xb28d70e125750838 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530244.619803:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f42167200/0xb28d70e125750838 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530244.619835:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f42167200/0xb28d70e125750838 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530244.619868:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03691f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555816064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788530244.619951:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530244.620672:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e0247f240 going to sleep for 11 seconds 00000100:00100000:2.0:1788530244.628771:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555816064 00000100:00100000:2.0:1788530244.628789:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555816064 00000100:00100000:2.0:1788530244.628861:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 410 00000100:00100000:2.0:1788530244.628875:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+26:6521:x1875409555816064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788530244.628899:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530244.628921:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f3d20de00/0xb28d70e12575083f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e125750838 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530244.628954:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f3d20de00/0xb28d70e12575083f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e125750838 expref: 27 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530244.628966:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f3d20de00/0xb28d70e12575083f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125750838 expref: 27 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530244.628975:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d20de00, rc 0) 00000100:00100000:2.0:1788530244.629068:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+27:6521:x1875409555816064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 195us (9117us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530244.629075:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 410 00000100:00100000:2.0:1788530244.629141:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03691f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555816064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788530244.629164:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f42167200/0xb28d70e125750838 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575083f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530244.629174:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f42167200/0xb28d70e125750838 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e12575083f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788530244.629367:0:6521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 7 count 7 00000040:00080000:2.0:1788530244.631002:0:6521:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788530244.631277:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:2.0:1788530244.631310:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 112 off8528 00000040:00080000:2.0:1788530244.631324:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 224 off8752 00000040:00080000:2.0:1788530244.631339:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8976 00000040:00080000:2.0:1788530244.631354:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 112 off9088 00000040:00080000:2.0:1788530244.631372:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 224 off9312 00000040:00080000:2.0:1788530244.631378:0:6521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 6 count 7 00000100:00100000:2.0:1788530244.631482:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03767800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555816192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788530244.633779:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530244.635748:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e0327c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788530244.640058:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555816192 00000100:00100000:0.0:1788530244.640074:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555816192 00000100:00100000:0.0:1788530244.640138:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 411 00000100:00100000:0.0:1788530244.640150:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+27:6521:x1875409555816192:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788530244.640344:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+27:6521:x1875409555816192:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 196us (6578us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530244.640353:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 411 00000100:00100000:1.0:1788530244.641040:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03767800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555816192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788530244.641094:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03690700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555816320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788530244.641154:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530244.641199:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e0247f180 going to sleep for 11 seconds 00000100:00100000:0.0:1788530244.641249:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555816320 00000100:00100000:0.0:1788530244.641261:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555816320 00000100:00100000:0.0:1788530244.641319:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 412 00000100:00100000:0.0:1788530244.641326:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+27:6521:x1875409555816320:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788530244.641439:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+27:6521:x1875409555816320:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 113us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530244.641456:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 412 00000100:00100000:0.0:1788530244.641769:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03690700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555816320:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788530244.642243:0:6521:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788530244.642336:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03c50e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555816448:0@lo:502:ll_cfg_requeue.0 00000100:00100000:0.0:1788530244.642388:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530244.642723:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555816448 00000100:00100000:1.0:1788530244.642731:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555816448 00000100:00100000:1.0:1788530244.642766:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 413 00000100:00100000:1.0:1788530244.642775:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+27:6521:x1875409555816448:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788530244.642869:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+27:6521:x1875409555816448:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 95us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530244.642877:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 413 00000100:00100000:0.0:1788530244.643117:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e0328af00 going to sleep for 11 seconds 00000100:00100000:0.0:1788530244.643137:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03c50e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555816448:0@lo:502:ll_cfg_requeue.0 00000040:00080000:0.0:1788530244.643357:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:0.0:1788530244.643387:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 112 off8528 00000040:00080000:0.0:1788530244.643403:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 224 off8752 00000040:00080000:0.0:1788530244.644933:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8976 00000040:00080000:0.0:1788530244.644971:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 112 off9088 00000040:00080000:0.0:1788530244.644983:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 224 off9312 00000040:00080000:0.0:1788530244.644995:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 224 off9536 00000040:00080000:0.0:1788530244.645009:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 128 off9664 00000040:00080000:0.0:1788530244.645022:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:0.0:1788530244.645036:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 224 off10112 00000040:00080000:0.0:1788530244.645050:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 128 off10240 00000100:00100000:0.0:1788530244.645111:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03c50e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555816576:0@lo:502:ll_cfg_requeue.0 00000100:00100000:0.0:1788530244.645212:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530244.645308:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e0328af00 going to sleep for 11 seconds 00000040:00080000:0.0:1788530244.653153:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788530244.655578:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555816576 00000100:00100000:1.0:1788530244.655593:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555816576 00000100:00100000:1.0:1788530244.655657:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 414 00000100:00100000:1.0:1788530244.655668:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+27:6521:x1875409555816576:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788530244.655884:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+27:6521:x1875409555816576:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 216us (10672us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530244.655894:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 414 00000100:00100000:1.0:1788530244.655972:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03c50e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555816576:0@lo:502:ll_cfg_requeue.0 00000040:00080000:1.0:1788530244.657366:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10464 00000040:00080000:1.0:1788530244.657400:0:6521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1788530244.658730:0:13813:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788530244.658749:0:13813:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788530244.658752:0:13813:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788530244.658761:0:13813:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a9f33b6f800 00000020:00000080:1.0:1788530244.658764:0:13813:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788530244.658865:0:13813:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788530244.658870:0:13813:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788530244.658872:0:13813:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788530244.658875:0:13813:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788530244.658877:0:13813:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788530244.658878:0:13813:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788530244.658882:0:13813:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a9f33b6f800 00000020:00000080:1.0:1788530244.658884:0:13813:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788530244.658909:0:13813:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788530244.658912:0:13813:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788530244.658913:0:13813:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788530244.658916:0:13813:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 13 count 13 00000020:01000000:0.0:1788530244.659659:0:6521:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1788530244.659677:0:6521:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788530244.659692:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f42167200/0xb28d70e125750838 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575083f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530244.659705:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f42167200/0xb28d70e125750838 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575083f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788530244.659726:0:6521:0:(mgc_request.c:715:do_requeue()) updating log params 10000000:01000000:0.0:1788530244.659729:0:6521:0:(mgc_request.c:2194:mgc_process_log()) Process log params-ffff9a9f32bea000 from 7 10000000:01000000:0.0:1788530244.659732:0:6521:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788530244.659786:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d100200/0xb28d70e125750846 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530244.659796:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f3d100200/0xb28d70e125750846 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530244.659812:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f3d100200/0xb28d70e125750846 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530244.659848:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03c52300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555816704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788530244.659937:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530244.659986:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e0328a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788530244.660055:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555816704 00000100:00100000:1.0:1788530244.660064:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555816704 00000100:00100000:1.0:1788530244.660112:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 415 00000100:00100000:1.0:1788530244.660124:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+27:6521:x1875409555816704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788530244.660140:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530244.660153:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f42166600/0xb28d70e12575084d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e125750846 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530244.660180:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f42166600/0xb28d70e12575084d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e125750846 expref: 28 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530244.660207:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f42166600/0xb28d70e12575084d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125750846 expref: 28 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530244.660217:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f42166600, rc 0) 00000100:00100000:1.0:1788530244.660281:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+28:6521:x1875409555816704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 159us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530244.660288:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 415 00000100:00100000:0.0:1788530244.660422:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03c52300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555816704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788530244.660438:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f3d100200/0xb28d70e125750846 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575084d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530244.660448:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f3d100200/0xb28d70e125750846 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e12575084d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788530244.660659:0:6521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x18:0x0] index 7 count 7 00000040:00080000:0.0:1788530244.661047:0:6521:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788530244.666531:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].1, 224 off8416 00000040:00080000:0.0:1788530244.666649:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].2, 112 off8528 00000040:00080000:0.0:1788530244.666665:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].3, 224 off8752 00000040:00080000:0.0:1788530244.666678:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].4, 224 off8976 00000040:00080000:0.0:1788530244.666691:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].5, 112 off9088 00000040:00080000:0.0:1788530244.666721:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].6, 224 off9312 00000040:00080000:0.0:1788530244.666727:0:6521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x18:0x0] index 6 count 7 00000100:00100000:0.0:1788530244.666873:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03c52300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555816832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788530244.666960:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530244.667009:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e0328a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788530244.667276:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555816832 00000100:00100000:1.0:1788530244.667288:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555816832 00000100:00100000:1.0:1788530244.667355:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 416 00000100:00100000:1.0:1788530244.667367:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+28:6521:x1875409555816832:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788530244.667542:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+28:6521:x1875409555816832:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 177us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530244.667550:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 416 00000100:00100000:1.0:1788530244.667625:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03c52300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555816832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788530244.667661:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03690000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555816960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788530244.667706:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530244.667722:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e0247f780 going to sleep for 11 seconds 00000100:00100000:1.0:1788530244.667736:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555816960 00000100:00100000:1.0:1788530244.667740:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555816960 00000100:00100000:1.0:1788530244.667763:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 417 00000100:00100000:1.0:1788530244.667769:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+28:6521:x1875409555816960:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788530244.667850:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+28:6521:x1875409555816960:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 80us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530244.667857:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 417 00000100:00100000:1.0:1788530244.667902:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03690000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555816960:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788530244.668352:0:6521:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788530244.668430:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03690000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555817088:0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788530244.668474:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530244.668506:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555817088 00000100:00100000:1.0:1788530244.668510:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555817088 00000100:00100000:1.0:1788530244.668533:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 418 00000100:00100000:1.0:1788530244.668539:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+28:6521:x1875409555817088:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788530244.668630:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+28:6521:x1875409555817088:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 91us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530244.668636:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 418 00000100:00100000:1.0:1788530244.668662:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e0247f780 going to sleep for 11 seconds 00000100:00100000:1.0:1788530244.668675:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03690000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555817088:0@lo:502:ll_cfg_requeue.0 00000040:00080000:1.0:1788530244.668832:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].1, 224 off8416 00000040:00080000:1.0:1788530244.668853:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].2, 112 off8528 00000040:00080000:1.0:1788530244.668865:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].3, 224 off8752 00000040:00080000:1.0:1788530244.668878:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].4, 224 off8976 00000040:00080000:1.0:1788530244.668891:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].5, 112 off9088 00000040:00080000:1.0:1788530244.668902:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].6, 224 off9312 00000040:00080000:1.0:1788530244.668915:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].7, 224 off9536 00000040:00080000:1.0:1788530244.668926:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].8, 128 off9664 00000040:00080000:1.0:1788530244.668940:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].9, 224 off9888 00000040:00080000:1.0:1788530244.668952:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].10, 224 off10112 00000040:00080000:1.0:1788530244.668964:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].11, 128 off10240 00000100:00100000:1.0:1788530244.668989:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03690000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555817216:0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788530244.669023:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530244.669044:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555817216 00000100:00100000:1.0:1788530244.669053:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555817216 00000100:00100000:1.0:1788530244.669077:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 419 00000100:00100000:1.0:1788530244.669083:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+28:6521:x1875409555817216:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788530244.669144:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+28:6521:x1875409555817216:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 61us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530244.669150:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 419 00000100:00100000:1.0:1788530244.669179:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e0247f780 going to sleep for 11 seconds 00000100:00100000:1.0:1788530244.669192:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03690000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555817216:0@lo:502:ll_cfg_requeue.0 00000040:00080000:1.0:1788530244.669227:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].12, 224 off10464 00000040:00080000:1.0:1788530244.669234:0:6521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1788530244.673262:0:13814:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788530244.673295:0:13814:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788530244.673298:0:13814:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788530244.673309:0:13814:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a9f32bea000 00000020:00000080:1.0:1788530244.673313:0:13814:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788530244.673423:0:13814:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788530244.673427:0:13814:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788530244.673429:0:13814:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788530244.673432:0:13814:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788530244.673435:0:13814:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788530244.673436:0:13814:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788530244.673440:0:13814:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a9f32bea000 00000020:00000080:1.0:1788530244.673442:0:13814:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788530244.673468:0:13814:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788530244.673471:0:13814:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788530244.673472:0:13814:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788530244.673476:0:13814:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1a:0x0] index 13 count 13 00000020:01000000:1.0:1788530244.674363:0:6521:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1788530244.674376:0:6521:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788530244.674387:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d100200/0xb28d70e125750846 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575084d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530244.674406:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f3d100200/0xb28d70e125750846 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575084d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788530244.674419:0:6521:0:(mgc_request.c:715:do_requeue()) updating log params 10000000:01000000:1.0:1788530244.674422:0:6521:0:(mgc_request.c:2194:mgc_process_log()) Process log params-ffff9a9f0aaed800 from 7 10000000:01000000:1.0:1788530244.674425:0:6521:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788530244.674453:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f42167c00/0xb28d70e125750854 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530244.674461:0:6521:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f42167c00/0xb28d70e125750854 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530244.674472:0:6521:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f42167c00/0xb28d70e125750854 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530244.674733:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03690000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555817600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788530244.674816:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530244.674861:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e0247f780 going to sleep for 11 seconds 00000100:00100000:3.0:1788530244.675380:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875409555817856:0@lo:400:kworker.0 00000100:00100000:3.0:1788530244.675419:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530244.675440:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555818368:0@lo:400:kworker.0 00000100:00100000:3.0:1788530244.675463:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530244.675481:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555818880:0@lo:400:kworker.0 00000100:00100000:3.0:1788530244.675519:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530244.675540:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788530244.675546:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875409555817728:0@lo:400:kworker.0 00000100:00100000:3.0:1788530244.675585:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530244.675602:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875409555818240:0@lo:400:kworker.0 00000100:00100000:3.0:1788530244.675623:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530244.675639:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875409555818752:0@lo:400:kworker.0 00000100:00100000:3.0:1788530244.675657:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530244.678711:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555817856 00000100:00100000:0.0:1788530244.678730:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555817856 00000100:00100000:0.0:1788530244.678817:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555817728 00000100:00100000:0.0:1788530244.678821:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555817728 00000100:00100000:0.0:1788530244.678846:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555818240 00000100:00100000:0.0:1788530244.678849:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555818240 00000100:00100000:0.0:1788530244.678870:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555818752 00000100:00100000:0.0:1788530244.678873:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555818752 00000100:00100000:0.0:1788530244.678893:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1788530244.678906:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0263ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875409555817856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530244.679022:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0263ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875409555817856:12345-0@lo:400:kworker.0 Request processed in 118us (3602us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530244.679030:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1788530244.679051:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1788530244.679058:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0263f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875409555817728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530244.679087:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0263f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875409555817728:12345-0@lo:400:kworker.0 Request processed in 30us (3501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530244.679104:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1788530244.679117:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1788530244.679123:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0263e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875409555818240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530244.679153:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0263e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875409555818240:12345-0@lo:400:kworker.0 Request processed in 30us (3529us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530244.679159:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1788530244.679170:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1788530244.679176:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0263d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875409555818752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530244.679203:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0263d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875409555818752:12345-0@lo:400:kworker.0 Request processed in 28us (3545us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530244.679209:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00080000:0.0:1788530244.679229:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788530244.679289:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875409555817728:0@lo:400:kworker.0 00010000:00080000:0.0:1788530244.679310:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e03d3f100 x1875409555818240/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530260 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530244.679322:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875409555818240:0@lo:400:kworker.0 00010000:00080000:0.0:1788530244.679335:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e03d3ed80 x1875409555818752/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530260 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530244.679342:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875409555818752:0@lo:400:kworker.0 00000100:00100000:0.0:1788530244.679357:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875409555817856:0@lo:400:kworker.0 00000100:00100000:2.0:1788530244.680038:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555817344:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788530244.680110:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530244.680153:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555817984:0@lo:400:kworker.0 00000100:00100000:2.0:1788530244.680178:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530244.680198:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555818496:0@lo:400:kworker.0 00000100:00100000:2.0:1788530244.680220:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530244.680237:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0263f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555819008:0@lo:400:kworker.0 00000100:00100000:2.0:1788530244.680255:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530244.680291:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788530244.680298:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555817472:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788530244.680317:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530244.680333:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875409555818112:0@lo:400:kworker.0 00000100:00100000:2.0:1788530244.680354:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530244.680382:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875409555818624:0@lo:400:kworker.0 00000100:00100000:2.0:1788530244.680402:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530244.680506:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555818368 00000100:00100000:2.0:1788530244.680514:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555818368 00000100:00100000:2.0:1788530244.680583:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555818880 00000100:00100000:2.0:1788530244.680587:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555818880 00000100:00100000:2.0:1788530244.680602:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555818496 00000100:00100000:2.0:1788530244.680604:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555818496 00000100:00100000:2.0:1788530244.680617:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555819008 00000100:00100000:2.0:1788530244.680619:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555819008 00000100:00100000:2.0:1788530244.680633:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788530244.680640:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0263df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555818368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530244.680681:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0263df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555818368:12345-0@lo:400:kworker.0 Request processed in 42us (5217us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530244.680688:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788530244.680703:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788530244.680708:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0263d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555818880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530244.680728:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0263d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555818880:12345-0@lo:400:kworker.0 Request processed in 21us (5209us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530244.680734:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788530244.680742:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788530244.680747:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03764a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555818496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530244.680766:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03764a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555818496:12345-0@lo:400:kworker.0 Request processed in 20us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530244.680771:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788530244.680780:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788530244.680785:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03767b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3649:x1875409555819008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530244.680814:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03767b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3649:x1875409555819008:12345-0@lo:400:kworker.0 Request processed in 30us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530244.680820:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788530244.680840:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555818112 00000100:00100000:2.0:1788530244.680843:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555818112 00000100:00100000:2.0:1788530244.680879:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555818624 00000100:00100000:2.0:1788530244.680881:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555818624 00000100:00100000:2.0:1788530244.680893:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1788530244.680898:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03766680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875409555818112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530244.680922:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03766680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875409555818112:12345-0@lo:400:kworker.0 Request processed in 24us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530244.680928:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1788530244.680936:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1788530244.680941:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03766d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875409555818624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530244.680959:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03766d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875409555818624:12345-0@lo:400:kworker.0 Request processed in 18us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530244.680964:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1788530244.680979:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555817984 00000100:00100000:2.0:1788530244.680982:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555817984 00000100:00100000:2.0:1788530244.681008:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788530244.681014:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03765880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555817984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530244.681041:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03765880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555817984:12345-0@lo:400:kworker.0 Request processed in 27us (862us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530244.681047:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788530244.681068:0:9912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555817344 00000100:00100000:2.0:1788530244.681072:0:9912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555817344 00000100:00100000:2.0:1788530244.681090:0:9912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555817472 00000100:00100000:2.0:1788530244.681098:0:9912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555817472 00000100:00100000:2.0:1788530244.681111:0:9912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788530244.681116:0:9912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03766300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555817344:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788530244.681139:0:9912:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788530244.681169:0:9912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03766300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555817344:12345-0@lo:13:osp-pre-1-1.0 Request processed in 53us (1060us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530244.681175:0:9912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788530244.681185:0:9912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788530244.681190:0:9912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03765180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1875409555817472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788530244.681198:0:9912:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788530244.681214:0:9912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03765180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1875409555817472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 24us (895us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530244.681219:0:9912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788530244.681234:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03765f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555819136:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788530244.681258:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530244.681321:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555817472:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788530244.681331:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875409555818112:0@lo:400:kworker.0 00000100:00100000:2.0:1788530244.681339:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875409555818624:0@lo:400:kworker.0 00000100:00100000:2.0:1788530244.681353:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555817344:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788530244.681365:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555817984:0@lo:400:kworker.0 00010000:00080000:2.0:1788530244.681375:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e03d3d180 x1875409555818496/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788530260 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530244.681385:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555818496:0@lo:400:kworker.0 00000100:00100000:2.0:1788530244.681402:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0263f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555819008:0@lo:400:kworker.0 00000100:00100000:2.0:1788530244.681441:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555819136 00000100:00100000:2.0:1788530244.681445:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555819136 00000100:00100000:2.0:1788530244.681462:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788530244.681467:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03764000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555819136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788530244.681482:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788530244.681508:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03764000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555819136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 41us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530244.681513:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00010000:00080000:2.0:1788530244.681533:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e03765f80 x1875409555819136/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530260 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530244.681544:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03765f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555819136:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788530244.681691:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03764700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555819264:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788530244.681722:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788530244.681770:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788530244.681776:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788530244.681779:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788530244.681799:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e03d3fb80 x1875409555818368/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788530260 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530244.681808:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555818368:0@lo:400:kworker.0 00000100:00100000:0.0:1788530244.681817:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555818880:0@lo:400:kworker.0 00000100:00100000:1.0:1788530244.681895:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555817600 00000100:00100000:1.0:1788530244.681900:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555817600 00000100:00100000:1.0:1788530244.681936:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 420 00000100:00100000:1.0:1788530244.681943:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+28:6521:x1875409555817600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788530244.681952:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530244.681971:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f42167600/0xb28d70e12575085b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e125750854 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530244.681995:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f42167600/0xb28d70e12575085b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e125750854 expref: 29 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530244.682017:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f42167600/0xb28d70e12575085b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125750854 expref: 29 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530244.682025:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f42167600, rc 0) 00000100:00100000:1.0:1788530244.682056:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:6521:x1875409555817600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (7240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530244.682062:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 420 00000100:00100000:1.0:1788530244.682106:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03690000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555817600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788530244.682120:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f42167c00/0xb28d70e125750854 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575085b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530244.682131:0:6521:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f42167c00/0xb28d70e125750854 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e12575085b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530244.682173:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03690000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555819392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788530244.682196:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530244.682218:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e0247f780 going to sleep for 11 seconds 00000100:00100000:0.0:1788530244.682342:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555819392 00000100:00100000:0.0:1788530244.682348:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555819392 00000100:00100000:0.0:1788530244.682379:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 421 00000100:00100000:0.0:1788530244.682385:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:6521:x1875409555819392:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788530244.682500:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:6521:x1875409555819392:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 115us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530244.682506:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 421 00000100:00100000:0.0:1788530244.682534:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03690000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555819392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788530244.682586:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03c51180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555819520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788530244.682623:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530244.682635:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e0328a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788530244.682644:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555819520 00000100:00100000:0.0:1788530244.682647:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555819520 00000100:00100000:0.0:1788530244.682662:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 422 00000100:00100000:0.0:1788530244.682667:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:6521:x1875409555819520:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788530244.682731:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:6521:x1875409555819520:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 64us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530244.682738:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 422 00000100:00100000:0.0:1788530244.682774:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03c51180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:6521:1875409555819520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788530244.683015:0:13815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03693480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:13815:1875409555819648:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788530244.683044:0:13815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530244.683062:0:13815:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f17d3ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1788530244.683095:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555819648 00000100:00100000:0.0:1788530244.683099:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555819648 00000100:00100000:0.0:1788530244.683126:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 423 00000100:00100000:0.0:1788530244.683132:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:13815:x1875409555819648:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788530244.683194:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:13815:x1875409555819648:12345-0@lo:502:llog_process_th.0 Request processed in 61us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530244.683200:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 423 00000100:00100000:1.0:1788530244.683885:0:13815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03693480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:13815:1875409555819648:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788530244.683911:0:13815:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788530244.683920:0:13815:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788530244.683922:0:13815:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788530244.683929:0:13815:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a9f0aaed800 00000020:00000080:1.0:1788530244.683935:0:13815:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788530244.684010:0:13815:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788530244.684014:0:13815:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788530244.684016:0:13815:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788530244.684019:0:13815:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788530244.684021:0:13815:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788530244.684023:0:13815:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788530244.684026:0:13815:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a9f0aaed800 00000020:00000080:1.0:1788530244.684028:0:13815:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788530244.684062:0:13815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03693480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:13815:1875409555819776:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788530244.684103:0:13815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530244.684135:0:13815:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f17d3ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1788530244.684186:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555819776 00000100:00100000:0.0:1788530244.684191:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555819776 00000100:00100000:0.0:1788530244.684223:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 424 00000100:00100000:0.0:1788530244.684230:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:13815:x1875409555819776:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788530244.684320:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:13815:x1875409555819776:12345-0@lo:502:llog_process_th.0 Request processed in 89us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530244.684328:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 424 00000100:00100000:1.0:1788530244.684393:0:13815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03693480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:13815:1875409555819776:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788530244.684412:0:13815:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788530244.684416:0:13815:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788530244.684418:0:13815:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788530244.684421:0:13815:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000100:00100000:2.0:1788530244.686786:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555819264 00000100:00100000:2.0:1788530244.686827:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555819264 00000100:00100000:2.0:1788530244.686926:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788530244.686941:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555819264:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788530244.686981:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788530244.687117:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555819264:12345-0@lo:13:osp-pre-0-1.0 Request processed in 179us (5394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530244.687125:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00010000:00080000:1.0:1788530244.688380:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e03764700 x1875409555819264/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530260 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530244.688415:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03764700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555819264:0@lo:13:osp-pre-0-1.0 00000040:00080000:2.0:1788530244.689441:0:13816:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000000:0.0:1788530244.690880:0:6521:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1788530244.690895:0:6521:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788530244.690906:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f42167c00/0xb28d70e125750854 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575085b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530244.690920:0:6521:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f42167c00/0xb28d70e125750854 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575085b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530244.801573:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788530245.609202:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530245.609270:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530245.609318:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530245.609354:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530245.609377:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530245.609401:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530245.609441:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531598976 00000100:00100000:1.0:1788530245.609467:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531598976 00000100:00100000:0.0:1788530245.609677:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531599360 00000100:00100000:0.0:1788530245.609683:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531599360 00000100:00100000:0.0:1788530245.609735:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 83 00000100:00100000:0.0:1788530245.609747:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03690000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2399:x1875409531599360:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1788530245.609877:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03690000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2399:x1875409531599360:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 130us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530245.609887:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 83 00000100:00100000:0.0:1788530245.609920:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531599104 00000100:00100000:0.0:1788530245.609924:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531599104 00000100:00100000:0.0:1788530245.609969:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531599616 00000100:00100000:0.0:1788530245.609972:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531599616 00000100:00100000:0.0:1788530245.609990:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531599232 00000100:00100000:0.0:1788530245.609993:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531599232 00000100:00100000:0.0:1788530245.610004:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531599488 00000100:00100000:0.0:1788530245.610006:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531599488 00000100:00100000:0.0:1788530245.610020:0:10719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 280 00000100:00100000:0.0:1788530245.610026:0:10719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03693480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2399:x1875409531599104:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1788530245.610059:0:10719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03693480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2399:x1875409531599104:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 33us (873us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530245.610067:0:10719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 280 00000100:00100000:0.0:1788530245.610079:0:10719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 281 00000100:00100000:0.0:1788530245.610086:0:10719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03690700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2399:x1875409531599616:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1788530245.610114:0:10719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03690700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2399:x1875409531599616:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 28us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530245.610119:0:10719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 281 00000100:00100000:0.0:1788530245.610130:0:10719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 282 00000100:00100000:0.0:1788530245.610136:0:10719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03691f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2399:x1875409531599232:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1788530245.610156:0:10719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03691f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2399:x1875409531599232:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 21us (778us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530245.610172:0:10719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 282 00000100:00100000:0.0:1788530245.610185:0:10719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 283 00000100:00100000:0.0:1788530245.610192:0:10719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03692d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2399:x1875409531599488:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1788530245.610216:0:10719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03692d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2399:x1875409531599488:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 25us (813us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530245.610222:0:10719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 283 00000100:00080000:0.0:1788530245.610244:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788530245.610249:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788530245.610252:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788530245.610988:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 425 00000100:00100000:1.0:1788530245.611002:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f442bcd-b742-4e76-ad7b-709f731358a0+14:2399:x1875409531598976:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1788530245.611051:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f442bcd-b742-4e76-ad7b-709f731358a0+14:2399:x1875409531598976:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 53us (1695us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530245.611058:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 425 00000040:00080000:2.0:1788530245.697325:0:13816:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1788530245.698072:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788530245.698371:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0263d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555819904:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788530245.698446:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530245.698674:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555819904 00000100:00100000:2.0:1788530245.698683:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555819904 00000100:00100000:2.0:1788530245.698743:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788530245.698773:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555819904:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788530245.698827:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446453248 avail 1300213760 00000100:00100000:2.0:1788530245.698901:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555819904:12345-0@lo:41:osp-pre-1-0.0 Request processed in 131us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530245.698909:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788530245.699045:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0263d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555819904:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788530245.824864:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530246.849027:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788530247.246070:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00010000:00010000:2.0:1788530247.876755:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530248.902675:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788530249.283658:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788530249.283722:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03c52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555820032:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788530249.283880:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530249.286461:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555820032 00000100:00100000:2.0:1788530249.286490:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555820032 00000100:00100000:2.0:1788530249.286654:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788530249.286672:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555820032:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788530249.286751:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788530249.286910:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555820032:12345-0@lo:41:osp-pre-0-1.0 Request processed in 243us (3029us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530249.286919:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788530249.287150:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03c52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555820032:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788530249.797291:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03766a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555820544:0@lo:400:kworker.0 00000100:00100000:2.0:1788530249.797383:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530249.797458:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555821056:0@lo:400:kworker.0 00000100:00100000:2.0:1788530249.797486:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530249.797513:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555821568:0@lo:400:kworker.0 00000100:00100000:2.0:1788530249.797549:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530249.797611:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788530249.797617:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03765f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3649:1875409555820160:0@lo:400:kworker.0 00000100:00100000:2.0:1788530249.797647:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530249.797667:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875409555820672:0@lo:400:kworker.0 00000100:00100000:2.0:1788530249.797885:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530249.797912:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875409555821184:0@lo:400:kworker.0 00000100:00100000:2.0:1788530249.797935:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530249.797963:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03767480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875409555820288:0@lo:400:kworker.0 00000100:00100000:2.0:1788530249.797988:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530249.798004:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03764700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875409555820800:0@lo:400:kworker.0 00000100:00100000:2.0:1788530249.798023:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530249.798038:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875409555821312:0@lo:400:kworker.0 00000100:00100000:2.0:1788530249.798057:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530249.798075:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788530249.798081:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03765c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875409555820416:0@lo:400:kworker.0 00000100:00100000:2.0:1788530249.798101:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530249.798116:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03767800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555820928:0@lo:400:kworker.0 00000100:00100000:2.0:1788530249.798135:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530249.798148:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555821440:0@lo:400:kworker.0 00000100:00100000:2.0:1788530249.798167:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530249.798194:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555820544 00000100:00100000:2.0:1788530249.798201:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555820544 00000100:00100000:2.0:1788530249.798432:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788530249.798447:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555820544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530249.798613:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788530249.798623:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0263c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555821696:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788530249.798655:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530249.798727:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555820672 00000100:00100000:3.0:1788530249.798731:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555820672 00000100:00100000:3.0:1788530249.798795:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555821184 00000100:00100000:3.0:1788530249.798799:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555821184 00000100:00100000:3.0:1788530249.798815:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555820288 00000100:00100000:3.0:1788530249.798818:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555820288 00000100:00100000:3.0:1788530249.798829:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555820800 00000100:00100000:3.0:1788530249.798831:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555820800 00000100:00100000:3.0:1788530249.798842:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555821312 00000100:00100000:3.0:1788530249.798855:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555821312 00000100:00100000:3.0:1788530249.798870:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555820416 00000100:00100000:3.0:1788530249.798872:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555820416 00000100:00100000:3.0:1788530249.798884:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1788530249.798891:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875409555820672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530249.798946:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875409555820672:12345-0@lo:400:kworker.0 Request processed in 55us (1062us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530249.798955:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1788530249.798974:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1788530249.798980:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875409555821184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530249.799008:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875409555821184:12345-0@lo:400:kworker.0 Request processed in 29us (1073us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530249.799014:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1788530249.799025:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1788530249.799031:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875409555820288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530249.799061:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875409555820288:12345-0@lo:400:kworker.0 Request processed in 30us (1073us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530249.799067:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1788530249.799078:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1788530249.799083:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875409555820800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530249.799109:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875409555820800:12345-0@lo:400:kworker.0 Request processed in 26us (1085us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530249.799115:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1788530249.799126:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1788530249.799133:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875409555821312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530249.799171:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875409555821312:12345-0@lo:400:kworker.0 Request processed in 39us (1113us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530249.799183:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1788530249.799195:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1788530249.799200:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875409555820416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530249.799236:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875409555820416:12345-0@lo:400:kworker.0 Request processed in 36us (1134us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530249.799242:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1788530249.799261:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555821056 00000100:00100000:3.0:1788530249.799264:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555821056 00000100:00100000:3.0:1788530249.799281:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555821568 00000100:00100000:3.0:1788530249.799284:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555821568 00000100:00100000:3.0:1788530249.799293:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555820928 00000100:00100000:3.0:1788530249.799295:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555820928 00000100:00100000:3.0:1788530249.799305:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555821440 00000100:00100000:3.0:1788530249.799307:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555821440 00000100:00100000:3.0:1788530249.799317:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788530249.799323:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555821056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530249.799360:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555821056:12345-0@lo:400:kworker.0 Request processed in 37us (1874us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530249.799367:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788530249.799376:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788530249.799381:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555821568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530249.799403:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555821568:12345-0@lo:400:kworker.0 Request processed in 23us (1854us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530249.799779:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555820544:12345-0@lo:400:kworker.0 Request processed in 1335us (2394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530249.799787:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788530249.799841:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788530249.799975:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788530249.799986:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03c52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555821824:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788530249.800020:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530249.800090:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788530249.800101:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555820928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530249.800157:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555820928:12345-0@lo:400:kworker.0 Request processed in 60us (2021us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530249.800173:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788530249.800186:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788530249.800192:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555821440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530249.800234:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555821440:12345-0@lo:400:kworker.0 Request processed in 42us (2065us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530249.800240:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788530249.800285:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03765c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875409555820416:0@lo:400:kworker.0 00010000:00080000:2.0:1788530249.800300:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e03767800 x1875409555820928/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788530265 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530249.800310:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03767800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555820928:0@lo:400:kworker.0 00000100:00100000:2.0:1788530249.800320:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555821440:0@lo:400:kworker.0 00000100:00100000:2.0:1788530249.800331:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03767480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875409555820288:0@lo:400:kworker.0 00010000:00080000:2.0:1788530249.800353:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e03764700 x1875409555820800/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530265 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530249.800363:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03764700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875409555820800:0@lo:400:kworker.0 00000100:00100000:1.0:1788530249.800373:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555820160 00010000:00080000:2.0:1788530249.800374:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e037e5880 x1875409555821312/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530265 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530249.800379:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555820160 00000100:00100000:2.0:1788530249.800381:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875409555821312:0@lo:400:kworker.0 00000100:00100000:2.0:1788530249.800404:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788530249.800410:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03692a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555821952:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788530249.800410:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 426 00000100:00100000:1.0:1788530249.800417:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:3649:x1875409555820160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530249.800447:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530249.800451:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:3649:x1875409555820160:12345-0@lo:400:kworker.0 Request processed in 36us (2804us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530249.800457:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 426 00000100:00100000:2.0:1788530249.800472:0:9912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555821696 00000100:00100000:2.0:1788530249.800480:0:9912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555821696 00000100:00100000:2.0:1788530249.800498:0:9912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555821824 00000100:00100000:2.0:1788530249.800501:0:9912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555821824 00000100:00100000:2.0:1788530249.800511:0:9912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555821952 00000100:00100000:2.0:1788530249.800513:0:9912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555821952 00000100:00100000:2.0:1788530249.800524:0:9912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00080000:1.0:1788530249.800525:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788530249.800529:0:9912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0263ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555821696:12345-0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788530249.800529:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788530249.800532:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788530249.800534:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788530249.800545:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788530249.800552:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555821824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788530249.800581:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00002000:00000024:2.0:1788530249.800584:0:9912:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788530249.800612:0:9912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0263ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555821696:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (1956us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530249.800618:0:9912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788530249.800627:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555821824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530249.800630:0:9912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788530249.800634:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788530249.800637:0:9912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555821952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788530249.800645:0:9912:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00010000:00080000:1.0:1788530249.800657:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e03c52680 x1875409555821824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530265 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530249.800670:0:9912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555821952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 34us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530249.800670:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03c52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555821824:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788530249.800688:0:9912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788530249.800694:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788530249.800702:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555822080:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788530249.800708:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:2.0:1788530249.800713:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a9e03693b80, transno 4294967301 00000100:00100000:2.0:1788530249.800727:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03692a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555821952:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788530249.800728:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530249.800746:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555822080 00000100:00100000:1.0:1788530249.800749:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555822080 00000100:00100000:1.0:1788530249.800768:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788530249.800772:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0375ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555822080:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788530249.800781:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788530249.800805:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0375ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555822080:12345-0@lo:13:osp-pre-0-1.0 Request processed in 33us (78us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530249.800811:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00010000:00080000:1.0:1788530249.800833:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e027da680 x1875409555822080/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530265 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530249.800846:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555822080:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788530249.800868:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0263c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555821696:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788530249.800878:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03765f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3649:1875409555820160:0@lo:400:kworker.0 00000100:00100000:2.0:1788530249.800889:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875409555820672:0@lo:400:kworker.0 00000100:00100000:2.0:1788530249.800899:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875409555821184:0@lo:400:kworker.0 00000100:00100000:2.0:1788530249.800909:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03766a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555820544:0@lo:400:kworker.0 00010000:00080000:2.0:1788530249.800929:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e037e5500 x1875409555821056/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788530265 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530249.800937:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555821056:0@lo:400:kworker.0 00000100:00100000:2.0:1788530249.800946:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555821568:0@lo:400:kworker.0 00010000:00010000:2.0:1788530249.922526:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788530250.735199:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530250.735268:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530250.735304:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530250.735338:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531599744 00000100:00100000:3.0:1788530250.735354:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530250.735356:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531599744 00000100:00100000:3.0:1788530250.735388:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530250.735415:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530250.735451:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 427 00000100:00100000:0.0:1788530250.735474:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f442bcd-b742-4e76-ad7b-709f731358a0+14:2400:x1875409531599744:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1788530250.735593:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f442bcd-b742-4e76-ad7b-709f731358a0+14:2400:x1875409531599744:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 90us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530250.735615:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 427 00000100:00100000:3.0:1788530250.735702:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531600000 00000100:00100000:3.0:1788530250.735708:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531600000 00000100:00100000:3.0:1788530250.735770:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531600256 00000100:00100000:3.0:1788530250.735774:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531600256 00000100:00100000:0.0:1788530250.735784:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531599872 00000100:00100000:0.0:1788530250.735790:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531599872 00000100:00100000:3.0:1788530250.735798:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531600384 00000100:00100000:3.0:1788530250.735803:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531600384 00000100:00100000:0.0:1788530250.735823:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 290 00000100:00100000:3.0:1788530250.735832:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 291 00000100:00100000:0.0:1788530250.735836:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0263c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2400:x1875409531600000:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1788530250.735846:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0263c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2400:x1875409531600256:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1788530250.735884:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0263c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2400:x1875409531600000:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 51us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530250.735885:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0263c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2400:x1875409531600256:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 42us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530250.735901:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 290 00000100:00080000:1.0:1788530250.735947:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788530250.735951:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788530250.736228:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 291 00000100:00100000:1.0:1788530250.736240:0:10719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 292 00000100:00100000:3.0:1788530250.736248:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 293 00000100:00100000:1.0:1788530250.736255:0:10719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0263d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2400:x1875409531599872:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1788530250.736261:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0263f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2400:x1875409531600384:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1788530250.736301:0:10719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0263d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2400:x1875409531599872:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 50us (945us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530250.736309:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0263f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2400:x1875409531600384:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 51us (890us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530250.736315:0:10719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 292 00000100:00100000:3.0:1788530250.736324:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 293 00000100:00100000:3.0:1788530250.736368:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531600128 00000100:00100000:3.0:1788530250.736373:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531600128 00000100:00100000:3.0:1788530250.736416:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 88 00000100:00100000:3.0:1788530250.736422:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f33f9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2400:x1875409531600128:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1788530250.736732:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f33f9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2400:x1875409531600128:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 309us (1343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530250.736740:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 88 00000100:00080000:1.0:1788530250.737686:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788530250.817606:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0263df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555822208:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788530250.817704:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530250.826287:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555822208 00000100:00100000:1.0:1788530250.826312:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555822208 00000100:00100000:1.0:1788530250.826403:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788530250.826417:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555822208:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788530250.826485:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446453248 avail 1300213760 00000100:00100000:1.0:1788530250.826620:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555822208:12345-0@lo:41:osp-pre-1-0.0 Request processed in 205us (8916us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530250.826630:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788530250.826678:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0263df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555822208:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788530250.944895:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530251.971673:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530252.993125:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530254.016961:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788530254.401901:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788530254.401940:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03c50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555822336:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788530254.402037:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530254.402387:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555822336 00000100:00100000:0.0:1788530254.402398:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555822336 00000100:00100000:0.0:1788530254.402478:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788530254.402492:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0375c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555822336:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788530254.402541:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788530254.402627:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0375c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555822336:12345-0@lo:41:osp-pre-0-1.0 Request processed in 137us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530254.402635:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788530254.405462:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03c50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555822336:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788530254.918110:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0375c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555822464:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788530254.918226:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530254.918344:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0375f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555822592:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788530254.918376:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530254.918434:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555822464 00000100:00100000:1.0:1788530254.918448:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555822464 00000100:00100000:1.0:1788530254.918529:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555822592 00000100:00100000:1.0:1788530254.918533:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555822592 00000100:00100000:1.0:1788530254.918554:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788530254.918583:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0375ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555822464:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788530254.918621:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788530254.918670:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0375ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555822464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530254.918677:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788530254.918700:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788530254.918706:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0375f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555822592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788530254.918716:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788530254.918742:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0375f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555822592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 37us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530254.918761:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00080000:1.0:1788530254.919160:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788530254.919307:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e0375f100 x1875409555822592/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530270 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530254.919339:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0375f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555822592:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1788530254.919391:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e0375c000 x1875409555822464/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530270 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530254.919406:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0375c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555822464:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788530254.922485:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0375c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555822720:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788530254.922580:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530254.922644:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555822720 00000100:00100000:1.0:1788530254.922650:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555822720 00000100:00100000:1.0:1788530254.922708:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788530254.922721:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0375f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555822720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788530254.922758:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788530254.925061:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0375f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555822720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2333us (2471us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530254.925074:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:1.0:1788530254.926386:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788530254.926475:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0375c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555822720:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788530254.930003:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0263df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3647:1875409555822848:0@lo:400:kworker.0 00000100:00100000:1.0:1788530254.930299:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530254.930362:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37371880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875409555823360:0@lo:400:kworker.0 00000100:00100000:1.0:1788530254.930409:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530254.930433:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03c91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555823872:0@lo:400:kworker.0 00000100:00100000:1.0:1788530254.930461:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530254.930498:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788530254.930506:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0263d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875409555822976:0@lo:400:kworker.0 00000100:00100000:1.0:1788530254.930530:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530254.930553:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875409555823488:0@lo:400:kworker.0 00000100:00100000:1.0:1788530254.930602:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530254.930622:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03c92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555824000:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788530254.930644:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530254.930680:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37370e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875409555823104:0@lo:400:kworker.0 00000100:00100000:1.0:1788530254.930707:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530254.930727:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875409555823616:0@lo:400:kworker.0 00000100:00100000:1.0:1788530254.930749:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530254.930766:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788530254.931465:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555822848 00000100:00100000:2.0:1788530254.931477:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555822848 00000100:00100000:2.0:1788530254.931556:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 428 00000100:00100000:2.0:1788530254.931583:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:3647:x1875409555822848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530254.931659:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:3647:x1875409555822848:12345-0@lo:400:kworker.0 Request processed in 79us (1360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530254.931667:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 428 00000100:00100000:2.0:1788530254.931716:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555823360 00000100:00100000:2.0:1788530254.931720:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555823360 00000100:00100000:1.0:1788530254.932917:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37371f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555823232:0@lo:400:kworker.0 00000100:00100000:1.0:1788530254.932993:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530254.933035:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875409555823744:0@lo:400:kworker.0 00000100:00100000:1.0:1788530254.933059:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530254.933142:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555822976 00000100:00100000:1.0:1788530254.933148:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555822976 00000100:00100000:2.0:1788530254.933324:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555823488 00000100:00100000:2.0:1788530254.933330:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555823488 00000100:00100000:1.0:1788530254.933538:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555823104 00000100:00100000:1.0:1788530254.933546:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555823104 00000100:00100000:1.0:1788530254.933580:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555823616 00000100:00100000:1.0:1788530254.933583:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555823616 00000100:00100000:1.0:1788530254.933601:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555823744 00000100:00100000:1.0:1788530254.933612:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555823744 00000100:00100000:1.0:1788530254.933634:0:10719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1788530254.933642:0:10719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0375c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875409555823360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530254.933695:0:10719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0375c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875409555823360:12345-0@lo:400:kworker.0 Request processed in 54us (3285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530254.933702:0:10719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1788530254.933719:0:10719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1788530254.933724:0:10719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875409555822976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530254.933749:0:10719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875409555822976:12345-0@lo:400:kworker.0 Request processed in 25us (3219us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530254.933755:0:10719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1788530254.933770:0:10719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1788530254.933791:0:10719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875409555823104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530254.933826:0:10719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875409555823104:12345-0@lo:400:kworker.0 Request processed in 36us (3118us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530254.933832:0:10719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1788530254.933844:0:10719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1788530254.933850:0:10719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32bd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875409555823616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530254.933877:0:10719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32bd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875409555823616:12345-0@lo:400:kworker.0 Request processed in 28us (3127us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530254.933883:0:10719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1788530254.933893:0:10719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1788530254.933899:0:10719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32bd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875409555823744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530254.933923:0:10719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32bd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875409555823744:12345-0@lo:400:kworker.0 Request processed in 25us (864us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530254.933937:0:10719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1788530254.933962:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555823872 00000100:00100000:1.0:1788530254.933966:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555823872 00000100:00100000:1.0:1788530254.934003:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788530254.934010:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555823872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530254.934044:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555823872:12345-0@lo:400:kworker.0 Request processed in 35us (3582us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530254.934050:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788530254.934082:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555824000 00000100:00100000:1.0:1788530254.934086:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555824000 00000100:00100000:1.0:1788530254.934126:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788530254.934134:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555824000:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788530254.934151:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788530254.934192:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555824000:12345-0@lo:13:osp-pre-1-1.0 Request processed in 59us (3546us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530254.934199:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788530254.934245:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555823232 00000100:00100000:1.0:1788530254.934250:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555823232 00000100:00100000:1.0:1788530254.934276:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788530254.934281:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32bd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555823232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530254.934312:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32bd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555823232:12345-0@lo:400:kworker.0 Request processed in 31us (1322us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530254.934317:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788530254.934364:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37371f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555823232:0@lo:400:kworker.0 00010000:00080000:1.0:1788530254.934382:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e037d5880 x1875409555823744/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530254.934407:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875409555823744:0@lo:400:kworker.0 00000100:00100000:1.0:1788530254.934421:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37370e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875409555823104:0@lo:400:kworker.0 00000100:00100000:1.0:1788530254.934432:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875409555823616:0@lo:400:kworker.0 00000100:00100000:2.0:1788530254.939041:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1788530254.939072:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875409555823488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530254.939167:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875409555823488:12345-0@lo:400:kworker.0 Request processed in 110us (8563us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530254.939192:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1788530254.939254:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0263d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875409555822976:0@lo:400:kworker.0 00010000:00080000:2.0:1788530254.939271:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f328e7b80 x1875409555823488/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530254.939281:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875409555823488:0@lo:400:kworker.0 00000100:00100000:2.0:1788530254.939301:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03c92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555824000:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788530254.939312:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0263df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3647:1875409555822848:0@lo:400:kworker.0 00000100:00100000:2.0:1788530254.939324:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37371880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875409555823360:0@lo:400:kworker.0 00000100:00100000:2.0:1788530254.939332:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03c91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555823872:0@lo:400:kworker.0 00000100:00080000:2.0:1788530254.939373:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788530254.939382:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788530254.939385:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788530255.042535:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788530255.855123:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530255.855261:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530255.855384:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530255.857838:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531600768 00000100:00100000:2.0:1788530255.857858:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531600768 00000100:00100000:2.0:1788530255.857974:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531600640 00000100:00100000:2.0:1788530255.857978:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531600640 00000100:00100000:2.0:1788530255.858008:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 300 00000100:00100000:2.0:1788530255.858025:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32bd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2400:x1875409531600768:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1788530255.858115:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32bd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2400:x1875409531600768:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 97us (2852us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530255.858123:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 300 00000100:00100000:2.0:1788530255.858142:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 301 00000100:00100000:2.0:1788530255.858150:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32bd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2400:x1875409531600640:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1788530255.858202:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32bd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2400:x1875409531600640:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 53us (2817us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530255.858210:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 301 00000100:00080000:1.0:1788530255.859064:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788530255.859072:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788530255.859223:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531600512 00000100:00100000:0.0:1788530255.859232:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531600512 00000100:00100000:0.0:1788530255.859330:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 429 00000100:00100000:0.0:1788530255.859340:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f442bcd-b742-4e76-ad7b-709f731358a0+14:2400:x1875409531600512:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1788530255.859587:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f442bcd-b742-4e76-ad7b-709f731358a0+14:2400:x1875409531600512:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 248us (4477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530255.859608:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 429 00000100:00100000:1.0:1788530255.861316:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530255.861367:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530255.861547:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531600896 00000100:00100000:2.0:1788530255.861557:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531600896 00000100:00100000:2.0:1788530255.861676:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 27 00000100:00100000:2.0:1788530255.861690:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2398:x1875409531600896:12345-192.168.202.41@tcp:9:kworker.0 00000020:00000080:2.0:1788530255.861722:0:8439:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e125750782 00000100:00080000:2.0:1788530255.861731:0:8439:0:(import.c:65:import_set_state_nolock()) ffff9a9f37415000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788530255.861775:0:8439:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:3.0:1788530255.861979:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531601152 00000100:00100000:3.0:1788530255.861984:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531601152 00000100:00100000:3.0:1788530255.862037:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 302 00000100:00100000:3.0:1788530255.862046:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2400:x1875409531601152:12345-192.168.202.41@tcp:400:kworker.0 00000100:00080000:0.0:1788530255.862121:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788530255.862127:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788530255.862171:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788530255.863969:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+2:2398:x1875409531600896:12345-192.168.202.41@tcp:9:kworker.0 Request processed in 2268us (2648us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530255.863987:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 27 00000100:00100000:3.0:1788530255.865121:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2400:x1875409531601152:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 3069us (3745us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530255.865135:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 302 00000100:00100000:1.0:1788530255.865265:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530255.865404:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531601024 00000100:00100000:2.0:1788530255.865412:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531601024 00000100:00100000:2.0:1788530255.865500:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 303 00000100:00100000:2.0:1788530255.865511:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37371880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2400:x1875409531601024:12345-192.168.202.41@tcp:400:kworker.0 00000100:00080000:3.0:1788530255.865737:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788530255.866291:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37371880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2400:x1875409531601024:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 777us (1022us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530255.866302:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 303 00000040:00080000:1.0:1788530255.937634:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788530255.940103:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03c90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555824128:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788530255.940261:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530255.941515:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555824128 00000100:00100000:3.0:1788530255.941527:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555824128 00000100:00100000:3.0:1788530255.941602:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788530255.941614:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37370e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555824128:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788530255.941653:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446453248 avail 1300213760 00000100:00100000:3.0:1788530255.941736:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37370e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555824128:12345-0@lo:41:osp-pre-1-0.0 Request processed in 124us (1475us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530255.941744:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788530255.941800:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03c90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555824128:0@lo:41:osp-pre-1-0.0 00000040:00080000:0.0:1788530255.942027:0:13816:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788530256.069655:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530257.090222:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530258.115339:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530259.136786:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788530259.521822:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03c50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555824256:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788530259.521894:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530259.522088:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555824256 00000100:00100000:0.0:1788530259.522097:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555824256 00000100:00100000:0.0:1788530259.522161:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788530259.522171:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37371f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555824256:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788530259.522213:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788530259.522270:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37371f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555824256:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530259.522278:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788530259.522373:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03c50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555824256:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788530260.033181:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788530260.033211:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d3f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555824384:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788530260.033324:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530260.033434:0:9912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555824384 00000100:00100000:1.0:1788530260.033446:0:9912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555824384 00000100:00100000:1.0:1788530260.033554:0:9912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788530260.033593:0:9912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d3fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555824384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788530260.033648:0:9912:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788530260.033731:0:9912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d3fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555824384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 141us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530260.033739:0:9912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788530260.033817:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d3f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555824384:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788530260.034463:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788530260.034478:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03c53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555824512:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788530260.034533:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788530260.034834:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788530260.034979:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03c51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3649:1875409555824640:0@lo:400:kworker.0 00000100:00100000:0.0:1788530260.035015:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530260.035048:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03c51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875409555825152:0@lo:400:kworker.0 00000100:00100000:0.0:1788530260.035074:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530260.035090:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03c52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875409555825664:0@lo:400:kworker.0 00000100:00100000:0.0:1788530260.035108:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530260.035139:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788530260.035145:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03c52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875409555824768:0@lo:400:kworker.0 00000100:00100000:0.0:1788530260.035165:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530260.035183:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03c50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875409555825280:0@lo:400:kworker.0 00000100:00100000:0.0:1788530260.035216:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530260.035233:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03c50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875409555825792:0@lo:400:kworker.0 00000100:00100000:0.0:1788530260.035251:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530260.035281:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555825152 00000100:00100000:0.0:1788530260.035289:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555825152 00000100:00100000:0.0:1788530260.035355:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555825664 00000100:00100000:0.0:1788530260.035358:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555825664 00000100:00100000:0.0:1788530260.035373:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555824768 00000100:00100000:0.0:1788530260.035376:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555824768 00000100:00100000:0.0:1788530260.035386:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555825280 00000100:00100000:0.0:1788530260.035388:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555825280 00000100:00100000:0.0:1788530260.035399:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555825792 00000100:00100000:0.0:1788530260.035401:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555825792 00000100:00100000:0.0:1788530260.035416:0:10719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1788530260.035423:0:10719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875409555825152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530260.035471:0:10719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875409555825152:12345-0@lo:400:kworker.0 Request processed in 48us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530260.035479:0:10719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1788530260.035495:0:10719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1788530260.035502:0:10719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875409555825664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530260.035528:0:10719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875409555825664:12345-0@lo:400:kworker.0 Request processed in 27us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530260.035553:0:10719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1788530260.035588:0:10719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1788530260.035595:0:10719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875409555824768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530260.035621:0:10719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875409555824768:12345-0@lo:400:kworker.0 Request processed in 27us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530260.035637:0:10719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1788530260.035649:0:10719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1788530260.035655:0:10719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875409555825280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530260.035683:0:10719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875409555825280:12345-0@lo:400:kworker.0 Request processed in 28us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530260.035689:0:10719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1788530260.035700:0:10719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1788530260.035706:0:10719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875409555825792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530260.035732:0:10719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875409555825792:12345-0@lo:400:kworker.0 Request processed in 26us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530260.035738:0:10719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00080000:0.0:1788530260.035755:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788530260.035759:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788530260.035790:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03c52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875409555824768:0@lo:400:kworker.0 00010000:00080000:0.0:1788530260.035804:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e03c50000 x1875409555825280/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530276 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530260.035816:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03c50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875409555825280:0@lo:400:kworker.0 00010000:00080000:0.0:1788530260.035826:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e03c50e00 x1875409555825792/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530276 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530260.035835:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03c50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875409555825792:0@lo:400:kworker.0 00000100:00100000:0.0:1788530260.035846:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03c51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875409555825152:0@lo:400:kworker.0 00000100:00100000:0.0:1788530260.035854:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03c52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875409555825664:0@lo:400:kworker.0 00000100:00100000:3.0:1788530260.036225:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03c51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875409555824896:0@lo:400:kworker.0 00000100:00100000:3.0:1788530260.036254:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530260.036271:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03c50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555825408:0@lo:400:kworker.0 00000100:00100000:3.0:1788530260.036292:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530260.036316:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03c53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555825920:0@lo:400:kworker.0 00000100:00100000:3.0:1788530260.036335:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530260.036351:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788530260.036357:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03c53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555825024:0@lo:400:kworker.0 00000100:00100000:3.0:1788530260.036379:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530260.036394:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03c52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555825536:0@lo:400:kworker.0 00000100:00100000:3.0:1788530260.036411:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530260.036436:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555825408 00000100:00100000:3.0:1788530260.036440:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555825408 00000100:00100000:3.0:1788530260.036476:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555825920 00000100:00100000:3.0:1788530260.036479:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555825920 00000100:00100000:3.0:1788530260.036491:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555825536 00000100:00100000:3.0:1788530260.036493:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555825536 00000100:00100000:3.0:1788530260.036505:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788530260.036511:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555825408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530260.036741:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555825408:12345-0@lo:400:kworker.0 Request processed in 228us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530260.036748:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788530260.036763:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788530260.036770:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555825920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530260.036799:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555825920:12345-0@lo:400:kworker.0 Request processed in 30us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530260.036805:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788530260.036815:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788530260.036821:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555825536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530260.036846:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555825536:12345-0@lo:400:kworker.0 Request processed in 25us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530260.037009:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555824640 00000100:00100000:2.0:1788530260.037013:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555824640 00000100:00100000:2.0:1788530260.037048:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 430 00000100:00100000:2.0:1788530260.037055:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:3649:x1875409555824640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530260.037092:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:3649:x1875409555824640:12345-0@lo:400:kworker.0 Request processed in 38us (2077us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530260.037098:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 430 00000100:00100000:2.0:1788530260.037139:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555824896 00000100:00100000:2.0:1788530260.037142:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555824896 00000100:00100000:2.0:1788530260.037176:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1788530260.037183:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875409555824896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530260.037209:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875409555824896:12345-0@lo:400:kworker.0 Request processed in 27us (954us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530260.037214:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1788530260.037262:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788530260.037271:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555826176:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788530260.037294:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530260.037330:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03c51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3649:1875409555824640:0@lo:400:kworker.0 00000100:00100000:2.0:1788530260.037367:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555825024 00000100:00100000:2.0:1788530260.037370:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555825024 00000100:00100000:2.0:1788530260.037392:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788530260.037398:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555825024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530260.037427:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555825024:12345-0@lo:400:kworker.0 Request processed in 29us (1047us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530260.037432:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00080000:2.0:1788530260.037456:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788530260.037460:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788530260.037483:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03c53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555825024:0@lo:400:kworker.0 00000100:00100000:3.0:1788530260.038390:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00010000:00080000:2.0:1788530260.038460:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e03c52680 x1875409555825536/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788530276 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530260.038470:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03c52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555825536:0@lo:400:kworker.0 00000100:00100000:2.0:1788530260.038486:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03c51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875409555824896:0@lo:400:kworker.0 00010000:00080000:2.0:1788530260.038493:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e03c50700 x1875409555825408/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788530276 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530260.038499:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03c50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555825408:0@lo:400:kworker.0 00000100:00100000:2.0:1788530260.038505:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03c53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555825920:0@lo:400:kworker.0 00000100:00100000:2.0:1788530260.038527:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788530260.038701:0:9912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555824512 00000100:00100000:1.0:1788530260.038708:0:9912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555824512 00000100:00100000:1.0:1788530260.038759:0:9912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555826176 00000100:00100000:1.0:1788530260.038763:0:9912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555826176 00000100:00100000:1.0:1788530260.038780:0:9912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788530260.038789:0:9912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555824512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788530260.038829:0:9912:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788530260.038905:0:9912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555824512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (4371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530260.038912:0:9912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788530260.038929:0:9912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788530260.038935:0:9912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555826176:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788530260.038946:0:9912:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788530260.038983:0:9912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555826176:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (1688us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530260.038989:0:9912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788530260.039026:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555826176:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788530260.040048:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555826048:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788530260.040130:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788530260.040226:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e03c53480 x1875409555824512/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530276 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530260.040279:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03c53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555824512:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788530260.040399:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555826048 00000100:00100000:0.0:1788530260.040434:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555826048 00000100:00100000:0.0:1788530260.040498:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788530260.040508:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555826048:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788530260.040529:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788530260.041816:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555826048:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1298us (1684us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530260.042629:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00010000:00080000:2.0:1788530260.042854:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e037e5500 x1875409555826048/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530276 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530260.042888:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555826048:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788530260.160988:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788530260.969419:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530260.969466:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530260.969502:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530260.969547:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530260.969624:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530260.970006:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531601536 00000100:00100000:2.0:1788530260.970019:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531601536 00000100:00100000:2.0:1788530260.970140:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531601792 00000100:00100000:2.0:1788530260.970144:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531601792 00000100:00100000:2.0:1788530260.970174:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531601408 00000100:00100000:2.0:1788530260.970178:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531601408 00000100:00100000:2.0:1788530260.970205:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531601664 00000100:00100000:2.0:1788530260.970208:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531601664 00000100:00100000:2.0:1788530260.970227:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 310 00000100:00100000:2.0:1788530260.970239:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d3f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2399:x1875409531601536:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1788530260.970341:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d3f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2399:x1875409531601536:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 104us (874us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530260.970351:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 310 00000100:00100000:2.0:1788530260.970371:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 311 00000100:00100000:2.0:1788530260.970379:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d3fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2399:x1875409531601792:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1788530260.970402:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d3fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2399:x1875409531601792:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 25us (900us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530260.970409:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 311 00000100:00100000:2.0:1788530260.970420:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 312 00000100:00100000:2.0:1788530260.970426:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d3fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2399:x1875409531601408:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1788530260.970449:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d3fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2399:x1875409531601408:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 24us (912us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530260.970455:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 312 00000100:00100000:2.0:1788530260.970465:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 313 00000100:00100000:2.0:1788530260.970472:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d3f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2399:x1875409531601664:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1788530260.970491:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d3f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2399:x1875409531601664:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 20us (867us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530260.970497:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 313 00000100:00100000:0.0:1788530260.970672:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531601280 00000100:00100000:0.0:1788530260.970678:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531601280 00000100:00100000:0.0:1788530260.970713:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 431 00000100:00100000:0.0:1788530260.970721:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f442bcd-b742-4e76-ad7b-709f731358a0+14:2399:x1875409531601280:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1788530260.970749:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f442bcd-b742-4e76-ad7b-709f731358a0+14:2399:x1875409531601280:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 29us (1343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530260.970755:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 431 00000100:00080000:1.0:1788530260.971494:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788530260.971499:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788530261.057407:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37408380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555826304:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788530261.057490:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530261.057962:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555826304 00000100:00100000:0.0:1788530261.057971:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555826304 00000100:00100000:0.0:1788530261.058035:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788530261.058047:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d3f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555826304:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788530261.058088:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446453248 avail 1300213760 00000100:00100000:0.0:1788530261.058152:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d3f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555826304:12345-0@lo:41:osp-pre-1-0.0 Request processed in 107us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530261.058159:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788530261.058262:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37408380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555826304:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788530261.186827:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788530262.082741:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41 00000020:00000080:1.0:1788530262.082752:0:9518:0:(genops.c:885:class_export_put()) final put ffff9a9f373f3000/aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41 00000020:00000080:3.0:1788530262.082836:0:12493:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f373f3000/aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41 for lustre-OST0001 00000020:00000080:3.0:1788530262.082900:0:12493:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a9f37415000 for lustre-OST0001 00010000:00010000:2.0:1788530262.208802:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530263.233448:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530264.256816:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788530264.642072:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788530264.642108:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555826432:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788530264.642184:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530264.642290:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555826432 00000100:00100000:0.0:1788530264.642306:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555826432 00000100:00100000:0.0:1788530264.642370:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788530264.642380:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37408380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555826432:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788530264.642418:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788530264.642481:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37408380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555826432:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530264.642488:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788530264.642540:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555826432:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788530265.153552:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3735d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875409555826688:0@lo:400:kworker.0 00000100:00100000:3.0:1788530265.153650:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530265.153704:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f08db7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875409555827200:0@lo:400:kworker.0 00000100:00100000:3.0:1788530265.153728:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530265.153746:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875409555827712:0@lo:400:kworker.0 00000100:00100000:3.0:1788530265.153767:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530265.153798:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788530265.153804:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3735dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555826816:0@lo:400:kworker.0 00000100:00100000:3.0:1788530265.153830:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530265.153848:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f08db4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875409555827328:0@lo:400:kworker.0 00000100:00100000:3.0:1788530265.153866:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530265.153883:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875409555827840:0@lo:400:kworker.0 00000100:00100000:3.0:1788530265.153901:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1788530265.154485:0:13816:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788530265.154545:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555826688 00000100:00100000:3.0:1788530265.154553:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555826688 00000100:00100000:3.0:1788530265.154616:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555827200 00000100:00100000:3.0:1788530265.154632:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555827200 00000100:00100000:3.0:1788530265.154653:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555827712 00000100:00100000:3.0:1788530265.154655:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555827712 00000100:00100000:3.0:1788530265.154664:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555827328 00000100:00100000:3.0:1788530265.154666:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555827328 00000100:00100000:3.0:1788530265.154676:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555827840 00000100:00100000:3.0:1788530265.154678:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555827840 00000100:00100000:3.0:1788530265.154690:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1788530265.154698:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875409555826688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530265.154747:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875409555826688:12345-0@lo:400:kworker.0 Request processed in 50us (1098us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530265.154753:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1788530265.154767:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1788530265.154772:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d25ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875409555827200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530265.154793:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d25ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875409555827200:12345-0@lo:400:kworker.0 Request processed in 21us (1064us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530265.154798:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1788530265.154806:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1788530265.154811:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d259c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875409555827712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530265.154829:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d259c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875409555827712:12345-0@lo:400:kworker.0 Request processed in 19us (1062us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530265.154834:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1788530265.154843:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1788530265.154848:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875409555827328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530265.154866:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875409555827328:12345-0@lo:400:kworker.0 Request processed in 18us (1000us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530265.154872:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1788530265.154887:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1788530265.154892:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875409555827840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530265.154914:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875409555827840:12345-0@lo:400:kworker.0 Request processed in 22us (1011us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530265.154919:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1788530265.154940:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555826816 00000100:00100000:3.0:1788530265.154943:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555826816 00000100:00100000:3.0:1788530265.154962:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788530265.154967:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555826816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530265.154992:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555826816:12345-0@lo:400:kworker.0 Request processed in 25us (1161us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530265.154998:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788530265.155049:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3735dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555826816:0@lo:400:kworker.0 00010000:00080000:3.0:1788530265.155061:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f08db4380 x1875409555827328/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530281 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530265.155082:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f08db4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875409555827328:0@lo:400:kworker.0 00010000:00080000:3.0:1788530265.155091:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f3d2a3100 x1875409555827840/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530281 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530265.155100:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875409555827840:0@lo:400:kworker.0 00000100:00100000:3.0:1788530265.155108:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3735d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875409555826688:0@lo:400:kworker.0 00000100:00100000:3.0:1788530265.155117:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f08db7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875409555827200:0@lo:400:kworker.0 00000100:00100000:3.0:1788530265.155124:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875409555827712:0@lo:400:kworker.0 00000100:00100000:1.0:1788530265.157108:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f08db5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875409555826944:0@lo:400:kworker.0 00000100:00100000:1.0:1788530265.157198:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530265.157247:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555827456:0@lo:400:kworker.0 00000100:00100000:1.0:1788530265.157272:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530265.157294:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555827968:0@lo:400:kworker.0 00000100:00100000:1.0:1788530265.157315:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530265.157343:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1788530265.157350:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3735c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3647:1875409555826560:0@lo:400:kworker.0 00000100:00100000:1.0:1788530265.157378:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530265.157399:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f08db4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555827072:0@lo:400:kworker.0 00000100:00100000:1.0:1788530265.157421:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530265.157438:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555827584:0@lo:400:kworker.0 00000100:00100000:1.0:1788530265.157458:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530265.157475:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555828096:0@lo:400:kworker.0 00000100:00100000:1.0:1788530265.157497:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788530265.157524:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788530265.157530:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788530265.157614:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555826944 00000100:00100000:1.0:1788530265.157621:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555826944 00000100:00100000:1.0:1788530265.157676:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1788530265.157698:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e035f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875409555826944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530265.157749:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e035f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875409555826944:12345-0@lo:400:kworker.0 Request processed in 53us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530265.157756:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1788530265.157782:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555827456 00000100:00100000:1.0:1788530265.157786:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555827456 00000100:00100000:1.0:1788530265.157811:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555827968 00000100:00100000:1.0:1788530265.157814:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555827968 00000100:00100000:1.0:1788530265.157825:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555827584 00000100:00100000:1.0:1788530265.157828:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555827584 00000100:00100000:1.0:1788530265.157841:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555828096 00000100:00100000:1.0:1788530265.157844:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555828096 00000100:00100000:1.0:1788530265.157858:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788530265.157864:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e035f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555827456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530265.157896:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e035f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555827456:12345-0@lo:400:kworker.0 Request processed in 32us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530265.157902:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788530265.157913:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788530265.157920:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37377800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555827968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530265.157946:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37377800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555827968:12345-0@lo:400:kworker.0 Request processed in 27us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530265.157952:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788530265.157964:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788530265.157970:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37377100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555827584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530265.157998:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37377100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555827584:12345-0@lo:400:kworker.0 Request processed in 28us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530265.158004:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788530265.158023:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788530265.158030:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3960c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555828096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530265.158059:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3960c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555828096:12345-0@lo:400:kworker.0 Request processed in 30us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530265.158066:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788530265.158105:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555826560 00000100:00100000:1.0:1788530265.158113:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555826560 00000100:00100000:1.0:1788530265.158147:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 432 00000100:00100000:1.0:1788530265.158152:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:3647:x1875409555826560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530265.158182:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:3647:x1875409555826560:12345-0@lo:400:kworker.0 Request processed in 29us (803us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530265.158187:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 432 00000100:00100000:1.0:1788530265.158219:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3960d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555828352:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788530265.158243:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530265.158266:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788530265.158272:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3960ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555828224:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788530265.158304:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530265.158351:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3735c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3647:1875409555826560:0@lo:400:kworker.0 00010000:00080000:1.0:1788530265.158364:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f3d2bb800 x1875409555827584/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788530281 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530265.158376:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555827584:0@lo:400:kworker.0 00000100:00100000:1.0:1788530265.158385:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555828096:0@lo:400:kworker.0 00000100:00100000:1.0:1788530265.158393:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f08db5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875409555826944:0@lo:400:kworker.0 00010000:00080000:1.0:1788530265.158402:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f3d2b9c00 x1875409555827456/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788530281 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530265.158418:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555827456:0@lo:400:kworker.0 00000100:00100000:1.0:1788530265.158428:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555827968:0@lo:400:kworker.0 00000100:00080000:1.0:1788530265.158456:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788530265.158459:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788530265.158472:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555828352 00000100:00100000:1.0:1788530265.158475:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555828352 00000100:00100000:1.0:1788530265.158498:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555828224 00000100:00100000:1.0:1788530265.158500:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555828224 00000100:00100000:1.0:1788530265.158512:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788530265.158517:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3960dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555828352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788530265.158544:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788530265.158608:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3960dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555828352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530265.158614:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788530265.158627:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788530265.158633:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f05f46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555828224:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788530265.158642:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788530265.158664:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f05f46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555828224:12345-0@lo:13:osp-pre-1-1.0 Request processed in 31us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530265.158670:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788530265.158704:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3960ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555828224:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788530265.158717:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3960d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555828352:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788530265.158745:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555827072 00000100:00100000:1.0:1788530265.158749:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555827072 00000100:00100000:1.0:1788530265.158785:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788530265.158792:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37376300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555827072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530265.158832:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37376300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555827072:12345-0@lo:400:kworker.0 Request processed in 41us (1409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530265.158840:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788530265.158864:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f08db4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555827072:0@lo:400:kworker.0 00000040:00080000:2.0:1788530265.164253:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788530265.165639:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788530265.165669:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555828480:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788530265.165740:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530265.166298:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555828480 00000100:00100000:1.0:1788530265.166305:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555828480 00000100:00100000:1.0:1788530265.166355:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788530265.166364:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555828480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788530265.166396:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788530265.166447:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555828480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530265.166454:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788530265.167701:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f05f45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555828608:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788530265.167768:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788530265.167818:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f3d2a3b80 x1875409555828480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530281 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530265.167844:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555828480:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788530265.168441:0:9912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555828608 00000100:00100000:1.0:1788530265.168450:0:9912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555828608 00000100:00100000:1.0:1788530265.168509:0:9912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788530265.168517:0:9912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d4e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555828608:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788530265.168538:0:9912:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788530265.168629:0:9912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d4e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555828608:12345-0@lo:13:osp-pre-0-1.0 Request processed in 112us (860us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530265.168637:0:9912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00010000:00080000:3.0:1788530265.169090:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f05f45500 x1875409555828608/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530281 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530265.169107:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f05f45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555828608:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788530265.282069:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788530266.087259:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530266.087314:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530266.087342:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530266.087363:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530266.087391:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530266.087421:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531602176 00000100:00100000:0.0:1788530266.087431:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531602176 00000100:00100000:0.0:1788530266.087504:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531602432 00000100:00100000:0.0:1788530266.087507:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531602432 00000100:00100000:0.0:1788530266.087531:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531602048 00000100:00100000:0.0:1788530266.087534:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531602048 00000100:00100000:0.0:1788530266.087547:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531602304 00000100:00100000:0.0:1788530266.087550:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531602304 00000100:00100000:0.0:1788530266.087590:0:10719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 320 00000100:00100000:0.0:1788530266.087601:0:10719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2401:x1875409531602176:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1788530266.087675:0:10719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2401:x1875409531602176:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 76us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530266.087683:0:10719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 320 00000100:00100000:0.0:1788530266.087703:0:10719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 321 00000100:00100000:0.0:1788530266.087710:0:10719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2401:x1875409531602432:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1788530266.087752:0:10719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2401:x1875409531602432:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 42us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530266.087759:0:10719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 321 00000100:00100000:0.0:1788530266.087772:0:10719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 322 00000100:00100000:0.0:1788530266.087779:0:10719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2401:x1875409531602048:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1788530266.087804:0:10719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2401:x1875409531602048:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 26us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530266.087810:0:10719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 322 00000100:00100000:0.0:1788530266.087823:0:10719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 323 00000100:00100000:0.0:1788530266.087830:0:10719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2401:x1875409531602304:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1788530266.087853:0:10719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2401:x1875409531602304:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 23us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530266.087859:0:10719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 323 00000100:00080000:0.0:1788530266.087882:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788530266.087886:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788530266.088595:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531601920 00000100:00100000:3.0:1788530266.088601:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531601920 00000100:00100000:3.0:1788530266.088640:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 433 00000100:00100000:3.0:1788530266.088646:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f442bcd-b742-4e76-ad7b-709f731358a0+14:2401:x1875409531601920:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1788530266.088683:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f442bcd-b742-4e76-ad7b-709f731358a0+14:2401:x1875409531601920:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 37us (1435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530266.088689:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 433 00000100:00100000:0.0:1788530266.199986:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555828736:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788530266.200077:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530266.200148:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555828736 00000100:00100000:0.0:1788530266.200155:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555828736 00000100:00100000:0.0:1788530266.200196:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788530266.200204:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555828736:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788530266.200236:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446453248 avail 1300213760 00000100:00100000:0.0:1788530266.200275:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555828736:12345-0@lo:41:osp-pre-1-0.0 Request processed in 71us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530266.200299:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788530266.200350:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555828736:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788530266.309092:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530267.329029:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530268.353209:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530269.377696:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788530269.760944:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555828864:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788530269.761039:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530269.761551:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555828864 00000100:00100000:0.0:1788530269.761584:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555828864 00000100:00100000:0.0:1788530269.761645:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788530269.761656:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555828864:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788530269.761699:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788530269.761771:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555828864:12345-0@lo:41:osp-pre-0-1.0 Request processed in 117us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530269.761778:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788530269.761931:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555828864:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788530270.272794:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788530270.272816:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555828992:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788530270.272895:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530270.272974:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555828992 00000100:00100000:3.0:1788530270.272983:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555828992 00000100:00100000:3.0:1788530270.273058:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788530270.273070:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555828992:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788530270.273085:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1788530270.273101:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788530270.273175:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555828992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530270.273182:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788530270.273235:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788530270.273244:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555829248:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788530270.273270:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530270.273299:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555829376:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788530270.273299:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788530270.273306:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f05f46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555829120:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788530270.273321:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788530270.273347:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f3d2a3b80 x1875409555828992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530286 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530270.273349:0:9912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555829248 00000100:00100000:3.0:1788530270.273352:0:9912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555829248 00000100:00100000:2.0:1788530270.273367:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555828992:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788530270.273373:0:9912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555829376 00000100:00100000:3.0:1788530270.273376:0:9912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555829376 00000100:00080000:2.0:1788530270.273385:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788530270.273389:0:9912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788530270.273394:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530270.273395:0:9912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555829248:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788530270.273411:0:9912:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788530270.273417:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555829120 00000100:00100000:2.0:1788530270.273420:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555829120 00000100:00100000:3.0:1788530270.273439:0:9912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555829248:12345-0@lo:13:osp-pre-1-1.0 Request processed in 44us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530270.273443:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788530270.273446:0:9912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788530270.273448:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555829376:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788530270.273456:0:9912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00002000:00000024:2.0:1788530270.273457:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788530270.273462:0:9912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555829120:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788530270.273470:0:9912:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788530270.273478:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555829376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 30us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530270.273484:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00080000:2.0:1788530270.273497:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788530270.273504:0:9912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555829120:12345-0@lo:13:osp-pre-0-1.0 Request processed in 43us (109us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530270.273511:0:9912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788530270.273520:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555829376:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1788530270.273533:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f05f46a00 x1875409555829120/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530286 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530270.273545:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f05f46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555829120:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788530270.274420:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555829248:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788530270.276312:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788530270.280057:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875409555829632:0@lo:400:kworker.0 00000100:00100000:2.0:1788530270.280625:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530270.280696:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3648:1875409555829504:0@lo:400:kworker.0 00000100:00100000:2.0:1788530270.280731:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530270.280783:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555829504 00000100:00100000:1.0:1788530270.280792:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555829504 00000100:00100000:3.0:1788530270.280817:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555829632 00000100:00100000:3.0:1788530270.280821:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555829632 00000100:00100000:1.0:1788530270.280851:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 434 00000100:00100000:1.0:1788530270.280860:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f17db3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:3648:x1875409555829504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530270.280933:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f17db3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:3648:x1875409555829504:12345-0@lo:400:kworker.0 Request processed in 74us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530270.280940:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 434 00000100:00100000:3.0:1788530270.280942:0:10719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1788530270.280948:0:10719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875409555829632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530270.280992:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3648:1875409555829504:0@lo:400:kworker.0 00000100:00100000:3.0:1788530270.281311:0:10719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875409555829632:12345-0@lo:400:kworker.0 Request processed in 362us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530270.281319:0:10719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1788530270.282989:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555829760:0@lo:400:kworker.0 00000100:00100000:2.0:1788530270.283085:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530270.283134:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03c51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875409555830272:0@lo:400:kworker.0 00000100:00100000:2.0:1788530270.283172:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530270.283207:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788530270.283212:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875409555829888:0@lo:400:kworker.0 00000100:00100000:2.0:1788530270.283231:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530270.283246:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03c53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875409555830400:0@lo:400:kworker.0 00000100:00100000:2.0:1788530270.283264:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530270.283315:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555829760 00000100:00100000:2.0:1788530270.283324:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555829760 00000100:00100000:2.0:1788530270.283388:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788530270.283399:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555829760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530270.283464:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555829760:12345-0@lo:400:kworker.0 Request processed in 66us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530270.283473:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788530270.283514:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555830272 00000100:00100000:2.0:1788530270.283517:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555830272 00000100:00100000:2.0:1788530270.283594:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555829888 00000100:00100000:2.0:1788530270.283597:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555829888 00000100:00100000:2.0:1788530270.283619:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555830400 00000100:00100000:2.0:1788530270.283622:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555830400 00000100:00100000:2.0:1788530270.283646:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1788530270.283673:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875409555830272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530270.283706:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875409555830272:12345-0@lo:400:kworker.0 Request processed in 34us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530270.283712:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1788530270.283726:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1788530270.283731:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875409555829888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530270.283751:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875409555829888:12345-0@lo:400:kworker.0 Request processed in 21us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530270.283757:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1788530270.283765:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1788530270.283770:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875409555830400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530270.283787:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875409555830400:12345-0@lo:400:kworker.0 Request processed in 18us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530270.283793:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00080000:2.0:1788530270.283817:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788530270.283821:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788530270.283875:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875409555829888:0@lo:400:kworker.0 00000100:00100000:2.0:1788530270.283885:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03c53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875409555830400:0@lo:400:kworker.0 00000100:00100000:2.0:1788530270.283895:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555829760:0@lo:400:kworker.0 00010000:00080000:2.0:1788530270.283908:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e03c51f80 x1875409555830272/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530286 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530270.283919:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03c51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875409555830272:0@lo:400:kworker.0 00000100:00100000:3.0:1788530270.284334:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555830016:0@lo:400:kworker.0 00000100:00100000:3.0:1788530270.284373:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530270.284403:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788530270.284409:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03c53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875409555830144:0@lo:400:kworker.0 00000100:00100000:3.0:1788530270.284427:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530270.284451:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555830144 00000100:00100000:3.0:1788530270.284455:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555830144 00000100:00100000:3.0:1788530270.284502:0:10719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:3.0:1788530270.284509:0:10719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875409555830144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530270.284540:0:10719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875409555830144:12345-0@lo:400:kworker.0 Request processed in 32us (112us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530270.284546:0:10719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00080000:3.0:1788530270.284579:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788530270.284594:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03c53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875409555830144:0@lo:400:kworker.0 00000100:00100000:2.0:1788530270.285245:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555830016 00000100:00100000:2.0:1788530270.285251:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555830016 00000100:00100000:2.0:1788530270.285308:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788530270.285316:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555830016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530270.285363:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555830016:12345-0@lo:400:kworker.0 Request processed in 48us (990us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530270.285369:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788530270.285446:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03c53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875409555830528:0@lo:400:kworker.0 00000100:00100000:3.0:1788530270.285925:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530270.286050:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555830016:0@lo:400:kworker.0 00000100:00100000:2.0:1788530270.286254:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555830528 00000100:00100000:2.0:1788530270.286259:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555830528 00000100:00100000:2.0:1788530270.286360:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1788530270.286369:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f08db6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875409555830528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530270.286410:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f08db6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875409555830528:12345-0@lo:400:kworker.0 Request processed in 43us (929us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530270.286416:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:1.0:1788530270.286497:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875409555829632:0@lo:400:kworker.0 00000100:00080000:3.0:1788530270.288425:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1788530270.288519:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e03c53100 x1875409555830528/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530286 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530270.288537:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03c53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875409555830528:0@lo:400:kworker.0 00010000:00010000:2.0:1788530270.404330:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788530271.214522:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530271.214586:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530271.214628:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530271.214651:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530271.214674:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530271.214701:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531602688 00000100:00100000:1.0:1788530271.214712:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531602688 00000100:00100000:1.0:1788530271.214801:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531602944 00000100:00100000:1.0:1788530271.214805:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531602944 00000100:00100000:1.0:1788530271.214832:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531602816 00000100:00100000:1.0:1788530271.214835:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531602816 00000100:00100000:1.0:1788530271.214850:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531603072 00000100:00100000:1.0:1788530271.214852:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531603072 00000100:00100000:1.0:1788530271.214872:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 330 00000100:00100000:1.0:1788530271.214881:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f05f47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2399:x1875409531602688:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1788530271.214959:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f05f47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2399:x1875409531602688:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 78us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530271.214967:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 330 00000100:00100000:1.0:1788530271.214988:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 331 00000100:00100000:1.0:1788530271.214995:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f05f45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2399:x1875409531602944:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1788530271.215032:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f05f45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2399:x1875409531602944:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 38us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530271.215054:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 331 00000100:00100000:1.0:1788530271.215069:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 332 00000100:00100000:1.0:1788530271.215076:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f05f44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2399:x1875409531602816:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1788530271.215103:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f05f44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2399:x1875409531602816:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 28us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530271.215109:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 332 00000100:00100000:1.0:1788530271.215121:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 333 00000100:00100000:1.0:1788530271.215127:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f05f46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2399:x1875409531603072:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1788530271.215152:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f05f46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2399:x1875409531603072:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 24us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530271.215158:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 333 00000100:00080000:1.0:1788530271.215190:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788530271.215196:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788530271.218209:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531602560 00000100:00100000:1.0:1788530271.218233:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531602560 00000100:00100000:1.0:1788530271.218348:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 435 00000100:00100000:1.0:1788530271.218360:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f396c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f442bcd-b742-4e76-ad7b-709f731358a0+14:2399:x1875409531602560:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1788530271.218463:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f396c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f442bcd-b742-4e76-ad7b-709f731358a0+14:2399:x1875409531602560:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 105us (3834us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530271.218473:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 435 00000100:00100000:3.0:1788530271.298855:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788530271.298879:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f08db4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555830656:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788530271.298949:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530271.302358:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555830656 00000100:00100000:2.0:1788530271.302382:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555830656 00000100:00100000:2.0:1788530271.303041:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788530271.303054:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f08db4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555830656:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788530271.303098:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446453248 avail 1300213760 00000100:00100000:2.0:1788530271.304288:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f08db4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555830656:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1229us (5331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530271.304302:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788530271.305766:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f08db4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555830656:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788530271.425376:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788530271.630584:0:14075:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 09:57:49 (1788530269) 00010000:00010000:0.0:1788530272.449033:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530273.472908:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788530274.079433:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530274.080079:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531603200 00000100:00100000:1.0:1788530274.080096:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531603200 00000100:00100000:1.0:1788530274.080429:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 40 00000100:00100000:1.0:1788530274.080441:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f08db5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:11087:x1875409531603200:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788530274.080481:0:10720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530274.080510:0:10720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166800/0xb28d70e125750862 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550848 expref: -99 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788530274.081070:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788530274.083679:0:10720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e125750869 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530274.083846:0:10720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e125750869 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530274.083864:0:10720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e125750869 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788530274.083936:0:10720:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788530274.083943:0:10720:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788530274.084010:0:10720:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e125750869 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530274.084917:0:10720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166800/0xb28d70e125750862 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550848 expref: 7 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530274.084951:0:10720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e125750869 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550848 expref: 6 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530274.084962:0:10720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a9f32abdb00) 00010000:00010000:0.0:1788530274.084965:0:10720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788530274.084968:0:10720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d100c00, rc 0) 00000100:00100000:0.0:1788530274.085503:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f08db5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:11087:x1875409531603200:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 5062us (6080us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530274.085513:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 40 00000100:00100000:0.0:1788530274.102365:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530274.102487:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531603328 00000100:00100000:1.0:1788530274.102502:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531603328 00000100:00100000:1.0:1788530274.102645:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 41 00000100:00100000:1.0:1788530274.102657:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:11088:x1875409531603328:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788530274.102695:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530274.102723:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166000/0xb28d70e125750870 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a55084f expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530274.102796:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167800/0xb28d70e125750877 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530274.102812:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167800/0xb28d70e125750877 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530274.102826:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167800/0xb28d70e125750877 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530274.102843:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166800/0xb28d70e12575087e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530274.102851:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166800/0xb28d70e12575087e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530274.102857:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166800/0xb28d70e12575087e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530274.102958:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167e00/0xb28d70e125750885 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530274.102966:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167e00/0xb28d70e125750885 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530274.102973:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167e00/0xb28d70e125750885 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788530274.103033:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788530274.103037:0:6524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788530274.103405:0:6524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167e00/0xb28d70e125750885 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530274.103420:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167800/0xb28d70e125750877 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530274.103429:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167800/0xb28d70e125750877 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530274.103436:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167800/0xb28d70e125750877 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530274.103444:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f42167800 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:1.0:1788530274.103449:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167800/0xb28d70e125750877 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530274.103456:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167800/0xb28d70e125750877 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530274.103470:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a9f32abdb00) 00010000:00010000:1.0:1788530274.103481:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788530274.103489:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167800/0xb28d70e125750877 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530274.103496:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167800/0xb28d70e125750877 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530274.103514:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166800/0xb28d70e12575087e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530274.103520:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166800/0xb28d70e12575087e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530274.103525:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166800/0xb28d70e12575087e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530274.103530:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f42166800 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:1.0:1788530274.103532:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166800/0xb28d70e12575087e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530274.103538:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166800/0xb28d70e12575087e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530274.103545:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9a9f32abdf00) 00010000:00010000:1.0:1788530274.103547:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788530274.103550:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166800/0xb28d70e12575087e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530274.103556:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166800/0xb28d70e12575087e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530274.103647:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166000/0xb28d70e125750870 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a55084f expref: 8 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530274.104334:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167e00/0xb28d70e125750885 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a55084f expref: 7 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530274.104353:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a9f32abd000) 00010000:00010000:1.0:1788530274.104358:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788530274.104365:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f42167e00, rc 0) 00000100:00100000:1.0:1788530274.104512:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+7:11088:x1875409531603328:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 1852us (2166us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530274.104529:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 41 00000100:00100000:1.0:1788530274.113872:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530274.114345:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531603456 00000100:00100000:3.0:1788530274.114354:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531603456 00000100:00100000:3.0:1788530274.114421:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 7 00000100:00100000:3.0:1788530274.114432:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f05f44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+7:11088:x1875409531603456:12345-192.168.202.41@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1788530274.114527:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f05f44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+7:11088:x1875409531603456:12345-192.168.202.41@tcp:900:lhsmtool_posix.0 Request processed in 97us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530274.114534:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 7 00000100:00100000:3.0:1788530274.127420:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530274.127820:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531603712 00000100:00100000:2.0:1788530274.127832:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531603712 00000100:00100000:2.0:1788530274.127933:0:10719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 42 00000100:00100000:2.0:1788530274.127944:0:10719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f08db7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+7:11088:x1875409531603712:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788530274.127965:0:10719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530274.128013:0:10719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20dc00/0xb28d70e12575088c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550856 expref: -99 pid: 10719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530274.128086:0:10719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e125750893 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530274.128102:0:10719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e125750893 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530274.128114:0:10719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e125750893 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530274.128169:0:10719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d600/0xb28d70e12575089a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530274.128176:0:10719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d600/0xb28d70e12575089a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530274.128184:0:10719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d600/0xb28d70e12575089a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530274.128470:0:10719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c400/0xb28d70e1257508a1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530274.128479:0:10719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c400/0xb28d70e1257508a1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530274.128485:0:10719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c400/0xb28d70e1257508a1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788530274.128495:0:10719:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1788530274.128632:0:10719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e125750893 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530274.128650:0:10719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e125750893 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530274.128657:0:10719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e125750893 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530274.128662:0:10719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d20c000 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:2.0:1788530274.128667:0:10719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e125750893 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530274.128674:0:10719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e125750893 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530274.128685:0:10719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a9f32abd000) 00010000:00010000:2.0:1788530274.128688:0:10719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788530274.128693:0:10719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e125750893 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530274.128699:0:10719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e125750893 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530274.128711:0:10719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d600/0xb28d70e12575089a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530274.128717:0:10719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d600/0xb28d70e12575089a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530274.128722:0:10719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d600/0xb28d70e12575089a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530274.128728:0:10719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d20d600 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:2.0:1788530274.128738:0:10719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d600/0xb28d70e12575089a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530274.128744:0:10719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d600/0xb28d70e12575089a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530274.128752:0:10719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9a9f2b992f00) 00010000:00010000:2.0:1788530274.128755:0:10719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788530274.128758:0:10719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d600/0xb28d70e12575089a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530274.128764:0:10719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d600/0xb28d70e12575089a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530274.129428:0:10719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20dc00/0xb28d70e12575088c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550856 expref: 10 pid: 10719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530274.129444:0:10719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c400/0xb28d70e1257508a1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550856 expref: 9 pid: 10719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530274.129452:0:10719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a9f2b992000) 00010000:00010000:2.0:1788530274.129454:0:10719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788530274.129457:0:10719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d20c400, rc 0) 00000100:00100000:2.0:1788530274.129536:0:10719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f08db7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+9:11088:x1875409531603712:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 1594us (2128us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1788530274.129544:0:10719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 42 00000100:00100000:0.0:1788530274.136725:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530274.136875:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531603840 00000100:00100000:2.0:1788530274.136896:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531603840 00000100:00100000:2.0:1788530274.136981:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 43 00000100:00100000:2.0:1788530274.137001:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+9:11088:x1875409531603840:12345-192.168.202.41@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788530274.137128:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+9:11088:x1875409531603840:12345-192.168.202.41@tcp:59:lhsmtool_posix.0 Request processed in 138us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530274.137137:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 43 00000100:00100000:1.0:1788530274.146166:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530274.146407:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531603968 00000100:00100000:3.0:1788530274.146419:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531603968 00000100:00100000:3.0:1788530274.146518:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 44 00000100:00100000:3.0:1788530274.146529:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f05f44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:11088:x1875409531603968:12345-192.168.202.41@tcp:59:lhsmtool_posix.0 00000004:00080000:0.0:1788530274.148393:0:6524:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 1773us 00000100:00080000:1.0:1788530274.148724:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788530274.183176:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f05f44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:11088:x1875409531603968:12345-192.168.202.41@tcp:59:lhsmtool_posix.0 Request processed in 36637us (37008us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530274.183191:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 44 00000040:00080000:2.0:1788530274.370717:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1788530274.438120:0:13816:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788530274.499588:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788530274.885730:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03c52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555830784:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788530274.885804:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530274.885889:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555830784 00000100:00100000:0.0:1788530274.885896:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555830784 00000100:00100000:0.0:1788530274.885963:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788530274.885974:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555830784:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788530274.886052:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788530274.886103:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555830784:12345-0@lo:41:osp-pre-0-1.0 Request processed in 131us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530274.886111:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788530274.886176:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03c52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555830784:0@lo:41:osp-pre-0-1.0 00000040:00080000:2.0:1788530275.393396:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788530275.393487:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555830912:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788530275.393611:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530275.393683:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555830912 00000100:00100000:2.0:1788530275.393691:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555830912 00000100:00100000:2.0:1788530275.393746:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788530275.393756:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555830912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788530275.393788:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788530275.393833:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555830912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530275.393840:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00080000:2.0:1788530275.393860:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788530275.393893:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e037e7100 x1875409555830912/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530291 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530275.393909:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555830912:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788530275.394159:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f08db4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555831040:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788530275.394240:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530275.394276:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555831040 00000100:00100000:3.0:1788530275.394281:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555831040 00000100:00100000:3.0:1788530275.394311:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788530275.394319:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f08db4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555831040:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788530275.394338:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788530275.394385:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f08db4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555831040:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530275.394393:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788530275.394423:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f08db4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555831040:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788530275.394555:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788530275.394596:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555831168:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788530275.394623:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530275.394646:0:9912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555831168 00000100:00100000:2.0:1788530275.394650:0:9912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555831168 00000100:00100000:2.0:1788530275.394684:0:9912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788530275.394690:0:9912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555831168:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788530275.394701:0:9912:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788530275.394731:0:9912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555831168:12345-0@lo:13:osp-pre-0-1.0 Request processed in 41us (108us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530275.394736:0:9912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00080000:2.0:1788530275.394751:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788530275.394754:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788530275.394770:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e037e7100 x1875409555831168/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530291 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530275.394784:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555831168:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788530275.397826:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788530275.397850:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f05f47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555831296:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788530275.397933:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530275.398319:0:9912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555831296 00000100:00100000:1.0:1788530275.398327:0:9912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555831296 00000100:00100000:1.0:1788530275.398432:0:9912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788530275.398446:0:9912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f08db4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555831296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788530275.398478:0:9912:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788530275.398536:0:9912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f08db4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555831296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530275.398546:0:9912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00080000:3.0:1788530275.398698:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788530275.398740:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f05f47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555831296:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788530275.410994:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875409555831808:0@lo:400:kworker.0 00000100:00100000:2.0:1788530275.411094:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530275.411154:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875409555832320:0@lo:400:kworker.0 00000100:00100000:2.0:1788530275.411176:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530275.411218:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788530275.411234:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3649:1875409555831424:0@lo:400:kworker.0 00000100:00100000:2.0:1788530275.411269:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530275.411288:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555831936:0@lo:400:kworker.0 00000100:00100000:2.0:1788530275.411314:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530275.411353:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875409555832448:0@lo:400:kworker.0 00000100:00100000:3.0:1788530275.411639:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555831680:0@lo:400:kworker.0 00000100:00100000:3.0:1788530275.411672:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530275.411691:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875409555832192:0@lo:400:kworker.0 00000100:00100000:3.0:1788530275.411713:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530275.411732:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788530275.411738:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875409555831552:0@lo:400:kworker.0 00000100:00100000:3.0:1788530275.411760:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530275.411778:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875409555832064:0@lo:400:kworker.0 00000100:00100000:3.0:1788530275.411798:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530275.411829:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555831936 00000100:00100000:3.0:1788530275.411864:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555831936 00000100:00100000:2.0:1788530275.412489:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530275.412531:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555831808 00000100:00100000:2.0:1788530275.412535:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555831808 00000100:00100000:2.0:1788530275.412597:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555832320 00000100:00100000:2.0:1788530275.412601:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555832320 00000100:00100000:2.0:1788530275.412635:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555832192 00000100:00100000:2.0:1788530275.412639:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555832192 00000100:00100000:2.0:1788530275.412652:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555831552 00000100:00100000:2.0:1788530275.412655:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555831552 00000100:00100000:2.0:1788530275.412665:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555832064 00000100:00100000:2.0:1788530275.412670:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555832064 00000100:00100000:2.0:1788530275.412696:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555832448 00000100:00100000:2.0:1788530275.412702:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555832448 00000100:00100000:2.0:1788530275.412737:0:10719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1788530275.412749:0:10719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0263ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875409555831808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530275.412805:0:10719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0263ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875409555831808:12345-0@lo:400:kworker.0 Request processed in 58us (1711us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530275.412812:0:10719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1788530275.412832:0:10719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:2.0:1788530275.412838:0:10719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0263df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875409555832320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530275.412875:0:10719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0263df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875409555832320:12345-0@lo:400:kworker.0 Request processed in 35us (1695us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530275.412885:0:10719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:2.0:1788530275.412905:0:10719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:3.0:1788530275.413580:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555831680 00000100:00100000:3.0:1788530275.413586:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555831680 00000100:00100000:3.0:1788530275.413611:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788530275.413620:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0263d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555831936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530275.413670:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0263d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555831936:12345-0@lo:400:kworker.0 Request processed in 51us (2354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530275.413677:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788530275.413698:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788530275.413704:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3735c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555831680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530275.413737:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3735c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555831680:12345-0@lo:400:kworker.0 Request processed in 33us (2064us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530275.413743:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788530275.413763:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:3.0:1788530275.413770:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3735c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875409555831552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530275.413799:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3735c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875409555831552:12345-0@lo:400:kworker.0 Request processed in 31us (2039us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530275.413805:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:3.0:1788530275.413819:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:3.0:1788530275.413825:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3735d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875409555832064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530275.413872:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3735d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875409555832064:12345-0@lo:400:kworker.0 Request processed in 46us (2072us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530275.413881:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:3.0:1788530275.413902:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:3.0:1788530275.413912:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03691500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875409555832448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530275.414592:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03691500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875409555832448:12345-0@lo:400:kworker.0 Request processed in 683us (2103us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530275.414607:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:3.0:1788530275.414668:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875409555831552:0@lo:400:kworker.0 00000100:00100000:3.0:1788530275.414681:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875409555832064:0@lo:400:kworker.0 00000100:00100000:3.0:1788530275.414691:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555831680:0@lo:400:kworker.0 00000100:00080000:3.0:1788530275.414728:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788530275.414733:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788530275.414907:0:10719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3735f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875409555832192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530275.415211:0:10719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3735f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875409555832192:12345-0@lo:400:kworker.0 Request processed in 2293us (3491us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530275.415230:0:10719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1788530275.415285:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555831424 00000100:00100000:2.0:1788530275.415299:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555831424 00010000:00080000:3.0:1788530275.415602:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f328e6300 x1875409555832192/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530291 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530275.415616:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875409555832192:0@lo:400:kworker.0 00000100:00100000:2.0:1788530275.416161:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 436 00000100:00100000:2.0:1788530275.416171:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f396c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:3649:x1875409555831424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530275.416214:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f396c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:3649:x1875409555831424:12345-0@lo:400:kworker.0 Request processed in 47us (4945us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530275.416227:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 436 00000100:00100000:3.0:1788530275.417526:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3649:1875409555831424:0@lo:400:kworker.0 00000100:00100000:3.0:1788530275.417545:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555831936:0@lo:400:kworker.0 00010000:00080000:3.0:1788530275.417584:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f328e7b80 x1875409555832448/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530291 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530275.417596:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875409555832448:0@lo:400:kworker.0 00000100:00100000:3.0:1788530275.417610:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875409555831808:0@lo:400:kworker.0 00000100:00100000:3.0:1788530275.417620:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875409555832320:0@lo:400:kworker.0 00000040:00080000:2.0:1788530275.460112:0:13816:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788530275.536710:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788530276.330255:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530276.330306:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530276.330341:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530276.330376:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530276.330384:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531604224 00000100:00100000:0.0:1788530276.330394:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531604224 00000100:00100000:3.0:1788530276.330396:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530276.330431:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531604480 00000100:00100000:3.0:1788530276.330435:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531604480 00000100:00100000:0.0:1788530276.330467:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531604352 00000100:00100000:0.0:1788530276.330470:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531604352 00000100:00100000:3.0:1788530276.330475:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531604608 00000100:00100000:3.0:1788530276.330477:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531604608 00000100:00100000:0.0:1788530276.330491:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 340 00000100:00100000:0.0:1788530276.330508:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3735dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+9:2400:x1875409531604224:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1788530276.330606:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3735dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+9:2400:x1875409531604224:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 101us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530276.340619:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 341 00000100:00100000:3.0:1788530276.340671:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531604096 00000100:00100000:3.0:1788530276.340681:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531604096 00000100:00100000:3.0:1788530276.342471:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 437 00000100:00100000:3.0:1788530276.342509:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f396c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f442bcd-b742-4e76-ad7b-709f731358a0+14:2400:x1875409531604096:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1788530276.342674:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f396c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f442bcd-b742-4e76-ad7b-709f731358a0+14:2400:x1875409531604096:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 185us (12331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530276.342682:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 437 00000100:00100000:3.0:1788530276.343620:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 342 00000100:00100000:3.0:1788530276.343634:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f328e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2400:x1875409531604352:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1788530276.344200:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 340 00000100:00100000:0.0:1788530276.344231:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 343 00000100:00100000:0.0:1788530276.344243:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f328e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2400:x1875409531604608:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1788530276.344308:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f328e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2400:x1875409531604608:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 69us (13910us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530276.344315:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 343 00000100:00100000:3.0:1788530276.345211:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f328e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2400:x1875409531604352:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 1577us (14829us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530276.345227:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 342 00000100:00080000:3.0:1788530276.345275:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788530276.345282:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788530276.345303:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2400:x1875409531604480:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1788530276.345339:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2400:x1875409531604480:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 4706us (15033us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530276.345346:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 341 00000100:00100000:3.0:1788530276.422900:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788530276.422922:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555832576:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788530276.423013:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530276.423105:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555832576 00000100:00100000:3.0:1788530276.423117:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555832576 00000100:00100000:3.0:1788530276.423174:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788530276.423183:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f328e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555832576:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788530276.423220:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446453248 avail 1300213760 00000100:00100000:3.0:1788530276.423285:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f328e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555832576:12345-0@lo:41:osp-pre-1-0.0 Request processed in 102us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530276.423293:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788530276.423344:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555832576:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788530276.547900:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788530277.327314:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530277.327769:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531604736 00000100:00100000:3.0:1788530277.327781:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531604736 00000100:00100000:3.0:1788530277.327859:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 45 00000100:00100000:3.0:1788530277.327873:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f05f47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+9:11131:x1875409531604736:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:3.0:1788530277.327894:0:10720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788530277.327928:0:10720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e1257508af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a55085d expref: -99 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530277.328017:0:10720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e1257508b6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530277.328044:0:10720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e1257508b6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530277.328061:0:10720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e1257508b6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530277.328077:0:10720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030400/0xb28d70e1257508bd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530277.328095:0:10720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030400/0xb28d70e1257508bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530277.328102:0:10720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030400/0xb28d70e1257508bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530277.328150:0:10720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e1257508b6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530277.328157:0:10720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e1257508b6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530277.328163:0:10720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e1257508b6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530277.328171:0:10720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f00031e00 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:3.0:1788530277.328176:0:10720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e1257508b6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530277.328185:0:10720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e1257508b6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530277.328198:0:10720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a9f32abdb00) 00010000:00010000:3.0:1788530277.328201:0:10720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788530277.328207:0:10720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e1257508b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530277.328213:0:10720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e1257508b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530277.328226:0:10720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030400/0xb28d70e1257508bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530277.328238:0:10720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030400/0xb28d70e1257508bd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530277.328244:0:10720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030400/0xb28d70e1257508bd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530277.328248:0:10720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f00030400 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:3.0:1788530277.328251:0:10720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030400/0xb28d70e1257508bd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530277.328257:0:10720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030400/0xb28d70e1257508bd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530277.328265:0:10720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9a9f092c5e00) 00010000:00010000:3.0:1788530277.328268:0:10720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788530277.328271:0:10720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030400/0xb28d70e1257508bd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530277.328277:0:10720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030400/0xb28d70e1257508bd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530277.328312:0:10720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e1257508af lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a55085d expref: 10 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530277.328323:0:10720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a9f32abdb00) 00010000:00010000:3.0:1788530277.328325:0:10720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788530277.328328:0:10720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e1257508af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a55085d expref: 10 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530277.328348:0:10720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f00031800, rc 0) 00000100:00100000:3.0:1788530277.328426:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f05f47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+9:11131:x1875409531604736:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 552us (1122us total) trans 0 rc 301/301 00000100:00100000:3.0:1788530277.328441:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 45 00000100:00100000:3.0:1788530277.344686:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530277.344813:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531604992 00000100:00100000:0.0:1788530277.344822:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531604992 00000100:00100000:0.0:1788530277.344894:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 46 00000100:00100000:0.0:1788530277.344905:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f328e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+9:11131:x1875409531604992:12345-192.168.202.41@tcp:36:lfs.0 00010000:00010000:0.0:1788530277.344972:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788530277.344997:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e125750869 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550848 expref: 9 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530277.345014:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a9f32abdb00) 00010000:00010000:0.0:1788530277.345025:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788530277.345103:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101400/0xb28d70e1257508c4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530277.345116:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101400/0xb28d70e1257508c4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530277.345126:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101400/0xb28d70e1257508c4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530277.345138:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100800/0xb28d70e1257508cb lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530277.345144:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100800/0xb28d70e1257508cb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530277.345151:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100800/0xb28d70e1257508cb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530277.345705:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101600/0xb28d70e1257508d2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530277.345716:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101600/0xb28d70e1257508d2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530277.345724:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101600/0xb28d70e1257508d2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788530277.345740:0:6524:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001766d097 reply state 00000000838108fd transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101600/0xb28d70e1257508d2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530277.345749:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101600/0xb28d70e1257508d2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530277.345755:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a9e0241d100) 00010000:00010000:0.0:1788530277.345764:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788530277.345767:0:6524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788530277.345772:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1788530277.345780:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101400/0xb28d70e1257508c4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530277.345786:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101400/0xb28d70e1257508c4 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530277.345795:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101400/0xb28d70e1257508c4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530277.345802:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d101400 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:0.0:1788530277.345808:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101400/0xb28d70e1257508c4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530277.345817:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101400/0xb28d70e1257508c4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530277.345830:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a9e0241dc00) 00010000:00010000:0.0:1788530277.345833:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788530277.345838:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101400/0xb28d70e1257508c4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530277.345845:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101400/0xb28d70e1257508c4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788530277.345865:0:6524:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001766d097 reply state 00000000838108fd transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100800/0xb28d70e1257508cb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530277.345877:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100800/0xb28d70e1257508cb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530277.345901:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9a9e0241df00) 00010000:00010000:0.0:1788530277.345904:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788530277.345907:0:6524:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1788530277.346041:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f328e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+10:11131:x1875409531604992:12345-192.168.202.41@tcp:36:lfs.0 Request processed in 1133us (1359us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1788530277.346051:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 46 00000100:00100000:2.0:1788530277.536785:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530277.537635:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531605120 00000100:00100000:1.0:1788530277.537652:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531605120 00000100:00100000:1.0:1788530277.537765:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 47 00000100:00100000:1.0:1788530277.537779:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03690000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+10:11139:x1875409531605120:12345-192.168.202.41@tcp:101:lctl.0 00010000:00010000:1.0:1788530277.537831:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530277.537863:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166000/0xb28d70e1257508d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550864 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530277.537948:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166800/0xb28d70e1257508e0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530277.537975:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166800/0xb28d70e1257508e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530277.537987:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166800/0xb28d70e1257508e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788530277.538039:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788530277.538043:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788530277.538084:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166800/0xb28d70e1257508e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530277.538113:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166000/0xb28d70e1257508d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550864 expref: 12 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530277.538136:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166800/0xb28d70e1257508e0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550864 expref: 11 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530277.538144:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a9f32abdf00) 00010000:00010000:1.0:1788530277.538147:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788530277.538152:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f42166800, rc 0) 00000100:00100000:1.0:1788530277.538244:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03690000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+11:11139:x1875409531605120:12345-192.168.202.41@tcp:101:lctl.0 Request processed in 468us (1470us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530277.538252:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 47 00010000:00010000:2.0:1788530277.569072:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788530277.631210:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530277.631351:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531605248 00000100:00100000:3.0:1788530277.631363:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531605248 00000100:00100000:3.0:1788530277.631444:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 48 00000100:00100000:3.0:1788530277.631455:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+11:11145:x1875409531605248:12345-192.168.202.41@tcp:101:bash.0 00010000:00010000:3.0:1788530277.631475:0:10720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788530277.631496:0:10720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e1257508e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a55086b expref: -99 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530277.631600:0:10720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030400/0xb28d70e1257508ee lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530277.631614:0:10720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030400/0xb28d70e1257508ee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530277.631625:0:10720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030400/0xb28d70e1257508ee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530277.631635:0:10720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e1257508f5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530277.631642:0:10720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e1257508f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530277.631675:0:10720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e1257508f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530277.631758:0:10720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030e00/0xb28d70e1257508fc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530277.631765:0:10720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030e00/0xb28d70e1257508fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530277.631771:0:10720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030e00/0xb28d70e1257508fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788530277.631805:0:10720:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1788530277.631809:0:10720:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788530277.631844:0:10720:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030e00/0xb28d70e1257508fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530277.631855:0:10720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030400/0xb28d70e1257508ee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530277.631861:0:10720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030400/0xb28d70e1257508ee lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530277.631868:0:10720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030400/0xb28d70e1257508ee lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530277.631875:0:10720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f00030400 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:3.0:1788530277.631879:0:10720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030400/0xb28d70e1257508ee lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530277.631887:0:10720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030400/0xb28d70e1257508ee lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530277.631907:0:10720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a9f32abdf00) 00010000:00010000:3.0:1788530277.631909:0:10720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788530277.631914:0:10720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030400/0xb28d70e1257508ee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530277.631921:0:10720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030400/0xb28d70e1257508ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530277.631935:0:10720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e1257508f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530277.631941:0:10720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e1257508f5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530277.631946:0:10720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e1257508f5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530277.631951:0:10720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f00031e00 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:3.0:1788530277.631963:0:10720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e1257508f5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530277.631970:0:10720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e1257508f5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530277.631978:0:10720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9a9e0241df00) 00010000:00010000:3.0:1788530277.631980:0:10720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788530277.631984:0:10720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e1257508f5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530277.631989:0:10720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e1257508f5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530277.632027:0:10720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e1257508e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a55086b expref: 13 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530277.632040:0:10720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030e00/0xb28d70e1257508fc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a55086b expref: 12 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530277.632047:0:10720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a9e0241d100) 00010000:00010000:3.0:1788530277.632049:0:10720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788530277.632052:0:10720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f00030e00, rc 0) 00000100:00100000:3.0:1788530277.632118:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+12:11145:x1875409531605248:12345-192.168.202.41@tcp:101:bash.0 Request processed in 665us (919us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530277.632125:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 48 00000100:00100000:2.0:1788530277.636899:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530277.637000:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531605504 00000100:00100000:0.0:1788530277.637010:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531605504 00000100:00100000:0.0:1788530277.637079:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 49 00000100:00100000:0.0:1788530277.637091:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03693b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+12:11145:x1875409531605504:12345-192.168.202.41@tcp:101:bash.0 00010000:00010000:0.0:1788530277.637114:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530277.637138:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e125750903 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550872 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530277.637277:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e12575090a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530277.637296:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e12575090a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530277.637308:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e12575090a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530277.637356:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100600/0xb28d70e125750911 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530277.637365:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100600/0xb28d70e125750911 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530277.637395:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100600/0xb28d70e125750911 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788530277.637820:0:6524:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:0.0:1788530277.637967:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101a00/0xb28d70e125750918 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530277.637977:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101a00/0xb28d70e125750918 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530277.637984:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101a00/0xb28d70e125750918 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530277.638014:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e12575090a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530277.638022:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e12575090a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530277.638028:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e12575090a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530277.638034:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d101800 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:0.0:1788530277.638038:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e12575090a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530277.638045:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e12575090a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530277.638057:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a9e0241d100) 00010000:00010000:0.0:1788530277.638060:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788530277.638072:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e12575090a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530277.638079:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e12575090a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788530277.638095:0:6524:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000021102e22 reply state 000000001c6060b6 transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100600/0xb28d70e125750911 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530277.638108:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100600/0xb28d70e125750911 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530277.638114:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9a9e0241dc00) 00010000:00010000:0.0:1788530277.638116:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788530277.638119:0:6524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788530277.638153:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e125750903 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550872 expref: 15 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530277.638170:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101a00/0xb28d70e125750918 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550872 expref: 14 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530277.638177:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a9e0241da00) 00010000:00010000:0.0:1788530277.638180:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788530277.638182:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d101a00, rc 0) 00000100:00100000:0.0:1788530277.638268:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03693b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+15:11145:x1875409531605504:12345-192.168.202.41@tcp:101:bash.0 Request processed in 1179us (1379us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1788530277.638276:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 49 00000100:00100000:2.0:1788530277.643068:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530277.643167:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531605632 00000100:00100000:1.0:1788530277.643179:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531605632 00000100:00100000:1.0:1788530277.643237:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 28 00000100:00100000:1.0:1788530277.643247:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03692a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2398:x1875409531605632:12345-192.168.202.41@tcp:8:bash.0 00010000:00080000:1.0:1788530277.643287:0:8752:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-OST0000: connection from aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41@192.168.202.41@tcp t0 exp 0000000000000000 cur 485 last 0 00000020:00000080:1.0:1788530277.643326:0:8752:0:(genops.c:1385:class_connect()) connect: client aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41, cookie 0xb28d70e125750926 00002000:00100000:1.0:1788530277.643340:0:8752:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41/ffff9a9e03dee800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a05 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788530277.643362:0:8752:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788530277.643455:0:8752:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788530277.643488:0:8752:0:(import.c:65:import_set_state_nolock()) ffff9a9e03de8000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788530277.643602:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03692a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:2398:x1875409531605632:12345-192.168.202.41@tcp:8:bash.0 Request processed in 355us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530277.643610:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 28 00000100:00100000:1.0:1788530277.648205:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530277.648377:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531605760 00000100:00100000:2.0:1788530277.648390:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531605760 00000100:00100000:2.0:1788530277.648475:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 29 00000100:00100000:2.0:1788530277.648487:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f05f45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:2399:x1875409531605760:12345-192.168.202.41@tcp:101:bash.0 00010000:00010000:2.0:1788530277.648509:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530277.648537:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000025afb78f/0xb28d70e12575092d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550879 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788530277.648818:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:2.0:1788530277.649331:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788530277.649360:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=485s v=(0 0) 00010000:00010000:2.0:1788530277.649366:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788530277.649378:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025afb78f/0xb28d70e12575092d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550879 expref: 7 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530277.649401:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000025afb78f/0xb28d70e12575092d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550879 expref: 7 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530277.649416:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d20cc00, rc 0) 00000100:00100000:2.0:1788530277.649476:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f05f45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+7:2399:x1875409531605760:12345-192.168.202.41@tcp:101:bash.0 Request processed in 992us (1282us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530277.649496:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 29 00000100:00100000:2.0:1788530277.659628:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530277.659862:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531605888 00000100:00100000:1.0:1788530277.659873:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531605888 00000100:00100000:1.0:1788530277.659935:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 30 00000100:00100000:1.0:1788530277.659946:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03766300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+7:11145:x1875409531605888:12345-192.168.202.41@tcp:101:bash.0 00010000:00010000:1.0:1788530277.659974:0:8752:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530277.659995:0:8752:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067543d74/0xb28d70e125750934 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550880 expref: -99 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530277.660028:0:8752:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000025afb78f/0xb28d70e12575092d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550879 expref: 8 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530277.660038:0:8752:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788530277.660059:0:8752:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788530277.660065:0:8752:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067543d74/0xb28d70e125750934 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550880 expref: 8 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530277.660103:0:8752:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000025afb78f/0xb28d70e12575092d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550879 expref: 8 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530277.660118:0:8752:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000025afb78f/0xb28d70e12575092d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550879 expref: 8 pid: 8436 timeout: 585 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530277.660133:0:8752:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f05f46680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8752:1875409555832704:192.168.202.41@tcp:104: 00000100:00100000:1.0:1788530277.662993:0:8752:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f3740c300 going to sleep for 11 seconds 00000100:00100000:0.0:1788530277.671615:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530277.672793:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531606016 00000100:00100000:2.0:1788530277.672804:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531606016 00010000:00010000:2.0:1788530277.672851:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000025afb78f/0xb28d70e12575092d lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550879 expref: 9 pid: 8436 timeout: 585 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530277.673313:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 61 00000100:00100000:2.0:1788530277.673325:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+9:2400:x1875409531606016:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788530277.673340:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788530277.673362:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000025afb78f/0xb28d70e12575092d lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550879 expref: 9 pid: 8436 timeout: 585 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530277.673379:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000025afb78f/0xb28d70e12575092d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550879 expref: 9 pid: 8436 timeout: 585 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530277.673405:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788530277.673410:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788530277.673418:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000067543d74/0xb28d70e125750934 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550880 expref: 9 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530277.673428:0:6508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067543d74/0xb28d70e125750934 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550880 expref: 9 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530277.673465:0:6508:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000067543d74/0xb28d70e125750934 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550880 expref: 9 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530277.673494:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03765180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6508:1875409555832832:192.168.202.41@tcp:105: 00000100:00100000:2.0:1788530277.673815:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f04d98300 going to sleep for 11 seconds 00010000:00010000:1.0:1788530277.673971:0:8752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000025afb78f/0xb28d70e12575092d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550879 expref: 9 pid: 8436 timeout: 585 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530277.673986:0:8752:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f05f46680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8752:1875409555832704:192.168.202.41@tcp:104: 00010000:00010000:1.0:1788530277.674012:0:8752:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000067543d74/0xb28d70e125750934 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550880 expref: 8 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530277.674023:0:8752:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f42167800, rc 0) 00000100:00100000:1.0:1788530277.674052:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03766300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+8:11145:x1875409531605888:12345-192.168.202.41@tcp:101:bash.0 Request processed in 14108us (14436us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530277.674060:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 30 00000100:00100000:1.0:1788530277.678892:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530277.680984:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531606272 00000100:00100000:3.0:1788530277.681000:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531606272 00000100:00100000:3.0:1788530277.681066:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 6 00000100:00100000:3.0:1788530277.681077:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f05f46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+15:11145:x1875409531606272:12345-192.168.202.41@tcp:35:bash.0 00000100:00100000:2.0:1788530277.681673:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03765180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6508:1875409555832832:192.168.202.41@tcp:105: 00010000:00010000:2.0:1788530277.681812:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788530277.681876:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+7:2400:x1875409531606016:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 8553us (10319us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530277.681886:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 61 00000100:00100000:2.0:1788530277.686342:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f05f46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+16:11145:x1875409531606272:12345-192.168.202.41@tcp:35:bash.0 Request processed in 5257us (7451us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1788530277.686356:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 6 00000100:00100000:1.0:1788530277.804763:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530277.805183:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531606528 00000100:00100000:3.0:1788530277.805194:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531606528 00000100:00100000:3.0:1788530277.805282:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 50 00000100:00100000:3.0:1788530277.805293:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f05f46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+16:11155:x1875409531606528:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:3.0:1788530277.805329:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788530277.805357:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e12575093b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550887 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788530277.805476:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1788530277.805662:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e12575093b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550887 expref: 18 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530277.805689:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a9f32abdf00) 00010000:00010000:3.0:1788530277.805693:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788530277.805700:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e12575093b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550887 expref: 18 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530277.805716:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f00031800, rc 0) 00000100:00100000:2.0:1788530277.805869:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f05f46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+17:11155:x1875409531606528:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 576us (1118us total) trans 4294967315 rc 301/301 00000100:00100000:2.0:1788530277.805878:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 50 00000100:00100000:0.0:1788530277.828085:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530277.829962:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531606784 00000100:00100000:1.0:1788530277.830002:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531606784 00000100:00100000:1.0:1788530277.830083:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 7 00000100:00100000:1.0:1788530277.830095:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+17:11155:x1875409531606784:12345-192.168.202.41@tcp:35:lfs.0 00000100:00100000:1.0:1788530277.830474:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+18:11155:x1875409531606784:12345-192.168.202.41@tcp:35:lfs.0 Request processed in 381us (2404us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1788530277.830483:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 7 00000100:00100000:0.0:1788530277.987877:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530277.987961:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531606912 00000100:00100000:3.0:1788530277.987974:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531606912 00000100:00100000:3.0:1788530277.988062:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 51 00000100:00100000:3.0:1788530277.988074:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+18:11161:x1875409531606912:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:3.0:1788530277.988105:0:10720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788530277.988127:0:10720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e125750949 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a55088e expref: -99 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530277.988200:0:10720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e125750950 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530277.988225:0:10720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e125750950 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530277.988252:0:10720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e125750950 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788530277.988324:0:10720:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1788530277.988329:0:10720:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788530277.988701:0:10720:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e125750950 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530277.988819:0:10720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e125750949 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a55088e expref: 20 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530277.988841:0:10720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e125750950 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a55088e expref: 19 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530277.988919:0:10720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a9e0241d100) 00010000:00010000:3.0:1788530277.988923:0:10720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788530277.988928:0:10720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f00031e00, rc 0) 00000100:00100000:3.0:1788530277.989018:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+19:11161:x1875409531606912:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 945us (1150us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530277.989025:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 51 00000100:00100000:2.0:1788530277.994289:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530277.994553:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531607168 00000100:00100000:3.0:1788530277.994588:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531607168 00000100:00100000:3.0:1788530277.994675:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 52 00000100:00100000:3.0:1788530277.994687:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03765180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+19:11161:x1875409531607168:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:3.0:1788530277.994721:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788530277.994760:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030400/0xb28d70e125750957 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550895 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530277.995040:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031400/0xb28d70e12575095e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530277.995057:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031400/0xb28d70e12575095e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530277.995070:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031400/0xb28d70e12575095e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788530277.995100:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788530277.995243:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030400/0xb28d70e125750957 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550895 expref: 22 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530277.995268:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031400/0xb28d70e12575095e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550895 expref: 21 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530277.995278:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a9e0241da00) 00010000:00010000:3.0:1788530277.995281:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788530277.995286:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f00031400, rc 0) 00000100:00100000:3.0:1788530277.996135:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03765180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+21:11161:x1875409531607168:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 1446us (1856us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1788530277.996144:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 52 00000100:00100000:2.0:1788530278.006760:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530278.006807:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530278.007051:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531607424 00000100:00100000:0.0:1788530278.007061:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531607424 00000100:00080000:1.0:1788530278.007137:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788530278.007174:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 53 00000100:00100000:0.0:1788530278.007190:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03764000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+21:11161:x1875409531607424:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:0.0:1788530278.007225:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530278.007251:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e12575096c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a55089c expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530278.007451:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e125750973 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530278.007469:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e125750973 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530278.007481:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e125750973 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788530278.007495:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788530278.007630:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e12575096c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a55089c expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530278.007651:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e125750973 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a55089c expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530278.007660:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a9e0241da00) 00010000:00010000:0.0:1788530278.007663:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788530278.007667:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d101800, rc 0) 00000100:00100000:3.0:1788530278.008006:0:10347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531607552 00000100:00100000:3.0:1788530278.008012:0:10347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531607552 00000100:00100000:3.0:1788530278.008058:0:10347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 0 00000100:00100000:3.0:1788530278.008067:0:10347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f396c1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+24:2400:x1875409531607552:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788530278.008079:0:10347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788530278.008093:0:10347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031400/0xb28d70e12575095e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550895 expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530278.008106:0:10347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a9e0241da00) 00010000:00010000:3.0:1788530278.008110:0:10347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788530278.009110:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03764000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+23:11161:x1875409531607424:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 1921us (2355us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1788530278.009139:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 53 00000100:00100000:3.0:1788530278.010200:0:10347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f396c1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+22:2400:x1875409531607552:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 2128us (3385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530278.010211:0:10347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 0 00000100:00100000:1.0:1788530278.030163:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530278.030608:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531607680 00000100:00100000:2.0:1788530278.030619:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531607680 00000100:00100000:1.0:1788530278.030890:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 31 00000100:00100000:1.0:1788530278.030905:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f05f45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+7:2400:x1875409531607680:12345-192.168.202.41@tcp:1:lfs.0 00010000:00010000:1.0:1788530278.030975:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b471637/0xb28d70e125750981 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530278.031002:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000067543d74/0xb28d70e125750934 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550880 expref: 7 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530278.031012:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788530278.031017:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788530278.031022:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b471637/0xb28d70e125750981 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530278.031065:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000067543d74/0xb28d70e125750934 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550880 expref: 7 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530278.031080:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000067543d74/0xb28d70e125750934 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550880 expref: 7 pid: 8752 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530278.031117:0:8436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f05f44700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1875409555832960:192.168.202.41@tcp:104: 00000100:00100000:1.0:1788530278.031257:0:8436:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f3740c540 going to sleep for 11 seconds 00000100:00100000:2.0:1788530278.036336:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530278.036449:0:8436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f05f44700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1875409555832960:192.168.202.41@tcp:104: 00010000:00010000:1.0:1788530278.036479:0:8436:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004b471637/0xb28d70e125750981 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530278.037110:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531607808 00000100:00100000:3.0:1788530278.037118:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531607808 00002000:00100000:3.0:1788530278.037163:0:8442:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff9a9e03764a80 x1875409531607808/t0(0) o4->aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41@192.168.202.41@tcp:219/0 lens 504/0 e 0 to 0 dl 1788530289 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788530278.037172:0:8442:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a9e03764a80 with x1875409531607808 ext(0->12) 00010000:00010000:3.0:1788530278.037178:0:8442:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000067543d74/0xb28d70e125750934 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550880 expref: 8 pid: 8752 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530278.037192:0:8442:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000067543d74/0xb28d70e125750934 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550880 expref: 8 pid: 8752 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788530278.037199:0:8442:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9a9e03764a80 00000100:00100000:3.0:1788530278.037235:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 0 00000100:00100000:3.0:1788530278.037406:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03764a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+8:2399:x1875409531607808:12345-192.168.202.41@tcp:4:lfs.0 00000001:00100000:1.0:1788530278.049821:0:8431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41 00000100:00100000:1.0:1788530278.056986:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03764a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+9:2399:x1875409531607808:12345-192.168.202.41@tcp:4:lfs.0 Request processed in 19635us (20646us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788530278.057006:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 0 00002000:00100000:1.0:1788530278.057018:0:8442:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff9a9e03764a80 x1875409531607808/t4294967300(0) o4->aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41@192.168.202.41@tcp:219/0 lens 504/448 e 0 to 0 dl 1788530289 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788530278.057028:0:8442:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a9e03764a80 with x1875409531607808 ext(0->12) 00010000:00010000:1.0:1788530278.057039:0:8442:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000067543d74/0xb28d70e125750934 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550880 expref: 9 pid: 8752 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530278.057060:0:8442:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000067543d74/0xb28d70e125750934 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550880 expref: 9 pid: 8752 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788530278.057069:0:8442:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9a9e03764a80 00000100:00100000:0.0:1788530278.067993:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530278.068136:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531607936 00000100:00100000:3.0:1788530278.068149:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531607936 00010000:00010000:3.0:1788530278.068199:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000067543d74/0xb28d70e125750934 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550880 expref: 9 pid: 8752 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530278.068256:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 62 00000100:00100000:3.0:1788530278.068268:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c50e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+9:2402:x1875409531607936:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788530278.068291:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788530278.068311:0:6510:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788530278.068314:0:6510:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1788530277 00002000:00010000:3.0:1788530278.068317:0:6510:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb atime from disk: 0 -> 1788530277 00002000:00010000:3.0:1788530278.068319:0:6510:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1788530277 00002000:00010000:3.0:1788530278.068338:0:6510:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1788530278.068515:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000067543d74/0xb28d70e125750934 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550880 expref: 9 pid: 8752 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530278.068531:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000067543d74/0xb28d70e125750934 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550880 expref: 9 pid: 8752 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530278.068594:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067543d74/0xb28d70e125750934 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550880 expref: 9 pid: 8752 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530278.068614:0:6510:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788530278.068619:0:6510:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788530278.068625:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004b471637/0xb28d70e125750981 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530278.068635:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b471637/0xb28d70e125750981 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530278.068672:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788530278.068924:0:8436:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004b471637/0xb28d70e125750981 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530278.068946:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004b471637/0xb28d70e125750981 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530278.068979:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b471637/0xb28d70e125750981 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530278.068987:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004b471637/0xb28d70e125750981 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530278.068996:0:8436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004b471637/0xb28d70e125750981 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530278.069003:0:8436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f42166000 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:1.0:1788530278.069007:0:8436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004b471637/0xb28d70e125750981 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530278.069015:0:8436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004b471637/0xb28d70e125750981 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530278.069029:0:8436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004b471637/0xb28d70e125750981 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530278.069037:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004b471637/0xb28d70e125750981 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530278.069125:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c50e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+8:2402:x1875409531607936:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 857us (1177us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530278.069135:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 62 00000100:00100000:1.0:1788530278.070364:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f05f45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+7:2400:x1875409531607680:12345-192.168.202.41@tcp:1:lfs.0 Request processed in 39455us (40209us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530278.070378:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 31 00000100:00100000:2.0:1788530278.086652:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530278.086848:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531608192 00000100:00100000:1.0:1788530278.086867:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531608192 00000100:00100000:1.0:1788530278.086929:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 8 00000100:00100000:1.0:1788530278.086940:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03767b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+22:11161:x1875409531608192:12345-192.168.202.41@tcp:35:lfs.0 00000004:00010000:1.0:1788530278.087016:0:6526:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e125750973 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a55089c expref: 22 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788530278.087261:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:1.0:1788530278.087316:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:1.0:1788530278.087655:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:1.0:1788530278.087694:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166000/0xb28d70e125750988 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530278.087708:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101a00/0xb28d70e125750918 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550872 expref: 26 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530278.087716:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166000/0xb28d70e125750988 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530278.087764:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101a00/0xb28d70e125750918 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550872 expref: 26 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530278.087779:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101a00/0xb28d70e125750918 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550872 expref: 26 pid: 6524 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530278.087805:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f05f44700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6526:1875409555833088:192.168.202.41@tcp:104: 00000100:00100000:1.0:1788530278.087901:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f3740c540 going to sleep for 11 seconds 00000100:00100000:1.0:1788530278.096807:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f05f44700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6526:1875409555833088:192.168.202.41@tcp:104: 00010000:00010000:1.0:1788530278.096839:0:6526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166000/0xb28d70e125750988 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530278.100579:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530278.101026:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531608320 00000100:00100000:1.0:1788530278.101038:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531608320 00010000:00010000:1.0:1788530278.101093:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101a00/0xb28d70e125750918 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550872 expref: 27 pid: 6524 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530278.101146:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 63 00000100:00100000:1.0:1788530278.101157:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03766a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+27:2399:x1875409531608320:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788530278.101179:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788530278.101187:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101a00/0xb28d70e125750918 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550872 expref: 27 pid: 6524 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530278.101203:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101a00/0xb28d70e125750918 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550872 expref: 27 pid: 6524 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530278.101234:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101a00/0xb28d70e125750918 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550872 expref: 27 pid: 6524 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530278.101501:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a9e0241da00) 00010000:00010000:1.0:1788530278.101507:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166000/0xb28d70e125750988 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530278.101534:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166000/0xb28d70e125750988 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530278.101542:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166000/0xb28d70e125750988 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530278.102197:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788530278.102288:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03766a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+26:2399:x1875409531608320:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 1129us (1949us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530278.102298:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 63 00010000:00010000:0.0:1788530278.114997:0:6526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166000/0xb28d70e125750988 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530278.115014:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166000/0xb28d70e125750988 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788530278.115137:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:0.0:1788530278.115274:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:0.0:1788530278.115390:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03c50000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6526:1875409555833216:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788530278.115456:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530278.116639:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e02768780 going to sleep for 11 seconds 00000100:00100000:3.0:1788530278.119116:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555833216 00000100:00100000:3.0:1788530278.119141:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555833216 00000100:00080000:1.0:1788530278.119492:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788530278.119710:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788530278.119734:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6526:x1875409555833216:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788530278.119907:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6526:x1875409555833216:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 186us (4450us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530278.120440:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03c50000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6526:1875409555833216:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788530278.120661:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:3.0:1788530278.120772:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03691180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6526:1875409555833344:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788530278.120827:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530278.120870:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e03639780 going to sleep for 11 seconds 00000100:00100000:1.0:1788530278.124111:0:6529:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:1.0:1788530278.124132:0:6529:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:0.0:1788530278.124627:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555833344 00000100:00100000:0.0:1788530278.124640:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555833344 00000100:00100000:3.0:1788530278.125644:0:14186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788530278.125659:0:14186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03692680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6526:x1875409555833344:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788530278.125959:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1788530278.126703:0:14186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03692680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6526:x1875409555833344:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 1039us (5867us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788530278.126712:0:14186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788530278.127641:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03691180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6526:1875409555833344:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788530278.128028:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:0.0:1788530278.128110:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166000/0xb28d70e125750988 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530278.128125:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166000/0xb28d70e125750988 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530278.128134:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166000/0xb28d70e125750988 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530278.128141:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f42166000 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:0.0:1788530278.128146:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166000/0xb28d70e125750988 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530278.128176:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166000/0xb28d70e125750988 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530278.128192:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a9e0241da00) 00010000:00010000:0.0:1788530278.128196:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788530278.128201:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166000/0xb28d70e125750988 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530278.128209:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166000/0xb28d70e125750988 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788530278.129721:0:6526:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788530278.129812:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1788530278.129826:0:6526:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 486032264111ns, next at 487032261466ns, rc = 0 00000001:00080000:0.0:1788530278.129836:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:0.0:1788530278.129899:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a9e0241da00) 00010000:00010000:0.0:1788530278.129904:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788530278.129920:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e125750973 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a55089c expref: 30 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530278.130100:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03767b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+29:11161:x1875409531608192:12345-192.168.202.41@tcp:35:lfs.0 Request processed in 43159us (43455us total) trans 4294967327 rc 0/0 00000100:00100000:0.0:1788530278.130112:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 8 00000020:00080000:0.0:1788530278.130120:0:6526:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788530278.139237:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530278.139514:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531608448 00000100:00100000:3.0:1788530278.139525:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531608448 00000100:00100000:3.0:1788530278.139634:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 54 00000100:00100000:3.0:1788530278.139647:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03765500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+29:11161:x1875409531608448:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:3.0:1788530278.139678:0:10720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788530278.139716:0:10720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031400/0xb28d70e12575098f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a5508a3 expref: -99 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530278.139972:0:10720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031400/0xb28d70e12575098f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5508a3 expref: 30 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530278.139988:0:10720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031400/0xb28d70e12575098f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5508a3 expref: 30 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530278.140008:0:10720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a9f092c5e00) 00010000:00010000:3.0:1788530278.140010:0:10720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788530278.140014:0:10720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f00031400, rc 0) 00000100:00100000:3.0:1788530278.140073:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03765500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+30:11161:x1875409531608448:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 429us (844us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530278.140081:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 54 00000100:00100000:2.0:1788530278.151937:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530278.152752:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531608704 00000100:00100000:0.0:1788530278.152763:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531608704 00000100:00100000:0.0:1788530278.152823:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 9 00000100:00100000:0.0:1788530278.152834:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3959f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+30:11161:x1875409531608704:12345-192.168.202.41@tcp:35:lfs.0 00000100:00100000:0.0:1788530278.153103:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3959f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+31:11161:x1875409531608704:12345-192.168.202.41@tcp:35:lfs.0 Request processed in 269us (1174us total) trans 4294967328 rc 0/0 00000100:00100000:0.0:1788530278.153112:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 9 00000100:00100000:0.0:1788530278.378916:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530278.379118:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531608960 00000100:00100000:3.0:1788530278.379132:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531608960 00000100:00100000:3.0:1788530278.379233:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 55 00000100:00100000:3.0:1788530278.379247:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+31:11171:x1875409531608960:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:3.0:1788530278.379280:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788530278.379308:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030400/0xb28d70e125750996 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a5508aa expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788530278.379448:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1788530278.379858:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030400/0xb28d70e125750996 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5508aa expref: 33 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530278.379874:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a9f32abdf00) 00010000:00010000:3.0:1788530278.379877:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788530278.379882:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030400/0xb28d70e125750996 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5508aa expref: 33 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530278.379900:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f00030400, rc 0) 00000100:00100000:0.0:1788530278.385968:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+32:11171:x1875409531608960:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 6697us (7041us total) trans 4294967329 rc 301/301 00000100:00100000:0.0:1788530278.385982:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 55 00000100:00100000:2.0:1788530278.404032:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530278.404154:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531609088 00000100:00100000:1.0:1788530278.404167:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531609088 00000100:00100000:1.0:1788530278.404276:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 56 00000100:00100000:1.0:1788530278.404290:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03765f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+32:11171:x1875409531609088:12345-192.168.202.41@tcp:34:lfs.0 00010000:00010000:1.0:1788530278.404372:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166000/0xb28d70e1257509a4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530278.404393:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166000/0xb28d70e1257509a4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530278.404405:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166000/0xb28d70e1257509a4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530278.404415:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167800/0xb28d70e1257509ab lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530278.404422:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167800/0xb28d70e1257509ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530278.404443:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167800/0xb28d70e1257509ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530278.404545:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea000/0xb28d70e1257509b2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530278.404555:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea000/0xb28d70e1257509b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530278.405093:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea000/0xb28d70e1257509b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788530278.405144:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea000/0xb28d70e1257509b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530278.405158:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166000/0xb28d70e1257509a4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530278.405164:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166000/0xb28d70e1257509a4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530278.405171:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166000/0xb28d70e1257509a4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530278.405178:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f42166000 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:1.0:1788530278.405183:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166000/0xb28d70e1257509a4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530278.405191:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166000/0xb28d70e1257509a4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530278.405203:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a9e0241d100) 00010000:00010000:1.0:1788530278.405532:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788530278.405538:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166000/0xb28d70e1257509a4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530278.405544:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166000/0xb28d70e1257509a4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530278.405959:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167800/0xb28d70e1257509ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530278.405967:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167800/0xb28d70e1257509ab lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530278.405973:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167800/0xb28d70e1257509ab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530278.405979:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f42167800 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:1.0:1788530278.405982:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167800/0xb28d70e1257509ab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530278.405988:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167800/0xb28d70e1257509ab lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530278.405997:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9a9e0241dc00) 00010000:00010000:1.0:1788530278.406000:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788530278.406003:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167800/0xb28d70e1257509ab lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530278.406009:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167800/0xb28d70e1257509ab lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530278.406019:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea000/0xb28d70e1257509b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530278.406032:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea000/0xb28d70e1257509b2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530278.406037:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea000/0xb28d70e1257509b2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530278.406042:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f012ea000 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:1.0:1788530278.406045:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea000/0xb28d70e1257509b2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530278.406051:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea000/0xb28d70e1257509b2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530278.406059:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a9f092c5e00) 00010000:00010000:1.0:1788530278.406062:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788530278.406065:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea000/0xb28d70e1257509b2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530278.406070:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea000/0xb28d70e1257509b2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530278.406180:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03765f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+32:11171:x1875409531609088:12345-192.168.202.41@tcp:34:lfs.0 Request processed in 1890us (2160us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530278.406189:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 56 00000100:00100000:2.0:1788530278.412169:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530278.413624:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531609344 00000100:00100000:3.0:1788530278.413641:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531609344 00000100:00100000:3.0:1788530278.413810:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 10 00000100:00100000:3.0:1788530278.413822:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03764700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+32:11171:x1875409531609344:12345-192.168.202.41@tcp:35:lfs.0 00000100:00100000:3.0:1788530278.414137:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03764700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+33:11171:x1875409531609344:12345-192.168.202.41@tcp:35:lfs.0 Request processed in 317us (1980us total) trans 4294967330 rc 0/0 00000100:00100000:3.0:1788530278.414147:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 10 00000100:00100000:3.0:1788530278.495001:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530278.495406:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531609600 00000100:00100000:0.0:1788530278.495418:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531609600 00000100:00100000:0.0:1788530278.495521:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 57 00000100:00100000:0.0:1788530278.495531:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+33:11174:x1875409531609600:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:0.0:1788530278.495557:0:10720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530278.495626:0:10720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e1257509b9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a5508b1 expref: -99 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530278.495876:0:10720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101400/0xb28d70e1257509c0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530278.495894:0:10720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101400/0xb28d70e1257509c0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530278.495907:0:10720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101400/0xb28d70e1257509c0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530278.495919:0:10720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101000/0xb28d70e1257509c7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530278.495926:0:10720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101000/0xb28d70e1257509c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530278.495957:0:10720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101000/0xb28d70e1257509c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530278.496084:0:10720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e1257509ce lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530278.496093:0:10720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e1257509ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530278.496100:0:10720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e1257509ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788530278.496112:0:10720:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788530278.496221:0:10720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101400/0xb28d70e1257509c0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530278.496230:0:10720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101400/0xb28d70e1257509c0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530278.496238:0:10720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101400/0xb28d70e1257509c0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530278.496244:0:10720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d101400 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:0.0:1788530278.496249:0:10720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101400/0xb28d70e1257509c0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530278.496257:0:10720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101400/0xb28d70e1257509c0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530278.496269:0:10720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a9e0241d100) 00010000:00010000:0.0:1788530278.496272:0:10720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788530278.496283:0:10720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101400/0xb28d70e1257509c0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530278.496291:0:10720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101400/0xb28d70e1257509c0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530278.496307:0:10720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101000/0xb28d70e1257509c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530278.496313:0:10720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101000/0xb28d70e1257509c7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530278.496320:0:10720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101000/0xb28d70e1257509c7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530278.496325:0:10720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d101000 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:0.0:1788530278.496327:0:10720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101000/0xb28d70e1257509c7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530278.496333:0:10720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101000/0xb28d70e1257509c7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530278.496340:0:10720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9a9e0241dc00) 00010000:00010000:0.0:1788530278.496342:0:10720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788530278.496344:0:10720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101000/0xb28d70e1257509c7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530278.496349:0:10720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101000/0xb28d70e1257509c7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530278.496390:0:10720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e1257509b9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5508b1 expref: 36 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530278.496419:0:10720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e1257509ce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5508b1 expref: 35 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530278.496426:0:10720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a9f092c5e00) 00010000:00010000:0.0:1788530278.496429:0:10720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788530278.496432:0:10720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d101c00, rc 0) 00000100:00100000:0.0:1788530278.496513:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+35:11174:x1875409531609600:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 984us (1524us total) trans 4294967331 rc 0/0 00000100:00100000:0.0:1788530278.496520:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 57 00000100:00100000:2.0:1788530278.512763:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530278.513125:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531609728 00000100:00100000:3.0:1788530278.513172:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531609728 00000100:00100000:3.0:1788530278.513283:0:10719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 58 00000100:00100000:3.0:1788530278.513297:0:10719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03767480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+35:11174:x1875409531609728:12345-192.168.202.41@tcp:54:lfs.0 00010000:00010000:3.0:1788530278.513393:0:10719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030400/0xb28d70e1257509dc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530278.513418:0:10719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030400/0xb28d70e1257509dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530278.513434:0:10719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030400/0xb28d70e1257509dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530278.513487:0:10719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030400/0xb28d70e1257509dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530278.513496:0:10719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030400/0xb28d70e1257509dc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530278.513504:0:10719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030400/0xb28d70e1257509dc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530278.513511:0:10719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f00030400 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:3.0:1788530278.513517:0:10719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030400/0xb28d70e1257509dc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530278.513526:0:10719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030400/0xb28d70e1257509dc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530278.513539:0:10719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a9f092c5e00) 00010000:00010000:3.0:1788530278.513542:0:10719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788530278.513547:0:10719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030400/0xb28d70e1257509dc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530278.513627:0:10719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030400/0xb28d70e1257509dc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530278.513720:0:10719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03767480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+35:11174:x1875409531609728:12345-192.168.202.41@tcp:54:lfs.0 Request processed in 425us (966us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530278.513729:0:10719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 58 00000100:00100000:2.0:1788530278.520664:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530278.521551:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531609984 00000100:00100000:1.0:1788530278.521592:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531609984 00000100:00100000:1.0:1788530278.521654:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 11 00000100:00100000:1.0:1788530278.521665:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03767800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+35:11174:x1875409531609984:12345-192.168.202.41@tcp:35:lfs.0 00000100:00100000:1.0:1788530278.521913:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03767800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+36:11174:x1875409531609984:12345-192.168.202.41@tcp:35:lfs.0 Request processed in 249us (1258us total) trans 4294967332 rc 0/0 00000100:00100000:1.0:1788530278.521934:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 11 00010000:00010000:0.0:1788530278.593080:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788530279.005226:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530279.005311:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531610240 00000100:00100000:0.0:1788530279.005322:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531610240 00000100:00100000:0.0:1788530279.005402:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 59 00000100:00100000:0.0:1788530279.005412:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03765c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+36:11205:x1875409531610240:12345-192.168.202.41@tcp:101:cat.0 00010000:00010000:0.0:1788530279.005436:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530279.005455:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e1257509e3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a5508b8 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530279.005623:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101000/0xb28d70e1257509ea lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530279.005640:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101000/0xb28d70e1257509ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530279.005652:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101000/0xb28d70e1257509ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788530279.005693:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788530279.005827:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e1257509e3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5508b8 expref: 39 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530279.005847:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101000/0xb28d70e1257509ea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5508b8 expref: 38 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530279.005856:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a9f092c5e00) 00010000:00010000:0.0:1788530279.005858:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788530279.005862:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d101000, rc 0) 00000100:00100000:0.0:1788530279.005914:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03765c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+38:11205:x1875409531610240:12345-192.168.202.41@tcp:101:cat.0 Request processed in 503us (708us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1788530279.005922:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 59 00000100:00100000:1.0:1788530279.013323:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530279.013543:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531610368 00000100:00100000:2.0:1788530279.013555:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531610368 00000100:00100000:2.0:1788530279.013652:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 1 00000100:00100000:2.0:1788530279.013663:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f05f44700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+38:2400:x1875409531610368:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788530279.013692:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788530279.013718:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101000/0xb28d70e1257509ea lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5508b8 expref: 38 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530279.013737:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a9f092c5e00) 00010000:00010000:2.0:1788530279.013742:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788530279.013804:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f05f44700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+37:2400:x1875409531610368:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 143us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530279.013812:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 1 00000100:00100000:1.0:1788530279.014081:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530279.014232:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531610624 00000100:00100000:2.0:1788530279.014237:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531610624 00000100:00100000:2.0:1788530279.014276:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 12 00000100:00100000:2.0:1788530279.014285:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f05f44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+37:11205:x1875409531610624:12345-192.168.202.41@tcp:35:cat.0 00000100:00100000:2.0:1788530279.014475:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f05f44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+38:11205:x1875409531610624:12345-192.168.202.41@tcp:35:cat.0 Request processed in 191us (393us total) trans 4294967334 rc 0/0 00000100:00100000:2.0:1788530279.014498:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 12 00000100:00100000:3.0:1788530279.145629:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530279.145727:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531610880 00000100:00100000:1.0:1788530279.145737:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531610880 00000100:00100000:1.0:1788530279.145802:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 60 00000100:00100000:1.0:1788530279.145812:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+38:11211:x1875409531610880:12345-192.168.202.41@tcp:101:dd.0 00010000:00010000:1.0:1788530279.145837:0:8678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530279.145840:0:8678:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788530279.145866:0:8678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e125750950 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a55088e expref: 38 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530279.145882:0:8678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a9e0241d100) 00010000:00010000:1.0:1788530279.145885:0:8678:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788530279.145896:0:8678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea800/0xb28d70e1257509f8 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a5508bf expref: -99 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530279.145994:0:8678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb600/0xb28d70e1257509ff lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530279.146004:0:8678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e1257509ce lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5508b1 expref: 38 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530279.146010:0:8678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb600/0xb28d70e1257509ff lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530279.146053:0:8678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e1257509ce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a5508b1 expref: 38 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530279.146084:0:8678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e1257509ce lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a5508b1 expref: 38 pid: 10720 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530279.146098:0:8678:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f05f47480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8678:1875409555833472:192.168.202.41@tcp:104: 00000100:00100000:1.0:1788530279.146197:0:8678:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f3740c300 going to sleep for 11 seconds 00000100:00100000:0.0:1788530279.150055:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530279.150136:0:10347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531611008 00000100:00100000:3.0:1788530279.150145:0:10347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531611008 00010000:00010000:3.0:1788530279.150188:0:10347:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e1257509ce lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a5508b1 expref: 39 pid: 10720 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530279.150223:0:10347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 64 00000100:00100000:3.0:1788530279.150229:0:10347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+39:2400:x1875409531611008:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788530279.150240:0:10347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788530279.150244:0:10347:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e1257509ce lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a5508b1 expref: 39 pid: 10720 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530279.150253:0:10347:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e1257509ce lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a5508b1 expref: 39 pid: 10720 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530279.150270:0:10347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a9f092c5e00) 00010000:00010000:3.0:1788530279.150273:0:10347:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb600/0xb28d70e1257509ff lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530279.150280:0:10347:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb600/0xb28d70e1257509ff lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530279.150299:0:10347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb600/0xb28d70e1257509ff lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530279.150312:0:10347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788530279.150362:0:10347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+39:2400:x1875409531611008:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 132us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530279.150369:0:10347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 64 00010000:00010000:1.0:1788530279.152249:0:8678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e1257509ce lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a5508b1 expref: 38 pid: 10720 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530279.152276:0:8678:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f05f47480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8678:1875409555833472:192.168.202.41@tcp:104: 00010000:00010000:1.0:1788530279.152300:0:8678:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb600/0xb28d70e1257509ff lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530279.152309:0:8678:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb600/0xb28d70e1257509ff lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530279.152315:0:8678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb600/0xb28d70e1257509ff lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788530279.152335:0:8678:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788530279.152514:0:8678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea800/0xb28d70e1257509f8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5508bf expref: 39 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530279.152531:0:8678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb600/0xb28d70e1257509ff lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5508bf expref: 38 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530279.152540:0:8678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a9f092c5e00) 00010000:00010000:1.0:1788530279.152549:0:8678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788530279.152553:0:8678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f012eb600, rc 0) 00000100:00100000:1.0:1788530279.152821:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+38:11211:x1875409531610880:12345-192.168.202.41@tcp:101:dd.0 Request processed in 7008us (7201us total) trans 4294967335 rc 0/0 00000100:00100000:1.0:1788530279.152829:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 60 00000001:00080000:3.0:1788530279.157340:0:6502:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967335 is committed 00000004:00080000:3.0:1788530279.157375:0:6502:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:3.0:1788530279.157400:0:6502:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a9e03639600 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1788530279.157406:0:6502:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a9f2cd1ee00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a9e03639900 00000020:00080000:3.0:1788530279.157410:0:6502:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a9f2cd1e100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a9f0120be00 00000020:00080000:2.0:1788530279.157449:0:6555:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00010000:00010000:1.0:1788530279.157548:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100800/0xb28d70e1257508cb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530279.157582:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100800/0xb28d70e1257508cb lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530279.157591:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100800/0xb28d70e1257508cb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530279.157598:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d100800 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:1.0:1788530279.157602:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100800/0xb28d70e1257508cb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530279.157611:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100800/0xb28d70e1257508cb lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530279.157629:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9a9e0241df00) 00010000:00010000:1.0:1788530279.157633:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788530279.157639:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100800/0xb28d70e1257508cb lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530279.157646:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100800/0xb28d70e1257508cb lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530279.157667:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101600/0xb28d70e1257508d2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530279.157697:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101600/0xb28d70e1257508d2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530279.157703:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101600/0xb28d70e1257508d2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530279.157708:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d101600 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:1.0:1788530279.157711:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101600/0xb28d70e1257508d2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530279.157716:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101600/0xb28d70e1257508d2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788530279.157717:0:6555:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:2.0:1788530279.157926:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788530279.157957:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03c51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555833600:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1788530279.157996:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a9e0241d100) 00010000:00010000:1.0:1788530279.157999:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788530279.158003:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101600/0xb28d70e1257508d2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530279.158009:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101600/0xb28d70e1257508d2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530279.158022:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788530279.158022:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100600/0xb28d70e125750911 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530279.158028:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100600/0xb28d70e125750911 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530279.158033:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100600/0xb28d70e125750911 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530279.158048:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d100600 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:1.0:1788530279.158057:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100600/0xb28d70e125750911 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530279.158063:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100600/0xb28d70e125750911 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530279.158072:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9a9e0241dc00) 00010000:00010000:1.0:1788530279.158075:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788530279.158078:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100600/0xb28d70e125750911 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530279.158084:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100600/0xb28d70e125750911 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530279.158140:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555833600 00000100:00100000:3.0:1788530279.158552:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555833600 00000100:00100000:3.0:1788530279.158705:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788530279.158715:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03767b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1875409555833600:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788530279.158970:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00002000:00080000:3.0:1788530279.159042:0:8438:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00000100:00100000:2.0:1788530279.159074:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531611136 00002000:00010000:3.0:1788530279.159075:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 13, mtime: 0x6a9ace65, atime: 0x6a9ace65, ctime: 0x6a9ace65, blocks: 0x8 00000100:00100000:2.0:1788530279.159079:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531611136 00010000:00010000:3.0:1788530279.159081:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000247abbd4/0xb28d70e125750a0d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530279.159095:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=487s v=(0 0) 00010000:00010000:3.0:1788530279.159099:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788530279.159107:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000247abbd4/0xb28d70e125750a0d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530279.159138:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000247abbd4/0xb28d70e125750a0d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530279.159148:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000247abbd4/0xb28d70e125750a0d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530279.159155:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000247abbd4/0xb28d70e125750a0d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530279.159159:0:10719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 61 00000100:00100000:2.0:1788530279.159166:0:10719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+11:11211:x1875409531611136:12345-192.168.202.41@tcp:101:dd.0 00010000:00010000:2.0:1788530279.159183:0:10719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530279.159199:0:10719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d000/0xb28d70e125750a14 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a5508c6 expref: -99 pid: 10719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530279.159216:0:8438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788530279.159230:0:10719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d800/0xb28d70e125750a1b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530279.159243:0:10719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d800/0xb28d70e125750a1b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530279.159251:0:10719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d800/0xb28d70e125750a1b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530279.159375:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03767b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3647:x1875409555833600:12345-0@lo:6:osp-syn-0-0.0 Request processed in 661us (1352us total) trans 4294967302 rc 0/0 00010000:00010000:2.0:1788530279.159377:0:10719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d000/0xb28d70e125750a14 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5508c6 expref: 13 pid: 10719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530279.159384:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:2.0:1788530279.159394:0:10719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d800/0xb28d70e125750a1b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5508c6 expref: 12 pid: 10719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530279.159414:0:10719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a9f092c5e00) 00010000:00010000:2.0:1788530279.159416:0:10719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788530279.159420:0:10719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d20d800, rc 0) 00000004:00080000:3.0:1788530279.159454:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a9e03c51c00/2, rc 0, transno 4294967302 00000100:00100000:3.0:1788530279.159463:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03c51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555833600:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788530279.159468:0:10719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+12:11211:x1875409531611136:12345-192.168.202.41@tcp:101:dd.0 Request processed in 304us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530279.159474:0:10719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 61 00010000:00010000:1.0:1788530279.160189:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788530279.160198:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000247abbd4/0xb28d70e125750a0d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530279.160266:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f00030400 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:1.0:1788530279.160271:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000247abbd4/0xb28d70e125750a0d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530279.160281:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000247abbd4/0xb28d70e125750a0d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530279.160296:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000247abbd4/0xb28d70e125750a0d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530279.160304:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000247abbd4/0xb28d70e125750a0d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530279.160332:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530279.160335:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530279.160336:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788530279.163235:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530279.164269:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531611392 00000100:00100000:1.0:1788530279.164279:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531611392 00000100:00100000:1.0:1788530279.164345:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 62 00000100:00100000:1.0:1788530279.164352:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+12:11211:x1875409531611392:12345-192.168.202.41@tcp:36:dd.0 00010000:00010000:1.0:1788530279.164548:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb400/0xb28d70e125750a22 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530279.164577:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb400/0xb28d70e125750a22 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530279.164587:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb400/0xb28d70e125750a22 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788530279.164633:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:1.0:1788530279.164650:0:6525:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000006b5aa5d reply state 000000001e7bfa87 transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb400/0xb28d70e125750a22 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530279.164660:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb400/0xb28d70e125750a22 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530279.164673:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a9f092c5e00) 00010000:00010000:1.0:1788530279.164675:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788530279.164678:0:6525:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788530279.164758:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+15:11211:x1875409531611392:12345-192.168.202.41@tcp:36:dd.0 Request processed in 404us (1532us total) trans 4294967337 rc 0/0 00000100:00100000:1.0:1788530279.164765:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 62 00000020:00080000:1.0:1788530279.164783:0:6525:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788530279.625504:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530279.625778:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531611520 00000100:00100000:0.0:1788530279.625789:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531611520 00000100:00100000:0.0:1788530279.625870:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 63 00000100:00100000:0.0:1788530279.625882:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+15:11225:x1875409531611520:12345-192.168.202.41@tcp:101:stat.0 00010000:00010000:0.0:1788530279.625912:0:10720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530279.625934:0:10720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100400/0xb28d70e125750a29 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a5508cd expref: -99 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530279.626017:0:10720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100000/0xb28d70e125750a30 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530279.626045:0:10720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100000/0xb28d70e125750a30 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530279.626057:0:10720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100000/0xb28d70e125750a30 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530279.626074:0:10720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100600/0xb28d70e125750a37 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530279.626081:0:10720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100600/0xb28d70e125750a37 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530279.626088:0:10720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100600/0xb28d70e125750a37 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530279.626451:0:10720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101600/0xb28d70e125750a3e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530279.626463:0:10720:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb600/0xb28d70e1257509ff lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5508bf expref: 16 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530279.626472:0:10720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101600/0xb28d70e125750a3e lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530279.626509:0:10720:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb600/0xb28d70e1257509ff lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a5508bf expref: 16 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530279.626525:0:10720:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb600/0xb28d70e1257509ff lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a5508bf expref: 16 pid: 8678 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530279.626550:0:10720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03c51f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:10720:1875409555833728:192.168.202.41@tcp:104: 00000100:00100000:0.0:1788530279.626695:0:10720:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e02768a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788530279.634072:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530279.635111:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531611776 00000100:00100000:1.0:1788530279.635125:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531611776 00000100:00100000:1.0:1788530279.635212:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 13 00000100:00100000:1.0:1788530279.635224:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+17:6175:x1875409531611776:12345-192.168.202.41@tcp:35:ldlm_bl.0 00010000:00010000:2.0:1788530279.635292:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788530279.635687:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+18:6175:x1875409531611776:12345-192.168.202.41@tcp:35:ldlm_bl.0 Request processed in 463us (1623us total) trans 4294967338 rc 0/0 00000100:00100000:1.0:1788530279.635696:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 13 00000100:00100000:3.0:1788530279.642958:0:10720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03c51f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:10720:1875409555833728:192.168.202.41@tcp:104: 00010000:00010000:3.0:1788530279.642992:0:10720:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101600/0xb28d70e125750a3e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530279.663394:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530279.663922:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531611904 00000100:00100000:2.0:1788530279.663933:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531611904 00010000:00010000:2.0:1788530279.663990:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb600/0xb28d70e1257509ff lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a5508bf expref: 18 pid: 8678 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530279.664050:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 65 00000100:00100000:2.0:1788530279.664062:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c51f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+18:2400:x1875409531611904:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788530279.664077:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788530279.664083:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb600/0xb28d70e1257509ff lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a5508bf expref: 18 pid: 8678 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530279.664096:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb600/0xb28d70e1257509ff lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a5508bf expref: 18 pid: 8678 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530279.664119:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb600/0xb28d70e1257509ff lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a5508bf expref: 18 pid: 8678 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530279.664136:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a9f092c5e00) 00010000:00010000:2.0:1788530279.664142:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101600/0xb28d70e125750a3e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530279.664167:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101600/0xb28d70e125750a3e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530279.664176:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101600/0xb28d70e125750a3e lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530279.664221:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788530279.664283:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c51f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+17:2400:x1875409531611904:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 224us (899us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530279.664291:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 65 00010000:00010000:0.0:1788530279.666873:0:10720:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101600/0xb28d70e125750a3e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530279.666896:0:10720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101600/0xb28d70e125750a3e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788530279.666969:0:10720:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788530279.666974:0:10720:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788530279.667025:0:10720:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101600/0xb28d70e125750a3e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530279.667058:0:10720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101600/0xb28d70e125750a3e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530279.667070:0:10720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100000/0xb28d70e125750a30 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530279.667076:0:10720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100000/0xb28d70e125750a30 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530279.667083:0:10720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100000/0xb28d70e125750a30 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530279.667088:0:10720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d100000 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:0.0:1788530279.667092:0:10720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100000/0xb28d70e125750a30 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530279.667112:0:10720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100000/0xb28d70e125750a30 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530279.667127:0:10720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a9e0241d100) 00010000:00010000:0.0:1788530279.667130:0:10720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788530279.667135:0:10720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100000/0xb28d70e125750a30 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530279.667141:0:10720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100000/0xb28d70e125750a30 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530279.667158:0:10720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100600/0xb28d70e125750a37 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530279.667164:0:10720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100600/0xb28d70e125750a37 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530279.667170:0:10720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100600/0xb28d70e125750a37 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530279.667175:0:10720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d100600 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:0.0:1788530279.667178:0:10720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100600/0xb28d70e125750a37 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530279.667184:0:10720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100600/0xb28d70e125750a37 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530279.667191:0:10720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9a9e0241da00) 00010000:00010000:0.0:1788530279.667194:0:10720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788530279.667196:0:10720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100600/0xb28d70e125750a37 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530279.667223:0:10720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100600/0xb28d70e125750a37 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530279.667271:0:10720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100400/0xb28d70e125750a29 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5508cd expref: 17 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530279.667285:0:10720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101600/0xb28d70e125750a3e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5508cd expref: 16 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530279.667293:0:10720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a9f092c5e00) 00010000:00010000:0.0:1788530279.667295:0:10720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788530279.667297:0:10720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d101600, rc 0) 00000100:00100000:0.0:1788530279.667379:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+16:11225:x1875409531611520:12345-192.168.202.41@tcp:101:stat.0 Request processed in 41499us (41886us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530279.667387:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 63 00000100:00100000:0.0:1788530279.941116:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530279.941225:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531612160 00000100:00100000:2.0:1788530279.941236:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531612160 00000100:00100000:2.0:1788530279.941314:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 64 00000100:00100000:2.0:1788530279.941325:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03735180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+16:11231:x1875409531612160:12345-192.168.202.41@tcp:36:truncate.0 00010000:00010000:2.0:1788530279.941383:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788530279.941410:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101600/0xb28d70e125750a3e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5508cd expref: 16 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530279.941431:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a9f092c5e00) 00010000:00010000:2.0:1788530279.941437:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788530279.941867:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d600/0xb28d70e125750a45 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530279.941883:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d600/0xb28d70e125750a45 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530279.941893:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d600/0xb28d70e125750a45 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788530279.941967:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:2.0:1788530279.941989:0:6524:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e7573073 reply state 00000000af79db3d transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d600/0xb28d70e125750a45 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530279.942003:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d600/0xb28d70e125750a45 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530279.942010:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a9f092c5e00) 00010000:00010000:2.0:1788530279.942013:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788530279.942016:0:6524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788530279.942816:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03735180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+18:11231:x1875409531612160:12345-192.168.202.41@tcp:36:truncate.0 Request processed in 1381us (1598us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1788530279.942827:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 64 00000020:00080000:2.0:1788530279.942833:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788530280.001766:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03734700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555833856:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788530280.001862:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530280.002125:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555833856 00000100:00100000:0.0:1788530280.002135:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555833856 00000100:00100000:0.0:1788530280.002201:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788530280.002212:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555833856:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788530280.002268:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446297600 avail 1300058112 00000100:00100000:0.0:1788530280.004497:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555833856:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2280us (2629us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530280.004511:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788530280.014012:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03734700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555833856:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788530280.189718:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530280.192151:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531612288 00000100:00100000:1.0:1788530280.192169:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531612288 00000100:00080000:3.0:1788530280.192442:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788530280.192489:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 65 00000100:00100000:1.0:1788530280.192502:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37364380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+18:11245:x1875409531612288:12345-192.168.202.41@tcp:101:stat.0 00010000:00010000:1.0:1788530280.192538:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530280.192578:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ebe00/0xb28d70e125750a4c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a5508d4 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530280.192657:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e125750a53 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530280.193259:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e125750a53 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530280.193281:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e125750a53 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530280.193308:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eae00/0xb28d70e125750a5a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530280.193316:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eae00/0xb28d70e125750a5a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530280.193515:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eae00/0xb28d70e125750a5a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530280.193654:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb000/0xb28d70e125750a61 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530280.193665:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb000/0xb28d70e125750a61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530280.193672:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb000/0xb28d70e125750a61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788530280.194169:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:1.0:1788530280.194175:0:6525:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788530280.194216:0:6525:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb000/0xb28d70e125750a61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530280.194229:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb000/0xb28d70e125750a61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530280.194239:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e125750a53 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530280.194245:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e125750a53 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530280.194253:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e125750a53 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530280.194259:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f012eac00 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:1.0:1788530280.194263:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e125750a53 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530280.194279:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e125750a53 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530280.194293:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a9e0241d100) 00010000:00010000:1.0:1788530280.194296:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788530280.194302:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e125750a53 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530280.194307:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e125750a53 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530280.198331:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eae00/0xb28d70e125750a5a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530280.198351:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eae00/0xb28d70e125750a5a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530280.198360:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eae00/0xb28d70e125750a5a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530280.198367:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f012eae00 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:1.0:1788530280.198372:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eae00/0xb28d70e125750a5a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530280.198380:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eae00/0xb28d70e125750a5a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530280.198398:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9a9f32abd900) 00010000:00010000:1.0:1788530280.198401:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788530280.198407:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eae00/0xb28d70e125750a5a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530280.198434:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eae00/0xb28d70e125750a5a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530280.198498:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ebe00/0xb28d70e125750a4c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5508d4 expref: 20 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530280.198512:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb000/0xb28d70e125750a61 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5508d4 expref: 19 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530280.198519:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a9f092c5e00) 00010000:00010000:1.0:1788530280.198522:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788530280.198524:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f012eb000, rc 0) 00000100:00100000:1.0:1788530280.198617:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37364380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+19:11245:x1875409531612288:12345-192.168.202.41@tcp:101:stat.0 Request processed in 6118us (8919us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530280.198627:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 65 00000100:00100000:1.0:1788530280.338212:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530280.338311:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531612544 00000100:00100000:2.0:1788530280.338331:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531612544 00000100:00100000:2.0:1788530280.338407:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 66 00000100:00100000:2.0:1788530280.338416:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f05f47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+19:11255:x1875409531612544:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:2.0:1788530280.338436:0:8678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530280.338455:0:8678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20dc00/0xb28d70e125750a68 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a5508db expref: -99 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788530280.338545:0:8678:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1788530280.338672:0:8678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20dc00/0xb28d70e125750a68 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5508db expref: 21 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530280.338687:0:8678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a9f32abdf00) 00010000:00010000:2.0:1788530280.338690:0:8678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788530280.339903:0:8678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20dc00/0xb28d70e125750a68 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5508db expref: 21 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530280.339922:0:8678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d20dc00, rc 0) 00000100:00100000:2.0:1788530280.340020:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f05f47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+20:11255:x1875409531612544:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 1605us (1818us total) trans 4294967341 rc 301/301 00000100:00100000:2.0:1788530280.340031:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 66 00000100:00100000:3.0:1788530280.347716:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530280.349621:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531612800 00000100:00100000:1.0:1788530280.349637:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531612800 00000100:00100000:1.0:1788530280.349708:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 14 00000100:00100000:1.0:1788530280.349944:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37365180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+20:11255:x1875409531612800:12345-192.168.202.41@tcp:35:lfs.0 00000100:00100000:1.0:1788530280.350291:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37365180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+21:11255:x1875409531612800:12345-192.168.202.41@tcp:35:lfs.0 Request processed in 572us (2643us total) trans 4294967342 rc 0/0 00000100:00100000:1.0:1788530280.350299:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 14 00000100:00100000:3.0:1788530280.449296:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530280.449414:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531613056 00000100:00100000:2.0:1788530280.449425:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531613056 00000100:00100000:2.0:1788530280.449515:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 67 00000100:00100000:2.0:1788530280.449526:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37364a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+21:11261:x1875409531613056:12345-192.168.202.41@tcp:101:bash.0 00010000:00010000:2.0:1788530280.449555:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530280.449629:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20dc00/0xb28d70e125750a76 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a5508e2 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530280.449778:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e125750a7d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530280.449794:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb000/0xb28d70e125750a61 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5508d4 expref: 22 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530280.449805:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e125750a7d lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530280.449842:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb000/0xb28d70e125750a61 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a5508d4 expref: 22 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530280.449857:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb000/0xb28d70e125750a61 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a5508d4 expref: 22 pid: 6525 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530280.449889:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03764380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6524:1875409555833984:192.168.202.41@tcp:104: 00000100:00100000:2.0:1788530280.450019:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f17d3ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1788530280.459376:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530280.459554:0:10347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531613184 00000100:00100000:3.0:1788530280.459606:0:10347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531613184 00010000:00010000:3.0:1788530280.459654:0:10347:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb000/0xb28d70e125750a61 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a5508d4 expref: 23 pid: 6525 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530280.459706:0:10347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 66 00000100:00100000:3.0:1788530280.459728:0:10347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03735f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+23:2400:x1875409531613184:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788530280.459865:0:10347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788530280.459876:0:10347:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb000/0xb28d70e125750a61 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a5508d4 expref: 23 pid: 6525 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530280.459891:0:10347:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb000/0xb28d70e125750a61 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a5508d4 expref: 23 pid: 6525 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530280.459915:0:10347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a9f092c5e00) 00010000:00010000:3.0:1788530280.459920:0:10347:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e125750a7d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530280.459942:0:10347:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e125750a7d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530280.459951:0:10347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e125750a7d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530280.459972:0:10347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788530280.460028:0:10347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03735f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+23:2400:x1875409531613184:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 313us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530280.460051:0:10347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 66 00010000:00010000:2.0:1788530280.461015:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb000/0xb28d70e125750a61 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a5508d4 expref: 22 pid: 6525 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530280.461037:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03764380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6524:1875409555833984:192.168.202.41@tcp:104: 00010000:00010000:2.0:1788530280.461060:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e125750a7d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530280.461068:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e125750a7d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530280.461073:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e125750a7d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788530280.461093:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1788530280.463586:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20dc00/0xb28d70e125750a76 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5508e2 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530280.463622:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e125750a7d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5508e2 expref: 22 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530280.463632:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a9f092c5e00) 00010000:00010000:2.0:1788530280.463635:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788530280.463639:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d20c000, rc 0) 00000100:00100000:2.0:1788530280.463731:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37364a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+22:11261:x1875409531613056:12345-192.168.202.41@tcp:101:bash.0 Request processed in 14205us (14504us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1788530280.467639:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 67 00000100:00100000:0.0:1788530280.475812:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530280.476017:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531613440 00000100:00100000:2.0:1788530280.476029:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531613440 00000100:00100000:2.0:1788530280.476136:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 68 00000100:00100000:2.0:1788530280.476148:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03736d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+22:11261:x1875409531613440:12345-192.168.202.41@tcp:36:bash.0 00010000:00010000:2.0:1788530280.476454:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20dc00/0xb28d70e125750a8b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530280.476483:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20dc00/0xb28d70e125750a8b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530280.476498:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20dc00/0xb28d70e125750a8b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788530280.476557:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:2.0:1788530280.476638:0:6523:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000014dda91e reply state 000000006777d71c transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20dc00/0xb28d70e125750a8b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530280.476653:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20dc00/0xb28d70e125750a8b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530280.476663:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a9f092c5e00) 00010000:00010000:2.0:1788530280.476667:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788530280.476674:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788530280.477173:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03736d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+25:11261:x1875409531613440:12345-192.168.202.41@tcp:36:bash.0 Request processed in 1022us (1371us total) trans 4294967345 rc 0/0 00000100:00100000:2.0:1788530280.477182:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 68 00000020:00080000:2.0:1788530280.477188:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788530280.490700:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530280.490888:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531613568 00000100:00100000:0.0:1788530280.490901:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531613568 00000100:00100000:0.0:1788530280.491018:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 69 00000100:00100000:0.0:1788530280.491030:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37364e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+25:11261:x1875409531613568:12345-192.168.202.41@tcp:101:bash.0 00010000:00010000:0.0:1788530280.491077:0:10720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530280.491108:0:10720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e125750a92 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a5508e9 expref: -99 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530280.491246:0:10720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e125750a99 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530280.491266:0:10720:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e125750a7d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5508e2 expref: 26 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530280.491276:0:10720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e125750a99 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530280.491318:0:10720:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e125750a7d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a5508e2 expref: 26 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530280.491334:0:10720:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e125750a7d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a5508e2 expref: 26 pid: 6524 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530280.491349:0:10720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03734700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:10720:1875409555834112:192.168.202.41@tcp:104: 00000100:00100000:0.0:1788530280.491459:0:10720:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e02768240 going to sleep for 11 seconds 00000100:00100000:0.0:1788530280.496189:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530280.496439:0:10720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03734700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:10720:1875409555834112:192.168.202.41@tcp:104: 00010000:00010000:3.0:1788530280.496471:0:10720:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e125750a99 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530280.496547:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531613696 00000100:00100000:2.0:1788530280.496601:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531613696 00010000:00010000:2.0:1788530280.496637:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e125750a7d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a5508e2 expref: 27 pid: 6524 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530280.496939:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 67 00000100:00100000:2.0:1788530280.496951:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f396c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+27:2399:x1875409531613696:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788530280.496965:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788530280.496971:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e125750a7d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a5508e2 expref: 27 pid: 6524 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530280.496983:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e125750a7d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a5508e2 expref: 27 pid: 6524 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530280.497003:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e125750a7d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a5508e2 expref: 27 pid: 6524 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530280.497017:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a9f092c5e00) 00010000:00010000:2.0:1788530280.497021:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e125750a99 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530280.497029:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e125750a99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530280.497037:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e125750a99 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530280.497072:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788530280.497130:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f396c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+26:2399:x1875409531613696:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 182us (951us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530280.497149:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 67 00010000:00010000:0.0:1788530280.497415:0:10720:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e125750a99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530280.497433:0:10720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e125750a99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788530280.497486:0:10720:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788530280.497491:0:10720:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788530280.497509:0:10720:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e125750a99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530280.497542:0:10720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e125750a92 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5508e9 expref: 26 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530280.497588:0:10720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e125750a99 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5508e9 expref: 25 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530280.497597:0:10720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a9f092c5e00) 00010000:00010000:0.0:1788530280.497600:0:10720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788530280.497602:0:10720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d100c00, rc 0) 00000100:00100000:0.0:1788530280.497629:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37364e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+25:11261:x1875409531613568:12345-192.168.202.41@tcp:101:bash.0 Request processed in 6602us (6944us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530280.497637:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 69 00000100:00100000:1.0:1788530280.502415:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530280.502548:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531613952 00000100:00100000:0.0:1788530280.502558:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531613952 00000100:00100000:0.0:1788530280.502666:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 15 00000100:00100000:0.0:1788530280.502678:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3959f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+25:11261:x1875409531613952:12345-192.168.202.41@tcp:35:bash.0 00000100:00100000:0.0:1788530280.503118:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3959f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+26:11261:x1875409531613952:12345-192.168.202.41@tcp:35:bash.0 Request processed in 440us (711us total) trans 4294967346 rc 0/0 00000100:00100000:0.0:1788530280.503127:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 15 00000100:00100000:3.0:1788530280.513211:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788530280.513237:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37365180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555834240:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788530280.513310:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530280.513356:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555834240 00000100:00100000:3.0:1788530280.513364:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555834240 00000100:00100000:3.0:1788530280.513419:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788530280.513431:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32bd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555834240:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788530280.513461:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788530280.513505:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32bd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555834240:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530280.513512:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00080000:3.0:1788530280.513538:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788530280.513591:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37365180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555834240:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788530280.514177:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788530280.514189:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f05f45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555834368:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788530280.514246:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530280.514278:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555834368 00000100:00100000:1.0:1788530280.514283:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555834368 00000100:00100000:1.0:1788530280.514317:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788530280.514324:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f05f44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555834368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788530280.514336:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788530280.514369:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f05f44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555834368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 46us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530280.514376:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:1.0:1788530280.514396:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788530280.514418:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f05f45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555834368:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788530280.514987:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03734700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875409555834752:0@lo:400:kworker.0 00000100:00100000:0.0:1788530280.515020:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530280.515053:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37375180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875409555835264:0@lo:400:kworker.0 00000100:00100000:0.0:1788530280.515072:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530280.515088:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875409555835776:0@lo:400:kworker.0 00000100:00100000:0.0:1788530280.515103:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530280.515118:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788530280.515122:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03735f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3650:1875409555834624:0@lo:400:kworker.0 00000100:00100000:0.0:1788530280.515144:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530280.515169:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37374a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555835136:0@lo:400:kworker.0 00000100:00100000:0.0:1788530280.515203:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530280.515218:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555835648:0@lo:400:kworker.0 00000100:00100000:0.0:1788530280.515237:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530280.515263:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555835648 00000100:00100000:0.0:1788530280.515267:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555835648 00000100:00100000:0.0:1788530280.515305:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788530280.515314:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0375f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3650:x1875409555835648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530280.515354:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0375f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3650:x1875409555835648:12345-0@lo:400:kworker.0 Request processed in 42us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530280.515361:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788530280.515393:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555835648:0@lo:400:kworker.0 00000100:00100000:0.0:1788530280.515419:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555834752 00000100:00100000:0.0:1788530280.515422:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555834752 00000100:00100000:0.0:1788530280.515459:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555835264 00000100:00100000:0.0:1788530280.515462:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555835264 00000100:00100000:0.0:1788530280.515481:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555835776 00000100:00100000:0.0:1788530280.515494:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555835776 00000100:00100000:0.0:1788530280.515522:0:10719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:0.0:1788530280.515529:0:10719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0375d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875409555834752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530280.515591:0:10719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0375d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875409555834752:12345-0@lo:400:kworker.0 Request processed in 62us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530280.515597:0:10719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:0.0:1788530280.515624:0:10719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:0.0:1788530280.515631:0:10719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0375ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875409555835264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530280.515657:0:10719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0375ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875409555835264:12345-0@lo:400:kworker.0 Request processed in 28us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530280.515663:0:10719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:0.0:1788530280.515673:0:10719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:0.0:1788530280.515678:0:10719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0375ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875409555835776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530280.515700:0:10719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0375ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875409555835776:12345-0@lo:400:kworker.0 Request processed in 23us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530280.515706:0:10719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:2.0:1788530280.516271:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03766a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555834496:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788530280.516315:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530280.516353:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37377480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875409555835008:0@lo:400:kworker.0 00000100:00100000:2.0:1788530280.516376:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530280.516396:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555835520:0@lo:400:kworker.0 00000100:00100000:2.0:1788530280.516416:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530280.516436:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788530280.516442:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37425c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555834880:0@lo:400:kworker.0 00000100:00100000:2.0:1788530280.516466:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530280.516489:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875409555835392:0@lo:400:kworker.0 00000100:00100000:2.0:1788530280.516511:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530280.516520:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0375fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875409555835904:0@lo:400:kworker.0 00000100:00100000:2.0:1788530280.516538:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530280.516583:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555834624 00000100:00100000:2.0:1788530280.516588:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555834624 00000100:00100000:0.0:1788530280.516891:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03734700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875409555834752:0@lo:400:kworker.0 00000100:00100000:0.0:1788530280.516918:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37375180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875409555835264:0@lo:400:kworker.0 00000100:00100000:0.0:1788530280.516942:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875409555835776:0@lo:400:kworker.0 00000100:00100000:0.0:1788530280.516977:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555835008 00000100:00100000:0.0:1788530280.516981:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555835008 00000100:00100000:0.0:1788530280.517027:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555835392 00000100:00100000:0.0:1788530280.517030:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555835392 00000100:00100000:0.0:1788530280.518726:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555835904 00000100:00100000:2.0:1788530280.518957:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 438 00000100:00100000:2.0:1788530280.518971:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f396c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:3650:x1875409555834624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530280.519313:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f396c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:3650:x1875409555834624:12345-0@lo:400:kworker.0 Request processed in 346us (4165us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530280.519321:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 438 00000100:00100000:2.0:1788530280.519384:0:9912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555834496 00000100:00100000:2.0:1788530280.519392:0:9912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555834496 00000100:00100000:2.0:1788530280.519423:0:9912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788530280.519435:0:9912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03764380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1875409555834496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788530280.519481:0:9912:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788530280.519526:0:9912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03764380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1875409555834496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (3211us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530280.519532:0:9912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788530280.519554:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555835136 00000100:00100000:2.0:1788530280.519558:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555835136 00000100:00100000:2.0:1788530280.519618:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555834880 00000100:00100000:2.0:1788530280.519622:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555834880 00000100:00100000:2.0:1788530280.519637:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788530280.519643:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0375f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555835136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530280.519831:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555835520 00000100:00100000:1.0:1788530280.519835:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555835520 00000100:00100000:1.0:1788530280.519871:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788530280.519879:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03767100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555835520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530280.519921:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03767100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555835520:12345-0@lo:400:kworker.0 Request processed in 43us (3503us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530280.519940:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:1.0:1788530280.519966:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788530280.519973:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788530280.519976:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788530280.519994:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1788530280.520003:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03764e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875409555835008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530280.520054:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03764e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875409555835008:12345-0@lo:400:kworker.0 Request processed in 53us (3677us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530280.520062:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1788530280.520082:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1788530280.520100:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03767800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875409555835392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530280.520139:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03767800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875409555835392:12345-0@lo:400:kworker.0 Request processed in 43us (3626us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530280.520145:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1788530280.520234:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03735f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3650:1875409555834624:0@lo:400:kworker.0 00000100:00100000:0.0:1788530280.521504:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555835904 00000100:00100000:2.0:1788530280.522176:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0375f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555835136:12345-0@lo:400:kworker.0 Request processed in 2528us (6977us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530280.522189:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788530280.522326:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788530280.522339:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03764700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555834880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530280.522349:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788530280.522370:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f05f45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555836032:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788530280.522376:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03764700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555834880:12345-0@lo:400:kworker.0 Request processed in 42us (5910us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530280.522381:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1788530280.522420:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530280.522426:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37425c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555834880:0@lo:400:kworker.0 00010000:00080000:2.0:1788530280.522444:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e03d42a00 x1875409555835392/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530296 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530280.522455:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875409555835392:0@lo:400:kworker.0 00000100:00100000:3.0:1788530280.522469:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555836032 00000100:00100000:2.0:1788530280.522471:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37377480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875409555835008:0@lo:400:kworker.0 00000100:00100000:3.0:1788530280.522474:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555836032 00000100:00100000:2.0:1788530280.522482:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555835520:0@lo:400:kworker.0 00000100:00100000:3.0:1788530280.522515:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788530280.522521:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32bd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555836032:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788530280.522525:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03766a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555834496:0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788530280.522541:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788530280.523139:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32bd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555836032:12345-0@lo:13:osp-pre-0-1.0 Request processed in 615us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530280.523157:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788530280.523216:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f05f45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555836032:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788530280.528279:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1788530280.528297:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875409555835904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530280.528414:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875409555835904:12345-0@lo:400:kworker.0 Request processed in 121us (11873us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530280.528422:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00080000:0.0:1788530280.531925:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1788530280.535492:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e0375fb80 x1875409555835904/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530296 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530280.535513:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0375fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875409555835904:0@lo:400:kworker.0 00000100:00100000:1.0:1788530280.538531:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37374a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555835136:0@lo:400:kworker.0 00010000:00010000:0.0:1788530280.649364:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788530280.670872:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530280.670980:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531614208 00000100:00100000:0.0:1788530280.670990:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531614208 00000100:00100000:0.0:1788530280.671070:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 70 00000100:00100000:0.0:1788530280.671081:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f05f44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+26:11271:x1875409531614208:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:0.0:1788530280.671110:0:8678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530280.671133:0:8678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e125750aa0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a5508f0 expref: -99 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788530280.671270:0:8678:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1788530280.671399:0:8678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e125750aa0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5508f0 expref: 28 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530280.671416:0:8678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a9f32abdf00) 00010000:00010000:0.0:1788530280.671419:0:8678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788530280.671426:0:8678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e125750aa0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5508f0 expref: 28 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530280.671444:0:8678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d101c00, rc 0) 00000100:00100000:0.0:1788530280.671530:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f05f44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+27:11271:x1875409531614208:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 450us (668us total) trans 4294967347 rc 301/301 00000100:00100000:0.0:1788530280.671537:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 70 00000100:00100000:1.0:1788530280.680905:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530280.681047:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531614336 00000100:00100000:2.0:1788530280.681064:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531614336 00000100:00100000:3.0:1788530280.681275:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 71 00000100:00100000:3.0:1788530280.681289:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f05f46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+27:11271:x1875409531614336:12345-192.168.202.41@tcp:34:lfs.0 00010000:00010000:3.0:1788530280.681379:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e125750aae lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530280.681398:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e125750aae lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530280.681412:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e125750aae lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530280.681429:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030000/0xb28d70e125750ab5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530280.681436:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030000/0xb28d70e125750ab5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530280.681444:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030000/0xb28d70e125750ab5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530280.681617:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030400/0xb28d70e125750abc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530280.681627:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030400/0xb28d70e125750abc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530280.681634:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030400/0xb28d70e125750abc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788530280.681688:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030400/0xb28d70e125750abc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530280.681711:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e125750aae lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530280.681720:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e125750aae lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530280.681727:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e125750aae lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530280.681734:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f00031800 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:3.0:1788530280.681739:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e125750aae lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530280.681747:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e125750aae lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530280.681759:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a9e0241d100) 00010000:00010000:3.0:1788530280.681762:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788530280.681767:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e125750aae lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530280.681790:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e125750aae lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530280.681807:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030000/0xb28d70e125750ab5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530280.681813:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030000/0xb28d70e125750ab5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530280.681819:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030000/0xb28d70e125750ab5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530280.681825:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f00030000 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:3.0:1788530280.681828:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030000/0xb28d70e125750ab5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530280.681834:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030000/0xb28d70e125750ab5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530280.681842:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9a9f02efad00) 00010000:00010000:3.0:1788530280.681845:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788530280.681847:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030000/0xb28d70e125750ab5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530280.681852:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030000/0xb28d70e125750ab5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530280.681869:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030400/0xb28d70e125750abc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530280.681875:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030400/0xb28d70e125750abc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530280.681887:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030400/0xb28d70e125750abc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530280.681893:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f00030400 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:3.0:1788530280.681895:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030400/0xb28d70e125750abc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530280.681902:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030400/0xb28d70e125750abc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530280.681910:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a9f092c5e00) 00010000:00010000:3.0:1788530280.681913:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788530280.681916:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030400/0xb28d70e125750abc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530280.681922:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030400/0xb28d70e125750abc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530280.682016:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f05f46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+27:11271:x1875409531614336:12345-192.168.202.41@tcp:34:lfs.0 Request processed in 730us (1125us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530280.682024:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 71 00000100:00100000:1.0:1788530280.687353:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530280.689753:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531614592 00000100:00100000:0.0:1788530280.689772:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531614592 00000100:00100000:0.0:1788530280.689848:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 16 00000100:00100000:0.0:1788530280.689859:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f05f47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+27:11271:x1875409531614592:12345-192.168.202.41@tcp:35:lfs.0 00000100:00100000:0.0:1788530280.690113:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f05f47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+28:11271:x1875409531614592:12345-192.168.202.41@tcp:35:lfs.0 Request processed in 255us (2773us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1788530280.690121:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 16 00000100:00100000:1.0:1788530280.777695:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530280.785430:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531614848 00000100:00100000:3.0:1788530280.785450:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531614848 00000100:00100000:3.0:1788530280.785555:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 72 00000100:00100000:3.0:1788530280.785583:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f05f46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+28:11274:x1875409531614848:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:3.0:1788530280.785608:0:10720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788530280.785634:0:10720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030400/0xb28d70e125750ac3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a5508f7 expref: -99 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530280.786289:0:10720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030000/0xb28d70e125750aca lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530280.786307:0:10720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030000/0xb28d70e125750aca lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530280.786390:0:10720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030000/0xb28d70e125750aca lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530280.786407:0:10720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e125750ad1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530280.786416:0:10720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e125750ad1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530280.786422:0:10720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e125750ad1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530280.786548:0:10720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e125750ad8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530280.786558:0:10720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e125750ad8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530280.786594:0:10720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e125750ad8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788530280.786604:0:10720:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788530280.786697:0:10720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030000/0xb28d70e125750aca lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530280.787396:0:10720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030000/0xb28d70e125750aca lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530280.787402:0:10720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030000/0xb28d70e125750aca lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530280.787408:0:10720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f00030000 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:3.0:1788530280.787413:0:10720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030000/0xb28d70e125750aca lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530280.787420:0:10720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030000/0xb28d70e125750aca lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530280.787432:0:10720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a9e0241d100) 00010000:00010000:3.0:1788530280.787435:0:10720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788530280.787440:0:10720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030000/0xb28d70e125750aca lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530280.787445:0:10720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030000/0xb28d70e125750aca lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530280.787459:0:10720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e125750ad1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530280.787464:0:10720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e125750ad1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530280.787469:0:10720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e125750ad1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530280.787473:0:10720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f00031800 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:3.0:1788530280.787480:0:10720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e125750ad1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530280.787486:0:10720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e125750ad1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530280.787492:0:10720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9a9f02efad00) 00010000:00010000:3.0:1788530280.787495:0:10720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788530280.787497:0:10720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e125750ad1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530280.787503:0:10720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e125750ad1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530280.787614:0:10720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030400/0xb28d70e125750ac3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5508f7 expref: 31 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530280.787630:0:10720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e125750ad8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5508f7 expref: 30 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530280.787637:0:10720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a9f092c5e00) 00010000:00010000:3.0:1788530280.787639:0:10720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788530280.787642:0:10720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f00031e00, rc 0) 00000100:00100000:3.0:1788530280.788796:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f05f46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+30:11274:x1875409531614848:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 3210us (11113us total) trans 4294967349 rc 0/0 00000100:00100000:3.0:1788530280.788807:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 72 00000100:00100000:0.0:1788530280.798117:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530280.798201:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531614976 00000100:00100000:2.0:1788530280.798211:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531614976 00000100:00100000:2.0:1788530280.798289:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 73 00000100:00100000:2.0:1788530280.798299:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0375fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+30:11274:x1875409531614976:12345-192.168.202.41@tcp:54:lfs.0 00010000:00010000:2.0:1788530280.798383:0:8678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e125750ae6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530280.798404:0:8678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e125750ae6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530280.798417:0:8678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e125750ae6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530280.798458:0:8678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e125750ae6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530280.798466:0:8678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e125750ae6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530280.798474:0:8678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e125750ae6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530280.798480:0:8678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d20c000 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:2.0:1788530280.798502:0:8678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e125750ae6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530280.798511:0:8678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e125750ae6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530280.798526:0:8678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a9f092c5e00) 00010000:00010000:2.0:1788530280.798529:0:8678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788530280.798534:0:8678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e125750ae6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530280.798542:0:8678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e125750ae6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530280.798660:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0375fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+30:11274:x1875409531614976:12345-192.168.202.41@tcp:54:lfs.0 Request processed in 353us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530280.798675:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 73 00000100:00100000:0.0:1788530280.799145:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530280.799896:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531615104 00000100:00100000:2.0:1788530280.799905:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531615104 00000100:00100000:2.0:1788530280.799976:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 2 00000100:00100000:2.0:1788530280.799987:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37374a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+30:2399:x1875409531615104:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788530280.800007:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788530280.800035:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e125750ad8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5508f7 expref: 30 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530280.800052:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a9f092c5e00) 00010000:00010000:2.0:1788530280.800059:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788530280.800100:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37374a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+29:2399:x1875409531615104:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 115us (955us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530280.800118:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 2 00000100:00100000:0.0:1788530280.804271:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530280.804505:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531615360 00000100:00100000:1.0:1788530280.804517:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531615360 00000100:00100000:1.0:1788530280.804603:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 17 00000100:00100000:1.0:1788530280.804616:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37377480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+29:11274:x1875409531615360:12345-192.168.202.41@tcp:35:lfs.0 00000100:00100000:0.0:1788530280.805506:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37377480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+30:11274:x1875409531615360:12345-192.168.202.41@tcp:35:lfs.0 Request processed in 887us (1248us total) trans 4294967350 rc 0/0 00000100:00100000:0.0:1788530280.805515:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 17 00000100:00100000:0.0:1788530281.128086:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530281.128349:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531615616 00000100:00100000:3.0:1788530281.128360:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531615616 00000100:00100000:3.0:1788530281.128438:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 74 00000100:00100000:3.0:1788530281.128450:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37375180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+30:11292:x1875409531615616:12345-192.168.202.41@tcp:101:cat.0 00010000:00010000:3.0:1788530281.128488:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788530281.128510:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030400/0xb28d70e125750aed lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a5508fe expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530281.128903:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e125750af4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530281.128919:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e125750af4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530281.128944:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e125750af4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788530281.128958:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788530281.129077:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030400/0xb28d70e125750aed lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5508fe expref: 33 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530281.129096:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e125750af4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5508fe expref: 32 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530281.129106:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a9f092c5e00) 00010000:00010000:3.0:1788530281.129109:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788530281.129113:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f00031800, rc 0) 00000100:00100000:3.0:1788530281.129443:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37375180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+32:11292:x1875409531615616:12345-192.168.202.41@tcp:101:cat.0 Request processed in 993us (1368us total) trans 4294967351 rc 0/0 00000100:00100000:3.0:1788530281.129454:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 74 00000100:00100000:0.0:1788530281.180970:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530281.181770:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531615744 00000100:00100000:1.0:1788530281.181785:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531615744 00000100:00100000:1.0:1788530281.181882:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 75 00000100:00100000:1.0:1788530281.181895:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03735f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+32:11293:x1875409531615744:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:1.0:1788530281.181933:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530281.181954:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eba00/0xb28d70e125750b02 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550905 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530281.182023:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb800/0xb28d70e125750b09 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530281.182038:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb800/0xb28d70e125750b09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530281.182064:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb800/0xb28d70e125750b09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788530281.182116:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1788530281.182120:0:6525:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788530281.182140:0:6525:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb800/0xb28d70e125750b09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530281.182168:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eba00/0xb28d70e125750b02 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550905 expref: 34 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530281.182309:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb800/0xb28d70e125750b09 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550905 expref: 33 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530281.182320:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a9e0241d100) 00010000:00010000:1.0:1788530281.182323:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788530281.182327:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f012eb800, rc 0) 00000100:00100000:1.0:1788530281.182416:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03735f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+33:11293:x1875409531615744:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 523us (1459us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530281.182424:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 75 00000100:00100000:1.0:1788530281.195118:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530281.195289:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531616128 00000100:00100000:3.0:1788530281.195304:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531616128 00000100:00100000:3.0:1788530281.195385:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 18 00000100:00100000:3.0:1788530281.195414:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f05f45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+33:11293:x1875409531616128:12345-192.168.202.41@tcp:35:lfs.0 00000100:00100000:3.0:1788530281.195785:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f05f45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+34:11293:x1875409531616128:12345-192.168.202.41@tcp:35:lfs.0 Request processed in 370us (677us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1788530281.195793:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 18 00000100:00100000:0.0:1788530281.200550:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530281.200907:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531616256 00000100:00100000:3.0:1788530281.200917:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531616256 00000100:00100000:3.0:1788530281.200993:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 3 00000100:00100000:3.0:1788530281.201007:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03734700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+34:11293:x1875409531616256:12345-192.168.202.41@tcp:103:lfs.0 00010000:00010000:3.0:1788530281.201029:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788530281.201060:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e125750a99 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5508e9 expref: 34 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530281.201087:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e125750af4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5508fe expref: 33 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530281.201101:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031400/0xb28d70e12575098f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5508a3 expref: 32 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530281.201110:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a9f092c5e00) 00010000:00010000:3.0:1788530281.201115:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788530281.201181:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03734700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+31:11293:x1875409531616256:12345-192.168.202.41@tcp:103:lfs.0 Request processed in 176us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530281.201196:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 3 00000100:00100000:1.0:1788530281.208037:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530281.212707:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531616384 00000100:00100000:2.0:1788530281.212726:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531616384 00000100:00100000:2.0:1788530281.213100:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 76 00000100:00100000:2.0:1788530281.213113:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f05f45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+31:11293:x1875409531616384:12345-192.168.202.41@tcp:58:lfs.0 00010000:00010000:2.0:1788530281.213265:0:8678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e125750b10 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530281.213293:0:8678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e125750b10 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530281.213312:0:8678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e125750b10 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788530281.213698:0:8678:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788530281.214109:0:8678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1788530281.214218:0:8678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1788530281.214354:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f05f45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+31:11293:x1875409531616384:12345-192.168.202.41@tcp:58:lfs.0 Request processed in 1240us (6324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530281.214365:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 76 00000100:00100000:1.0:1788530281.267815:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530281.268825:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531616512 00000100:00100000:2.0:1788530281.268841:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531616512 00000100:00100000:2.0:1788530281.268940:0:10719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 77 00000100:00100000:2.0:1788530281.268952:0:10719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+31:11295:x1875409531616512:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:2.0:1788530281.268974:0:10719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530281.268995:0:10719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d000/0xb28d70e125750b17 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a55090c expref: -99 pid: 10719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530281.269096:0:10719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d400/0xb28d70e125750b1e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530281.269111:0:10719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d400/0xb28d70e125750b1e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530281.269122:0:10719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d400/0xb28d70e125750b1e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530281.269136:0:10719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20da00/0xb28d70e125750b25 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530281.269142:0:10719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20da00/0xb28d70e125750b25 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530281.269149:0:10719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20da00/0xb28d70e125750b25 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530281.269248:0:10719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ca00/0xb28d70e125750b2c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530281.269258:0:10719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ca00/0xb28d70e125750b2c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530281.269264:0:10719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ca00/0xb28d70e125750b2c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788530281.269786:0:10719:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788530281.269792:0:10719:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788530281.269814:0:10719:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ca00/0xb28d70e125750b2c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530281.269839:0:10719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ca00/0xb28d70e125750b2c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530281.269848:0:10719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d400/0xb28d70e125750b1e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530281.269854:0:10719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d400/0xb28d70e125750b1e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530281.269861:0:10719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d400/0xb28d70e125750b1e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530281.269867:0:10719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d20d400 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:2.0:1788530281.269871:0:10719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d400/0xb28d70e125750b1e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530281.269879:0:10719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d400/0xb28d70e125750b1e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530281.269890:0:10719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a9e0241d100) 00010000:00010000:2.0:1788530281.269893:0:10719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788530281.269898:0:10719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d400/0xb28d70e125750b1e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530281.269903:0:10719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d400/0xb28d70e125750b1e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530281.269915:0:10719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20da00/0xb28d70e125750b25 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530281.269930:0:10719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20da00/0xb28d70e125750b25 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530281.269942:0:10719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20da00/0xb28d70e125750b25 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530281.269948:0:10719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d20da00 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:2.0:1788530281.269951:0:10719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20da00/0xb28d70e125750b25 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530281.269957:0:10719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20da00/0xb28d70e125750b25 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530281.269966:0:10719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9a9f2b996400) 00010000:00010000:2.0:1788530281.269968:0:10719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788530281.269971:0:10719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20da00/0xb28d70e125750b25 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530281.269976:0:10719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20da00/0xb28d70e125750b25 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530281.270011:0:10719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d000/0xb28d70e125750b17 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a55090c expref: 33 pid: 10719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530281.270024:0:10719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ca00/0xb28d70e125750b2c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a55090c expref: 32 pid: 10719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530281.270032:0:10719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a9f092c5e00) 00010000:00010000:2.0:1788530281.270034:0:10719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788530281.270037:0:10719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d20ca00, rc 0) 00000100:00100000:2.0:1788530281.271809:0:10719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+32:11295:x1875409531616512:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 2850us (3995us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530281.271836:0:10719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 77 00000100:00100000:1.0:1788530281.453477:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530281.456357:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530281.456396:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530281.456437:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531617152 00000100:00100000:1.0:1788530281.456447:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531617152 00000100:00100000:1.0:1788530281.456533:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 350 00000100:00100000:1.0:1788530281.456546:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2400:x1875409531617152:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1788530281.456671:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2400:x1875409531617152:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 127us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530281.456680:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 350 00000100:00080000:1.0:1788530281.456709:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788530281.456743:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530281.456765:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531616768 00000100:00100000:1.0:1788530281.456769:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531616768 00000100:00100000:1.0:1788530281.456810:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 351 00000100:00100000:1.0:1788530281.456817:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2400:x1875409531616768:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1788530281.456846:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2400:x1875409531616768:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 29us (103us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530281.456853:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 351 00000100:00080000:1.0:1788530281.456866:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788530281.456942:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530281.459108:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531616896 00000100:00100000:3.0:1788530281.459122:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531616896 00000100:00100000:3.0:1788530281.459196:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 99 00000100:00100000:3.0:1788530281.459206:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+7:2400:x1875409531616896:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1788530281.459328:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+7:2400:x1875409531616896:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 123us (2981us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530281.459337:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 99 00000100:00080000:3.0:1788530281.459393:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788530281.459408:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531617024 00000100:00100000:3.0:1788530281.459414:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531617024 00000100:00100000:3.0:1788530281.459478:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 352 00000100:00100000:3.0:1788530281.459487:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37370380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2400:x1875409531617024:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1788530281.459521:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37370380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2400:x1875409531617024:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 35us (2579us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530281.459528:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 352 00000100:00080000:3.0:1788530281.459544:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788530281.465337:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531616640 00000100:00100000:2.0:1788530281.465352:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531616640 00000100:00100000:3.0:1788530281.466059:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 439 00000100:00100000:3.0:1788530281.466072:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f396c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f442bcd-b742-4e76-ad7b-709f731358a0+14:2400:x1875409531616640:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1788530281.466165:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f396c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f442bcd-b742-4e76-ad7b-709f731358a0+14:2400:x1875409531616640:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 96us (12699us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530281.466174:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 439 00000100:00100000:2.0:1788530281.539202:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03c50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555836160:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788530281.539312:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530281.539396:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555836160 00000100:00100000:2.0:1788530281.539404:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555836160 00000100:00100000:2.0:1788530281.539446:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788530281.539455:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555836160:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788530281.539489:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446453248 avail 1300213760 00000100:00100000:2.0:1788530281.539538:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555836160:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530281.539545:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788530281.539616:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03c50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555836160:0@lo:41:osp-pre-1-0.0 00000040:00080000:3.0:1788530281.539995:0:13811:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788530281.540001:0:13811:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788530281.540042:0:13811:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788530281.540051:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788530281.540180:0:13811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37365180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13811:1875409555836288:192.168.202.41@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788530281.541395:0:13811:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f08cd5c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788530281.546406:0:13811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37365180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13811:1875409555836288:192.168.202.41@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788530281.547418:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530281.554854:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531617280 00000100:00100000:0.0:1788530281.554869:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531617280 00000100:00100000:0.0:1788530281.555036:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 78 00000100:00100000:0.0:1788530281.555048:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37365180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+32:11306:x1875409531617280:12345-192.168.202.41@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788530281.555082:0:10720:0:(mdt_handler.c:7977:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788530281.555226:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37365180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+32:11306:x1875409531617280:12345-192.168.202.41@tcp:53:lhsmtool_posix.0 Request processed in 181us (7814us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530281.555234:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 78 00000100:00100000:3.0:1788530281.569421:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530281.569513:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531617408 00000100:00100000:1.0:1788530281.569527:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531617408 00000100:00100000:1.0:1788530281.569651:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 79 00000100:00100000:1.0:1788530281.569663:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0335aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+32:11306:x1875409531617408:12345-192.168.202.41@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788530281.569753:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea200/0xb28d70e125750b33 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530281.569772:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea200/0xb28d70e125750b33 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530281.569786:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea200/0xb28d70e125750b33 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530281.569865:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e125750b3a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530281.569874:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e125750b3a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530281.569881:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e125750b3a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530281.569910:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eae00/0xb28d70e125750b41 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530281.569930:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eae00/0xb28d70e125750b41 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530281.569938:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eae00/0xb28d70e125750b41 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788530281.570000:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788530281.570006:0:6524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788530281.570024:0:6524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eae00/0xb28d70e125750b41 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530281.570037:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea200/0xb28d70e125750b33 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530281.570043:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea200/0xb28d70e125750b33 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530281.570051:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea200/0xb28d70e125750b33 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530281.570068:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f012ea200 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:1.0:1788530281.570072:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea200/0xb28d70e125750b33 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530281.570081:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea200/0xb28d70e125750b33 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530281.570095:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a9f2b992000) 00010000:00010000:1.0:1788530281.570098:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788530281.570105:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea200/0xb28d70e125750b33 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530281.570111:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea200/0xb28d70e125750b33 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530281.570128:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e125750b3a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530281.570134:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e125750b3a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530281.570139:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e125750b3a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530281.570144:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f012eac00 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:1.0:1788530281.570147:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e125750b3a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530281.570153:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e125750b3a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530281.570176:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff9a9f32abd900) 00010000:00010000:1.0:1788530281.570179:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788530281.570182:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e125750b3a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530281.570187:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e125750b3a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530281.570205:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eae00/0xb28d70e125750b41 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530281.570211:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eae00/0xb28d70e125750b41 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530281.570217:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eae00/0xb28d70e125750b41 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530281.570221:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f012eae00 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:1.0:1788530281.570224:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eae00/0xb28d70e125750b41 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530281.570229:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eae00/0xb28d70e125750b41 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530281.570236:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a9f092c5e00) 00010000:00010000:1.0:1788530281.570239:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788530281.570241:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eae00/0xb28d70e125750b41 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530281.570247:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eae00/0xb28d70e125750b41 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530281.570345:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0335aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+32:11306:x1875409531617408:12345-192.168.202.41@tcp:34:lhsmtool_posix.0 Request processed in 684us (936us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530281.570353:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 79 00000100:00100000:2.0:1788530281.573666:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530281.573800:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531617664 00000100:00100000:3.0:1788530281.573810:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531617664 00000100:00100000:3.0:1788530281.573884:0:10719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 80 00000100:00100000:3.0:1788530281.573895:0:10719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+32:11306:x1875409531617664:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788530281.573916:0:10719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788530281.573948:0:10719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031400/0xb28d70e125750b48 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550913 expref: -99 pid: 10719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530281.574053:0:10719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e125750b4f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530281.574068:0:10719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e125750b4f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530281.574080:0:10719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e125750b4f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788530281.574091:0:10719:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788530281.574178:0:10719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e125750b4f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530281.574196:0:10719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e125750b4f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530281.574203:0:10719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e125750b4f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530281.574209:0:10719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f00031800 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:3.0:1788530281.574214:0:10719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e125750b4f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530281.574255:0:10719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e125750b4f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530281.574269:0:10719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a9f092c5e00) 00010000:00010000:3.0:1788530281.574273:0:10719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788530281.574278:0:10719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e125750b4f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530281.574286:0:10719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e125750b4f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530281.574350:0:10719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031400/0xb28d70e125750b48 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550913 expref: 34 pid: 10719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530281.574360:0:10719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a9f2b992000) 00010000:00010000:3.0:1788530281.574363:0:10719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788530281.574367:0:10719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031400/0xb28d70e125750b48 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550913 expref: 34 pid: 10719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530281.574377:0:10719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f00031400, rc 0) 00000100:00100000:3.0:1788530281.574511:0:10719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+33:11306:x1875409531617664:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 616us (855us total) trans 4294967353 rc 301/301 00000100:00100000:3.0:1788530281.574518:0:10719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 80 00000100:00100000:0.0:1788530281.587796:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530281.587838:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531617792 00000100:00100000:0.0:1788530281.587850:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531617792 00000100:00100000:0.0:1788530281.587945:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 81 00000100:00100000:0.0:1788530281.587957:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+33:11306:x1875409531617792:12345-192.168.202.41@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788530281.588012:0:10720:0:(mdt_handler.c:7977:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788530281.588125:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+33:11306:x1875409531617792:12345-192.168.202.41@tcp:53:lhsmtool_posix.0 Request processed in 170us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530281.588132:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 81 00000100:00100000:1.0:1788530281.601775:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530281.602420:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531618048 00000100:00100000:0.0:1788530281.602432:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531618048 00000100:00100000:1.0:1788530281.602593:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 82 00000100:00100000:1.0:1788530281.602606:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+33:11306:x1875409531618048:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788530281.602631:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530281.602636:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788530281.602676:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb800/0xb28d70e125750b09 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550905 expref: 33 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530281.602697:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a9e0241d100) 00010000:00010000:1.0:1788530281.602702:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788530281.602717:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eae00/0xb28d70e125750b5d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a55091a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788530281.603138:0:6524:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:1.0:1788530281.603303:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e125750b64 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530281.603318:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e125750b64 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530281.603329:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e125750b64 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530281.603394:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eae00/0xb28d70e125750b5d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a55091a expref: 35 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530281.603420:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e125750b64 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a55091a expref: 34 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530281.603428:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9a9f32abd900) 00010000:00010000:1.0:1788530281.603431:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788530281.603433:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f012eac00, rc 0) 00000100:00100000:1.0:1788530281.603513:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+34:11306:x1875409531618048:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 909us (1749us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1788530281.603521:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 82 00000100:00100000:0.0:1788530281.608474:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530281.608599:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531618304 00000100:00100000:3.0:1788530281.608619:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531618304 00000100:00100000:3.0:1788530281.608706:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 83 00000100:00100000:3.0:1788530281.608718:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+34:11306:x1875409531618304:12345-192.168.202.41@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788530281.608795:0:8678:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788530281.608826:0:8678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e125750b64 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a55091a expref: 34 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530281.608846:0:8678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9a9f32abd900) 00010000:00010000:3.0:1788530281.608859:0:8678:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788530281.608880:0:8678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030400/0xb28d70e125750b72 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530281.608895:0:8678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030400/0xb28d70e125750b72 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530281.608905:0:8678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030400/0xb28d70e125750b72 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530281.608933:0:8678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030000/0xb28d70e125750b79 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xfd1473aa bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530281.608940:0:8678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030000/0xb28d70e125750b79 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xfd1473aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530281.608947:0:8678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030000/0xb28d70e125750b79 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xfd1473aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530281.608989:0:8678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030400/0xb28d70e125750b72 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530281.608996:0:8678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030400/0xb28d70e125750b72 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530281.609002:0:8678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030400/0xb28d70e125750b72 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530281.609016:0:8678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f00030400 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:3.0:1788530281.609020:0:8678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030400/0xb28d70e125750b72 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530281.609028:0:8678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030400/0xb28d70e125750b72 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530281.609037:0:8678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a9e0241d100) 00010000:00010000:3.0:1788530281.609040:0:8678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788530281.609044:0:8678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030400/0xb28d70e125750b72 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530281.609050:0:8678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030400/0xb28d70e125750b72 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530281.609060:0:8678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030000/0xb28d70e125750b79 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xfd1473aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530281.609067:0:8678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030000/0xb28d70e125750b79 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xfd1473aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530281.609073:0:8678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030000/0xb28d70e125750b79 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xfd1473aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530281.609079:0:8678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f00030000 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:3.0:1788530281.609082:0:8678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030000/0xb28d70e125750b79 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xfd1473aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530281.609087:0:8678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030000/0xb28d70e125750b79 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xfd1473aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530281.609107:0:8678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xfd1473aa (ffff9a9f02efad00) 00010000:00010000:3.0:1788530281.609110:0:8678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788530281.609113:0:8678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030000/0xb28d70e125750b79 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xfd1473aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530281.609119:0:8678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030000/0xb28d70e125750b79 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xfd1473aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530281.609219:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+33:11306:x1875409531618304:12345-192.168.202.41@tcp:36:lhsmtool_posix.0 Request processed in 503us (759us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788530281.609227:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 83 00000100:00100000:1.0:1788530281.622495:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530281.622634:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531618432 00000100:00100000:0.0:1788530281.622648:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531618432 00000100:00100000:0.0:1788530281.622755:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 84 00000100:00100000:0.0:1788530281.622768:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+33:11306:x1875409531618432:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788530281.622791:0:10720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530281.622817:0:10720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100000/0xb28d70e125750b80 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550921 expref: -99 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530281.622859:0:10720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100600/0xb28d70e125750b87 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530281.622874:0:10720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100600/0xb28d70e125750b87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530281.622886:0:10720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100600/0xb28d70e125750b87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530281.623052:0:10720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100000/0xb28d70e125750b80 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550921 expref: 35 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530281.623073:0:10720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100600/0xb28d70e125750b87 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550921 expref: 34 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530281.623090:0:10720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9a9e0241da00) 00010000:00010000:0.0:1788530281.623093:0:10720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788530281.623097:0:10720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d100600, rc 0) 00000100:00100000:0.0:1788530281.623162:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+34:11306:x1875409531618432:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 397us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530281.623170:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 84 00000100:00100000:1.0:1788530281.627478:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530281.628686:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531618688 00000100:00100000:3.0:1788530281.628711:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531618688 00000100:00100000:3.0:1788530281.628807:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 85 00000100:00100000:3.0:1788530281.628818:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d3f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+34:11306:x1875409531618688:12345-192.168.202.41@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788530281.628933:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030000/0xb28d70e125750b8e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530281.628950:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030000/0xb28d70e125750b8e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530281.628962:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030000/0xb28d70e125750b8e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788530281.629159:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:3.0:1788530281.629170:0:6524:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 489531608526ns, next at 490531605583ns, rc = 0 00000004:00010000:3.0:1788530281.629234:0:6524:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cd05e0ce reply state 0000000069f06fe9 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030000/0xb28d70e125750b8e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530281.629286:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030000/0xb28d70e125750b8e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530281.629294:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9a9e0241da00) 00010000:00010000:3.0:1788530281.629297:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788530281.629301:0:6524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788530281.629415:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d3f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+36:11306:x1875409531618688:12345-192.168.202.41@tcp:36:lhsmtool_posix.0 Request processed in 598us (1957us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1788530281.629421:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 85 00000100:00100000:3.0:1788530281.638267:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530281.638414:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531618816 00000100:00100000:0.0:1788530281.638428:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531618816 00000100:00100000:0.0:1788530281.638524:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 86 00000100:00100000:0.0:1788530281.638534:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0335b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+36:11306:x1875409531618816:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788530281.638601:0:8678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530281.638630:0:8678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100000/0xb28d70e125750b95 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550928 expref: -99 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530281.638705:0:8678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100000/0xb28d70e125750b95 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550928 expref: 37 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530281.638722:0:8678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100000/0xb28d70e125750b95 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550928 expref: 37 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530281.638744:0:8678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9a9e0241da00) 00010000:00010000:0.0:1788530281.638747:0:8678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788530281.638751:0:8678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d100000, rc 0) 00000100:00100000:0.0:1788530281.638807:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0335b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+37:11306:x1875409531618816:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 274us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530281.638831:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 86 00000100:00100000:1.0:1788530281.654090:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530281.654221:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531618944 00000100:00100000:2.0:1788530281.654234:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531618944 00000100:00100000:2.0:1788530281.654287:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 33 00000100:00100000:2.0:1788530281.654297:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d3f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2398:x1875409531618944:12345-192.168.202.41@tcp:8:lhsmtool_posix.0 00010000:00080000:2.0:1788530281.654341:0:8752:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-OST0001: connection from aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41@192.168.202.41@tcp t0 exp 0000000000000000 cur 489 last 0 00000020:00000080:2.0:1788530281.654386:0:8752:0:(genops.c:1385:class_connect()) connect: client aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41, cookie 0xb28d70e125750b9c 00002000:00100000:2.0:1788530281.654402:0:8752:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41/ffff9a9e03e59800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a05 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788530281.654414:0:8752:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788530281.654527:0:8752:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788530281.654582:0:8752:0:(import.c:65:import_set_state_nolock()) ffff9a9e03e5e800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788530281.654882:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d3f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:2398:x1875409531618944:12345-192.168.202.41@tcp:8:lhsmtool_posix.0 Request processed in 583us (804us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530281.654890:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 33 00000100:00100000:1.0:1788530281.658200:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530281.658369:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531619072 00000100:00100000:3.0:1788530281.658380:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531619072 00000100:00100000:3.0:1788530281.658471:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 34 00000100:00100000:3.0:1788530281.658485:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d3fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:0:x1875409531619072:12345-192.168.202.41@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1788530281.659078:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1788530281.671329:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00100000:3.0:1788530281.671349:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41 00000100:00100000:0.0:1788530281.672999:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d3fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:0:x1875409531619072:12345-192.168.202.41@tcp:2:lhsmtool_posix.0 Request processed in 14504us (14808us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1788530281.673014:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 34 00010000:00010000:1.0:1788530281.673139:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788530281.678611:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530281.678814:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531619328 00000100:00100000:0.0:1788530281.678835:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531619328 00000100:00100000:0.0:1788530281.678899:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 19 00000100:00100000:0.0:1788530281.678911:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+37:11306:x1875409531619328:12345-192.168.202.41@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788530281.679207:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+38:11306:x1875409531619328:12345-192.168.202.41@tcp:35:lhsmtool_posix.0 Request processed in 298us (609us total) trans 4294967356 rc 0/0 00000100:00100000:0.0:1788530281.679217:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 19 00000100:00100000:2.0:1788530281.687314:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530281.687415:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531619584 00000100:00100000:0.0:1788530281.687427:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531619584 00000100:00100000:0.0:1788530281.687530:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 87 00000100:00100000:0.0:1788530281.687542:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+38:11306:x1875409531619584:12345-192.168.202.41@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788530281.687720:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+38:11306:x1875409531619584:12345-192.168.202.41@tcp:57:lhsmtool_posix.0 Request processed in 180us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530281.687729:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 87 00000100:00100000:3.0:1788530281.691783:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530281.692006:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531619712 00000100:00100000:0.0:1788530281.692019:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531619712 00000100:00100000:0.0:1788530281.692110:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 88 00000100:00100000:0.0:1788530281.692123:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37409f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+38:11306:x1875409531619712:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788530281.692150:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530281.692174:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100400/0xb28d70e125750ba3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a55092f expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530281.692286:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101600/0xb28d70e125750baa lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530281.692303:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101600/0xb28d70e125750baa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530281.692317:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101600/0xb28d70e125750baa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788530281.692375:0:6524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788530281.692400:0:6524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101600/0xb28d70e125750baa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530281.692431:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100400/0xb28d70e125750ba3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a55092f expref: 40 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530281.692454:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101600/0xb28d70e125750baa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a55092f expref: 39 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530281.692464:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9a9e0241da00) 00010000:00010000:0.0:1788530281.692467:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788530281.692472:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d101600, rc 0) 00000100:00100000:0.0:1788530281.692552:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37409f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+39:11306:x1875409531619712:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 432us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530281.692605:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 88 00000100:00100000:3.0:1788530281.700402:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530281.700512:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531619840 00000100:00100000:2.0:1788530281.700522:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531619840 00000100:00100000:2.0:1788530281.700609:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 35 00000100:00100000:2.0:1788530281.700620:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3740ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2400:x1875409531619840:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788530281.700637:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530281.700671:0:8438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000870096cb/0xb28d70e125750bb1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550936 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788530281.700695:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9ace69, blocks: 0x0 00010000:00010000:2.0:1788530281.700715:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=489s v=(0 0) 00010000:00010000:2.0:1788530281.700719:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788530281.700729:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000870096cb/0xb28d70e125750bb1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550936 expref: 6 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530281.700749:0:8438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000870096cb/0xb28d70e125750bb1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550936 expref: 6 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530281.700763:0:8438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d20d400, rc 0) 00000100:00100000:2.0:1788530281.700941:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3740ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:2400:x1875409531619840:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 322us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530281.700965:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 35 00000100:00100000:2.0:1788530281.731965:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530281.732010:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531620096 00000100:00100000:2.0:1788530281.732019:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531620096 00000100:00100000:2.0:1788530281.732086:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 89 00000100:00100000:2.0:1788530281.732097:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03766a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+39:11306:x1875409531620096:12345-192.168.202.41@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788530281.732222:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03766a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+39:11306:x1875409531620096:12345-192.168.202.41@tcp:57:lhsmtool_posix.0 Request processed in 126us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530281.732230:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 89 00000100:00100000:0.0:1788530281.737514:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530281.737655:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531620224 00000100:00100000:3.0:1788530281.737666:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531620224 00000100:00100000:3.0:1788530281.737725:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 36 00000100:00100000:3.0:1788530281.737737:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:11306:x1875409531620224:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788530281.737755:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788530281.737775:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000247abbd4/0xb28d70e125750bb8 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a55093d expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530281.737953:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000870096cb/0xb28d70e125750bb1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550936 expref: 7 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530281.737963:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788530281.737967:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788530281.737973:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000247abbd4/0xb28d70e125750bb8 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a55093d expref: 7 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530281.738009:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000870096cb/0xb28d70e125750bb1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550936 expref: 7 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530281.738024:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000870096cb/0xb28d70e125750bb1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550936 expref: 7 pid: 8438 timeout: 589 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530281.738039:0:8436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1875409555836416:192.168.202.41@tcp:104: 00000100:00100000:3.0:1788530281.738140:0:8436:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f08cd5540 going to sleep for 11 seconds 00000100:00100000:0.0:1788530281.743913:0:8436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1875409555836416:192.168.202.41@tcp:104: 00010000:00010000:0.0:1788530281.743968:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000247abbd4/0xb28d70e125750bb8 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.41@tcp remote: 0x2b1406819a55093d expref: 7 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530281.744007:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f00030400, rc 0) 00000100:00100000:0.0:1788530281.744084:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+7:11306:x1875409531620224:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 6348us (6584us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530281.744093:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 36 00000100:00100000:1.0:1788530281.772158:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530281.773405:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531620352 00000100:00100000:3.0:1788530281.773420:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531620352 00010000:00010000:3.0:1788530281.773464:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000870096cb/0xb28d70e125750bb1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550936 expref: 7 pid: 8438 timeout: 589 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530281.773507:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 68 00000100:00100000:3.0:1788530281.773517:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d3fb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+7:2402:x1875409531620352:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788530281.773533:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788530281.773584:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000870096cb/0xb28d70e125750bb1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550936 expref: 7 pid: 8438 timeout: 589 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530281.773599:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000870096cb/0xb28d70e125750bb1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550936 expref: 7 pid: 8438 timeout: 589 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530281.773640:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000870096cb/0xb28d70e125750bb1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550936 expref: 7 pid: 8438 timeout: 589 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530281.773655:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788530281.773660:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788530281.773669:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000247abbd4/0xb28d70e125750bb8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.41@tcp remote: 0x2b1406819a55093d expref: 6 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530281.773680:0:6509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000247abbd4/0xb28d70e125750bb8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.41@tcp remote: 0x2b1406819a55093d expref: 6 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530281.773717:0:6509:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000247abbd4/0xb28d70e125750bb8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.41@tcp remote: 0x2b1406819a55093d expref: 6 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530281.773732:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6509:1875409555836544:192.168.202.41@tcp:105: 00000100:00100000:3.0:1788530281.774116:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f08cd5c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788530281.779903:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6509:1875409555836544:192.168.202.41@tcp:105: 00010000:00010000:3.0:1788530281.779947:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788530281.780018:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d3fb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:2402:x1875409531620352:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 6501us (7870us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530281.780049:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 68 00000100:00100000:1.0:1788530281.781742:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530281.786285:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531620480 00000100:00100000:2.0:1788530281.786305:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531620480 00002000:00100000:2.0:1788530281.786379:0:8444:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff9a9f3960ea00 x1875409531620480/t0(0) o4->aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41@192.168.202.41@tcp:222/0 lens 504/0 e 0 to 0 dl 1788530292 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788530281.786393:0:8444:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a9f3960ea00 with x1875409531620480 ext(0->8) 00002000:00010000:2.0:1788530281.786399:0:8444:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a9f3960ea00 00000100:00100000:2.0:1788530281.786445:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 0 00000100:00100000:2.0:1788530281.786456:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3960ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:2399:x1875409531620480:12345-192.168.202.41@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788530281.792214:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3960ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+8:2399:x1875409531620480:12345-192.168.202.41@tcp:4:lhsmtool_posix.0 Request processed in 5741us (10461us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1788530281.792232:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 0 00002000:00100000:2.0:1788530281.792249:0:8444:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff9a9f3960ea00 x1875409531620480/t4294967303(0) o4->aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41@192.168.202.41@tcp:222/0 lens 504/448 e 0 to 0 dl 1788530292 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788530281.792261:0:8444:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a9f3960ea00 with x1875409531620480 ext(0->8) 00002000:00010000:2.0:1788530281.792287:0:8444:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a9f3960ea00 00000100:00100000:1.0:1788530281.795894:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530281.796061:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531620608 00000100:00100000:2.0:1788530281.796072:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531620608 00000100:00100000:2.0:1788530281.796160:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 90 00000100:00100000:2.0:1788530281.796172:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3960f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+39:11306:x1875409531620608:12345-192.168.202.41@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788530281.800373:0:6502:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:3.0:1788530281.800396:0:6502:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:3.0:1788530281.800458:0:6502:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:3.0:1788530281.800488:0:6555:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:3.0:1788530281.800501:0:6555:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1788530281.800667:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3960f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+18:11306:x1875409531620608:12345-192.168.202.41@tcp:44:lhsmtool_posix.0 Request processed in 4491us (4779us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530281.800679:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 90 00000100:00100000:0.0:1788530281.802740:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788530281.802769:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3960dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555836672:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788530281.802847:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530281.804301:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555836672 00000100:00100000:1.0:1788530281.804315:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555836672 00000100:00100000:1.0:1788530281.804386:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788530281.804398:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555836672:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1788530281.804552:0:8438:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788530281.804556:0:8438:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1788530281 00002000:00010000:1.0:1788530281.804592:0:8438:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788530281.804595:0:8438:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1788530281 -> 1788530281 00002000:00010000:1.0:1788530281.804615:0:8438:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1788530281.804688:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3649:x1875409555836672:12345-0@lo:2:osp-syn-1-0.0 Request processed in 292us (1841us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1788530281.804696:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000004:00080000:1.0:1788530281.804748:0:3649:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a9f3960dc00/2, rc 0, transno 4294967304 00000100:00100000:1.0:1788530281.804754:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3960dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555836672:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788530281.807190:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530281.807277:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531620736 00000100:00100000:3.0:1788530281.807289:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531620736 00000100:00100000:3.0:1788530281.807349:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 38 00000100:00100000:3.0:1788530281.807361:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+8:2401:x1875409531620736:12345-192.168.202.41@tcp:16:lhsmtool_posix.0 00010000:00010000:2.0:1788530281.811515:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb400/0xb28d70e125750a22 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530281.811535:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb400/0xb28d70e125750a22 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530281.811545:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb400/0xb28d70e125750a22 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530281.811553:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f012eb400 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:2.0:1788530281.811581:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb400/0xb28d70e125750a22 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530281.811591:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb400/0xb28d70e125750a22 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530281.811616:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a9f092c5e00) 00010000:00010000:2.0:1788530281.811619:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788530281.811624:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb400/0xb28d70e125750a22 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530281.811630:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb400/0xb28d70e125750a22 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530281.811653:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d600/0xb28d70e125750a45 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530281.811672:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d600/0xb28d70e125750a45 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530281.811678:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d600/0xb28d70e125750a45 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530281.811683:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d20d600 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:2.0:1788530281.811686:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d600/0xb28d70e125750a45 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530281.811692:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d600/0xb28d70e125750a45 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530281.811699:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a9f092c5e00) 00010000:00010000:2.0:1788530281.811702:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788530281.811704:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d600/0xb28d70e125750a45 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530281.811709:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d600/0xb28d70e125750a45 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530281.811723:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20dc00/0xb28d70e125750a8b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530281.811728:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20dc00/0xb28d70e125750a8b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530281.811733:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20dc00/0xb28d70e125750a8b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530281.811738:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d20dc00 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:2.0:1788530281.811747:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20dc00/0xb28d70e125750a8b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530281.811752:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20dc00/0xb28d70e125750a8b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530281.811761:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a9f092c5e00) 00010000:00010000:2.0:1788530281.811763:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788530281.811765:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20dc00/0xb28d70e125750a8b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530281.811771:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20dc00/0xb28d70e125750a8b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530281.811782:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030000/0xb28d70e125750b8e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530281.811788:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030000/0xb28d70e125750b8e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530281.811792:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030000/0xb28d70e125750b8e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530281.811797:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f00030000 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:2.0:1788530281.811800:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030000/0xb28d70e125750b8e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530281.811806:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030000/0xb28d70e125750b8e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530281.811813:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9a9e0241da00) 00010000:00010000:2.0:1788530281.811826:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788530281.811835:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030000/0xb28d70e125750b8e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530281.811841:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030000/0xb28d70e125750b8e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788530281.817772:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:3.0:1788530281.817790:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:1.0:1788530281.818038:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:2401:x1875409531620736:12345-192.168.202.41@tcp:16:lhsmtool_posix.0 Request processed in 10672us (10854us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530281.818051:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 38 00000100:00100000:1.0:1788530281.823989:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530281.828309:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531620992 00000100:00100000:3.0:1788530281.828329:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531620992 00000100:00100000:3.0:1788530281.828419:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 91 00000100:00100000:3.0:1788530281.828430:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3960d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+14:11306:x1875409531620992:12345-192.168.202.41@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788530281.828513:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788530281.828550:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101600/0xb28d70e125750baa lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a55092f expref: 14 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530281.828595:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9a9e0241da00) 00010000:00010000:3.0:1788530281.828601:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788530281.828641:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031400/0xb28d70e125750bbf lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530281.828670:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031400/0xb28d70e125750bbf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530281.828684:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031400/0xb28d70e125750bbf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788530281.828866:0:6524:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e670249b reply state 00000000a7cff961 transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031400/0xb28d70e125750bbf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530281.828880:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031400/0xb28d70e125750bbf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530281.828888:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9a9e0241da00) 00010000:00010000:3.0:1788530281.828891:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788530281.828894:0:6524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788530281.829031:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3960d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+15:11306:x1875409531620992:12345-192.168.202.41@tcp:36:lhsmtool_posix.0 Request processed in 601us (5049us total) trans 4294967357 rc 0/0 00000100:00100000:3.0:1788530281.829052:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 91 00000100:00100000:3.0:1788530281.835994:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530281.836162:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531621120 00000100:00100000:1.0:1788530281.836171:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531621120 00000100:00100000:1.0:1788530281.836270:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 39 00000100:00100000:1.0:1788530281.836281:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:2402:x1875409531621120:12345-192.168.202.41@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788530281.836423:0:8438:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1788530281.836427:0:8438:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1788530281 -> 1788530279 00002000:00010000:1.0:1788530281.836430:0:8438:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1788530277 00002000:00010000:1.0:1788530281.836433:0:8438:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1788530281 -> 1788530279 00002000:00010000:1.0:1788530281.836435:0:8438:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1788530281.836503:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+7:2402:x1875409531621120:12345-192.168.202.41@tcp:2:lhsmtool_posix.0 Request processed in 224us (518us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1788530281.836511:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 39 00000100:00100000:0.0:1788530281.849000:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530281.849090:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531621376 00000100:00100000:1.0:1788530281.849101:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531621376 00000100:00100000:1.0:1788530281.849177:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 92 00000100:00100000:1.0:1788530281.849189:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+15:11306:x1875409531621376:12345-192.168.202.41@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788530281.849266:0:8678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea800/0xb28d70e125750bc6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530281.849283:0:8678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100600/0xb28d70e125750b87 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550921 expref: 15 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530281.849292:0:8678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea800/0xb28d70e125750bc6 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530281.849327:0:8678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100600/0xb28d70e125750b87 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550921 expref: 15 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530281.849341:0:8678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100600/0xb28d70e125750b87 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550921 expref: 15 pid: 10720 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530281.849355:0:8678:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3960ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8678:1875409555836800:192.168.202.41@tcp:104: 00000100:00100000:1.0:1788530281.849455:0:8678:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f3d05a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788530281.852817:0:8678:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3960ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8678:1875409555836800:192.168.202.41@tcp:104: 00010000:00010000:3.0:1788530281.852850:0:8678:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea800/0xb28d70e125750bc6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530281.855522:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530281.855685:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531621504 00000100:00100000:3.0:1788530281.855696:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531621504 00010000:00010000:3.0:1788530281.855740:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100600/0xb28d70e125750b87 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550921 expref: 16 pid: 10720 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530281.855837:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 69 00000100:00100000:3.0:1788530281.855862:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+16:2400:x1875409531621504:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788530281.855877:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788530281.855885:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100600/0xb28d70e125750b87 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550921 expref: 16 pid: 10720 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530281.855900:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100600/0xb28d70e125750b87 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550921 expref: 16 pid: 10720 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530281.855935:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100600/0xb28d70e125750b87 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550921 expref: 16 pid: 10720 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530281.855953:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9a9e0241da00) 00010000:00010000:3.0:1788530281.855959:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea800/0xb28d70e125750bc6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530281.855968:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea800/0xb28d70e125750bc6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530281.855976:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea800/0xb28d70e125750bc6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530281.856009:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788530281.856071:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+15:2400:x1875409531621504:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 211us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530281.856078:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 69 00010000:00010000:1.0:1788530281.856096:0:8678:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea800/0xb28d70e125750bc6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530281.856108:0:8678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea800/0xb28d70e125750bc6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530281.856147:0:8678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea800/0xb28d70e125750bc6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530281.856155:0:8678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea800/0xb28d70e125750bc6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530281.856161:0:8678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea800/0xb28d70e125750bc6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530281.856174:0:8678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f012ea800 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:1.0:1788530281.856178:0:8678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea800/0xb28d70e125750bc6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530281.856199:0:8678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea800/0xb28d70e125750bc6 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530281.856208:0:8678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9a9e0241da00) 00010000:00010000:1.0:1788530281.856211:0:8678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788530281.856215:0:8678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea800/0xb28d70e125750bc6 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530281.856220:0:8678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea800/0xb28d70e125750bc6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530281.856261:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+14:11306:x1875409531621376:12345-192.168.202.41@tcp:55:lhsmtool_posix.0 Request processed in 7075us (7275us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788530281.856281:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 92 00000100:00100000:3.0:1788530281.861404:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530281.861987:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531621632 00000100:00100000:0.0:1788530281.862004:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531621632 00000100:00100000:0.0:1788530281.862103:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 40 00000100:00100000:0.0:1788530281.862118:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+7:2399:x1875409531621632:12345-192.168.202.41@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788530281.862194:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000096ca2652/0xb28d70e125750bcd lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530281.862222:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000247abbd4/0xb28d70e125750bb8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.41@tcp remote: 0x2b1406819a55093d expref: 7 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530281.862232:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788530281.862237:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788530281.862242:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096ca2652/0xb28d70e125750bcd lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530281.862306:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000247abbd4/0xb28d70e125750bb8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.41@tcp remote: 0x2b1406819a55093d expref: 7 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530281.862322:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000247abbd4/0xb28d70e125750bb8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.41@tcp remote: 0x2b1406819a55093d expref: 7 pid: 8436 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530281.862343:0:8436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037d1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1875409555836928:192.168.202.41@tcp:104: 00000100:00100000:0.0:1788530281.862459:0:8436:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e027689c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788530281.869168:0:8436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037d1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1875409555836928:192.168.202.41@tcp:104: 00010000:00010000:3.0:1788530281.869222:0:8436:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000096ca2652/0xb28d70e125750bcd lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530281.869231:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530281.869278:0:10347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531621760 00000100:00100000:0.0:1788530281.869288:0:10347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531621760 00010000:00010000:0.0:1788530281.869331:0:10347:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000247abbd4/0xb28d70e125750bb8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.41@tcp remote: 0x2b1406819a55093d expref: 8 pid: 8436 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530281.869385:0:10347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 70 00000100:00100000:0.0:1788530281.869831:0:10347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c59500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+8:2400:x1875409531621760:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788530281.869848:0:10347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788530281.869871:0:10347:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000247abbd4/0xb28d70e125750bb8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.41@tcp remote: 0x2b1406819a55093d expref: 8 pid: 8436 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530281.869887:0:10347:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000247abbd4/0xb28d70e125750bb8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.41@tcp remote: 0x2b1406819a55093d expref: 8 pid: 8436 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530281.869932:0:10347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000247abbd4/0xb28d70e125750bb8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.41@tcp remote: 0x2b1406819a55093d expref: 8 pid: 8436 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530281.869956:0:10347:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788530281.869961:0:10347:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788530281.869967:0:10347:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000096ca2652/0xb28d70e125750bcd lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530281.869978:0:10347:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096ca2652/0xb28d70e125750bcd lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530281.870013:0:10347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788530281.870028:0:8436:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000096ca2652/0xb28d70e125750bcd lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530281.870038:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000096ca2652/0xb28d70e125750bcd lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530281.870063:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000096ca2652/0xb28d70e125750bcd lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530281.870071:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000096ca2652/0xb28d70e125750bcd lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530281.870080:0:8436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000096ca2652/0xb28d70e125750bcd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530281.870088:0:8436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d101400 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:3.0:1788530281.870094:0:8436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000096ca2652/0xb28d70e125750bcd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530281.870099:0:10347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c59500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+7:2400:x1875409531621760:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 282us (868us total) trans 0 rc 0/0 00010000:00010000:3.0:1788530281.870109:0:8436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000096ca2652/0xb28d70e125750bcd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530281.870114:0:10347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 70 00010000:00010000:3.0:1788530281.870129:0:8436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000096ca2652/0xb28d70e125750bcd lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530281.870149:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096ca2652/0xb28d70e125750bcd lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530281.870204:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:2399:x1875409531621632:12345-192.168.202.41@tcp:1:lhsmtool_posix.0 Request processed in 8091us (8816us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530281.870211:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 40 00000100:00100000:2.0:1788530281.876801:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530281.879229:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531622016 00000100:00100000:1.0:1788530281.879253:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531622016 00000100:00100000:1.0:1788530281.879382:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 93 00000100:00100000:1.0:1788530281.879394:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37425c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+14:11306:x1875409531622016:12345-192.168.202.41@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788530281.879522:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb200/0xb28d70e125750bd4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530281.879545:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d800/0xb28d70e125750a1b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5508c6 expref: 14 pid: 10719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530281.882258:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb200/0xb28d70e125750bd4 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530281.882318:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d800/0xb28d70e125750a1b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a5508c6 expref: 14 pid: 10719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530281.882339:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d800/0xb28d70e125750a1b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a5508c6 expref: 14 pid: 10719 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530281.882359:0:6525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3960ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6525:1875409555837056:192.168.202.41@tcp:104: 00000100:00100000:1.0:1788530281.882481:0:6525:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f3d05a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788530281.890458:0:6525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3960ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6525:1875409555837056:192.168.202.41@tcp:104: 00010000:00010000:1.0:1788530281.890488:0:6525:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb200/0xb28d70e125750bd4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530281.893159:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530281.893287:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531622144 00000100:00100000:1.0:1788530281.893300:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531622144 00010000:00010000:1.0:1788530281.893360:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d800/0xb28d70e125750a1b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a5508c6 expref: 15 pid: 10719 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530281.893421:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 71 00000100:00100000:1.0:1788530281.893434:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c5b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+15:2400:x1875409531622144:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788530281.893457:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788530281.893466:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d800/0xb28d70e125750a1b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a5508c6 expref: 15 pid: 10719 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530281.893496:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d800/0xb28d70e125750a1b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a5508c6 expref: 15 pid: 10719 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530281.893538:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d800/0xb28d70e125750a1b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a5508c6 expref: 15 pid: 10719 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530281.893557:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a9f092c5e00) 00010000:00010000:1.0:1788530281.893587:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb200/0xb28d70e125750bd4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530281.893599:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb200/0xb28d70e125750bd4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530281.893608:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb200/0xb28d70e125750bd4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530281.893637:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788530281.893691:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c5b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+14:2400:x1875409531622144:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 259us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530281.893699:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 71 00010000:00010000:2.0:1788530281.893736:0:6525:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb200/0xb28d70e125750bd4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530281.893747:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb200/0xb28d70e125750bd4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530281.894480:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ce00/0xb28d70e125750bdb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530281.894505:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100000/0xb28d70e125750b95 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550928 expref: 14 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530281.894515:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ce00/0xb28d70e125750bdb lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530281.895383:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100000/0xb28d70e125750b95 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550928 expref: 14 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530281.895406:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100000/0xb28d70e125750b95 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550928 expref: 14 pid: 8678 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530281.895427:0:6525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03e8a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6525:1875409555837184:192.168.202.41@tcp:104: 00000100:00100000:2.0:1788530281.895540:0:6525:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f33e24000 going to sleep for 11 seconds 00000100:00100000:2.0:1788530281.905447:0:6525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03e8a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6525:1875409555837184:192.168.202.41@tcp:104: 00010000:00010000:2.0:1788530281.905492:0:6525:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ce00/0xb28d70e125750bdb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530281.907353:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530281.907449:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531622272 00000100:00100000:2.0:1788530281.907460:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531622272 00010000:00010000:2.0:1788530281.907514:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100000/0xb28d70e125750b95 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550928 expref: 15 pid: 8678 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530281.907595:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 72 00000100:00100000:2.0:1788530281.907693:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f396c2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+15:2399:x1875409531622272:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788530281.907715:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788530281.907723:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100000/0xb28d70e125750b95 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550928 expref: 15 pid: 8678 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530281.907737:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100000/0xb28d70e125750b95 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550928 expref: 15 pid: 8678 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530281.907764:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100000/0xb28d70e125750b95 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550928 expref: 15 pid: 8678 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530281.907783:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9a9e0241da00) 00010000:00010000:2.0:1788530281.907790:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ce00/0xb28d70e125750bdb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530281.907802:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ce00/0xb28d70e125750bdb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530281.907810:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ce00/0xb28d70e125750bdb lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530281.907944:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788530281.908027:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f396c2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+14:2399:x1875409531622272:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 421us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530281.908036:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 72 00010000:00010000:2.0:1788530281.908315:0:6525:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ce00/0xb28d70e125750bdb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530281.908326:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ce00/0xb28d70e125750bdb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788530281.908475:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:2.0:1788530281.909276:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:2.0:1788530281.909346:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:2.0:1788530281.909475:0:6525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03e8a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6525:1875409555837312:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788530281.909551:0:6525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530281.910065:0:6525:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f33e24780 going to sleep for 11 seconds 00000100:00100000:0.0:1788530281.913948:0:14186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555837312 00000100:00100000:0.0:1788530281.913963:0:14186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555837312 00000100:00100000:1.0:1788530281.914282:0:14186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1788530281.914294:0:14186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03e8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6525:x1875409555837312:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788530281.914452:0:14186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03e8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6525:x1875409555837312:12345-0@lo:1000:mdt00_002.0 Request processed in 160us (4900us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530281.914460:0:14186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1788530281.914755:0:6525:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:1.0:1788530281.914763:0:6525:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a9f3960dc00, transno 4294967304 00000100:00100000:1.0:1788530281.914800:0:6525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03e8a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6525:1875409555837312:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1788530281.914979:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:1.0:1788530281.915051:0:6525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3960ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6525:1875409555837440:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788530281.915099:0:6525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530281.915132:0:6525:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f04d98300 going to sleep for 11 seconds 00000100:00100000:2.0:1788530281.915253:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555837440 00000100:00100000:2.0:1788530281.915260:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555837440 00000100:00100000:2.0:1788530281.915307:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788530281.915318:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3960dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6525:x1875409555837440:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788530281.915445:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3960dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6525:x1875409555837440:12345-0@lo:1000:mdt00_002.0 Request processed in 129us (344us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1788530281.915458:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788530281.915544:0:6525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3960ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6525:1875409555837440:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1788530281.915744:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ce00/0xb28d70e125750bdb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530281.915755:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ce00/0xb28d70e125750bdb lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530281.915767:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ce00/0xb28d70e125750bdb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530281.915773:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d20ce00 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:0.0:1788530281.915785:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ce00/0xb28d70e125750bdb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530281.915794:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ce00/0xb28d70e125750bdb lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530281.915810:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9a9e0241da00) 00010000:00010000:0.0:1788530281.916445:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788530281.916456:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ce00/0xb28d70e125750bdb lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530281.916466:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ce00/0xb28d70e125750bdb lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530281.916512:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e125750b10 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530281.916520:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e125750b10 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530281.916526:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e125750b10 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530281.916532:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d20c000 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:0.0:1788530281.916535:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e125750b10 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530281.916541:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e125750b10 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530281.916551:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a9f092c5e00) 00010000:00010000:0.0:1788530281.916554:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788530281.916589:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e125750b10 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530281.916596:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e125750b10 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530281.917728:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101400/0xb28d70e125750be2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530281.917753:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ca00/0xb28d70e125750b2c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a55090c expref: 17 pid: 10719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530281.917762:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101400/0xb28d70e125750be2 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530281.917804:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ca00/0xb28d70e125750b2c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a55090c expref: 17 pid: 10719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530281.918132:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ca00/0xb28d70e125750b2c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a55090c expref: 17 pid: 10719 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530281.918151:0:6525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03c59880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6525:1875409555837568:192.168.202.41@tcp:104: 00000100:00100000:0.0:1788530281.918274:0:6525:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e02768000 going to sleep for 11 seconds 00000100:00100000:2.0:1788530281.924535:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530281.924623:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531622400 00000100:00100000:3.0:1788530281.924636:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531622400 00010000:00010000:3.0:1788530281.924688:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ca00/0xb28d70e125750b2c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a55090c expref: 18 pid: 10719 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530281.924733:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 73 00000100:00100000:3.0:1788530281.924747:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03e89f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+18:2399:x1875409531622400:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788530281.924763:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788530281.924771:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ca00/0xb28d70e125750b2c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a55090c expref: 18 pid: 10719 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530281.924785:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ca00/0xb28d70e125750b2c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a55090c expref: 18 pid: 10719 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530281.924818:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a9f092c5e00) 00010000:00010000:3.0:1788530281.924825:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101400/0xb28d70e125750be2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530281.924838:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101400/0xb28d70e125750be2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530281.924871:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101400/0xb28d70e125750be2 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530281.924894:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788530281.924982:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03e89f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+18:2399:x1875409531622400:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 236us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530281.924994:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 73 00010000:00010000:1.0:1788530281.925734:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ca00/0xb28d70e125750b2c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a55090c expref: 17 pid: 10719 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530281.925752:0:6525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03c59880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6525:1875409555837568:192.168.202.41@tcp:104: 00010000:00010000:1.0:1788530281.925779:0:6525:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101400/0xb28d70e125750be2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530281.925787:0:6525:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101400/0xb28d70e125750be2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530281.925793:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101400/0xb28d70e125750be2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530281.925805:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101400/0xb28d70e125750be2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530281.925812:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101400/0xb28d70e125750be2 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530281.925819:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101400/0xb28d70e125750be2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530281.925825:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d101400 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:1.0:1788530281.925829:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101400/0xb28d70e125750be2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530281.925849:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101400/0xb28d70e125750be2 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530281.925859:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a9f092c5e00) 00010000:00010000:1.0:1788530281.925862:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788530281.925866:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101400/0xb28d70e125750be2 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530281.925885:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101400/0xb28d70e125750be2 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530281.925900:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb200/0xb28d70e125750bd4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530281.925906:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb200/0xb28d70e125750bd4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530281.925911:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb200/0xb28d70e125750bd4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530281.925926:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f012eb200 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:1.0:1788530281.925929:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb200/0xb28d70e125750bd4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530281.925934:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb200/0xb28d70e125750bd4 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530281.925942:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a9f092c5e00) 00010000:00010000:1.0:1788530281.925944:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788530281.925947:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb200/0xb28d70e125750bd4 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530281.925961:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb200/0xb28d70e125750bd4 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530281.926176:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37425c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+16:11306:x1875409531622016:12345-192.168.202.41@tcp:57:lhsmtool_posix.0 Request processed in 46783us (49384us total) trans 4294967362 rc 0/0 00000100:00100000:1.0:1788530281.926196:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 93 00000020:00080000:1.0:1788530281.926201:0:6525:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788530281.927165:0:13811:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788530281.927174:0:13811:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788530281.927713:0:13811:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788530281.927722:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788530281.931040:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530281.931121:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531622656 00000100:00100000:1.0:1788530281.931133:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531622656 00000100:00100000:1.0:1788530281.931201:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 20 00000100:00100000:1.0:1788530281.931213:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+16:11306:x1875409531622656:12345-192.168.202.41@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788530281.931551:0:6527:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788530281.931625:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:1.0:1788530281.931664:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eae00/0xb28d70e125750be9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530281.931685:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eae00/0xb28d70e125750be9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530281.931699:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eae00/0xb28d70e125750be9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530281.931710:0:6527:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eae00/0xb28d70e125750be9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530281.931716:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eae00/0xb28d70e125750be9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530281.931723:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eae00/0xb28d70e125750be9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530281.931761:0:6527:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788530281.931866:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+18:11306:x1875409531622656:12345-192.168.202.41@tcp:35:lhsmtool_posix.0 Request processed in 654us (837us total) trans 4294967364 rc 0/0 00000100:00100000:1.0:1788530281.931874:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 20 00000020:00080000:1.0:1788530281.931879:0:6527:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788530281.931908:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788530281.931927:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eae00/0xb28d70e125750be9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530281.931934:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f012eae00 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:1.0:1788530281.931939:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eae00/0xb28d70e125750be9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530281.931947:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eae00/0xb28d70e125750be9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530281.931960:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9a9e0241da00) 00010000:00010000:1.0:1788530281.931963:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788530281.931969:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eae00/0xb28d70e125750be9 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530281.931975:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eae00/0xb28d70e125750be9 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530281.931989:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530281.931991:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530281.931993:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788530282.321700:0:14224:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788530282.321716:0:14224:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788530282.321743:0:14224:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788530282.321750:0:14224:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788530282.539034:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530282.539153:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531622912 00000100:00100000:3.0:1788530282.539167:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531622912 00000100:00100000:3.0:1788530282.539260:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 94 00000100:00100000:3.0:1788530282.539277:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+18:11317:x1875409531622912:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:3.0:1788530282.539309:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788530282.539338:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e125750bf0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550944 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530282.539487:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030400/0xb28d70e125750bf7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530282.539508:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030400/0xb28d70e125750bf7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530282.539524:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030400/0xb28d70e125750bf7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788530282.539555:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1788530282.540249:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e125750bf0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550944 expref: 21 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530282.540272:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030400/0xb28d70e125750bf7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550944 expref: 20 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530282.540283:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a9e0241d100) 00010000:00010000:3.0:1788530282.540286:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788530282.540290:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f00030400, rc 0) 00000100:00100000:3.0:1788530282.540370:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+20:11317:x1875409531622912:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 1099us (1350us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1788530282.540380:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 94 00000100:00080000:0.0:1788530282.540941:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788530282.566375:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530282.566453:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531623040 00000100:00100000:3.0:1788530282.566465:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531623040 00000100:00100000:3.0:1788530282.566556:0:10719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 95 00000100:00100000:3.0:1788530282.566597:0:10719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03e88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+20:11317:x1875409531623040:12345-192.168.202.41@tcp:34:lfs.0 00010000:00010000:3.0:1788530282.567088:0:10719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e125750c05 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530282.567108:0:10719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e125750c05 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530282.567122:0:10719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e125750c05 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530282.567140:0:10719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030000/0xb28d70e125750c0c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530282.567164:0:10719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030000/0xb28d70e125750c0c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530282.567171:0:10719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030000/0xb28d70e125750c0c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530282.567269:0:10719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e125750c13 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530282.567277:0:10719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e125750c13 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530282.567284:0:10719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e125750c13 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788530282.567341:0:10719:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e125750c13 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530282.567355:0:10719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e125750c05 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530282.567362:0:10719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e125750c05 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530282.567369:0:10719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e125750c05 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530282.567376:0:10719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f00031800 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:3.0:1788530282.567381:0:10719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e125750c05 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530282.567390:0:10719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e125750c05 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530282.567411:0:10719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a9e0241d100) 00010000:00010000:3.0:1788530282.567414:0:10719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788530282.567420:0:10719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e125750c05 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530282.567428:0:10719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e125750c05 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530282.567446:0:10719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030000/0xb28d70e125750c0c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530282.567452:0:10719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030000/0xb28d70e125750c0c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530282.567458:0:10719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030000/0xb28d70e125750c0c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530282.567463:0:10719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f00030000 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:3.0:1788530282.567466:0:10719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030000/0xb28d70e125750c0c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530282.567472:0:10719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030000/0xb28d70e125750c0c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530282.567480:0:10719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9a9f0cf59500) 00010000:00010000:3.0:1788530282.567482:0:10719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788530282.567486:0:10719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030000/0xb28d70e125750c0c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530282.567492:0:10719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030000/0xb28d70e125750c0c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530282.567521:0:10719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e125750c13 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530282.567527:0:10719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e125750c13 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530282.567532:0:10719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e125750c13 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530282.567537:0:10719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f00031e00 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:3.0:1788530282.567540:0:10719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e125750c13 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530282.567546:0:10719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e125750c13 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530282.567553:0:10719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a9f0cf59900) 00010000:00010000:3.0:1788530282.567555:0:10719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788530282.567557:0:10719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e125750c13 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530282.568187:0:10719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e125750c13 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530282.572994:0:10719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03e88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+20:11317:x1875409531623040:12345-192.168.202.41@tcp:34:lfs.0 Request processed in 6383us (6614us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530282.573024:0:10719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 95 00000100:00100000:3.0:1788530282.644167:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530282.644288:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531623296 00000100:00100000:2.0:1788530282.644301:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531623296 00000100:00100000:2.0:1788530282.644419:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 96 00000100:00100000:2.0:1788530282.644433:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+20:11320:x1875409531623296:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:2.0:1788530282.644460:0:10720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530282.644487:0:10720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c800/0xb28d70e125750c1a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a55094b expref: -99 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530282.644577:0:10720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d200/0xb28d70e125750c21 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530282.644594:0:10720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d200/0xb28d70e125750c21 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530282.644607:0:10720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d200/0xb28d70e125750c21 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530282.644623:0:10720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20cc00/0xb28d70e125750c28 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530282.644641:0:10720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20cc00/0xb28d70e125750c28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530282.644649:0:10720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20cc00/0xb28d70e125750c28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530282.644849:0:10720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ca00/0xb28d70e125750c2f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530282.644868:0:10720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ca00/0xb28d70e125750c2f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530282.644876:0:10720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ca00/0xb28d70e125750c2f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788530282.644887:0:10720:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:2.0:1788530282.644985:0:10720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d200/0xb28d70e125750c21 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530282.644992:0:10720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d200/0xb28d70e125750c21 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530282.645000:0:10720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d200/0xb28d70e125750c21 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530282.645007:0:10720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d20d200 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:2.0:1788530282.645012:0:10720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d200/0xb28d70e125750c21 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530282.645022:0:10720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d200/0xb28d70e125750c21 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530282.645036:0:10720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a9e0241d100) 00010000:00010000:2.0:1788530282.645039:0:10720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788530282.645044:0:10720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d200/0xb28d70e125750c21 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530282.645050:0:10720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d200/0xb28d70e125750c21 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530282.645062:0:10720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20cc00/0xb28d70e125750c28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530282.645072:0:10720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20cc00/0xb28d70e125750c28 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530282.645078:0:10720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20cc00/0xb28d70e125750c28 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530282.645083:0:10720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d20cc00 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:2.0:1788530282.645086:0:10720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20cc00/0xb28d70e125750c28 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530282.645092:0:10720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20cc00/0xb28d70e125750c28 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530282.645099:0:10720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9a9f2b996c00) 00010000:00010000:2.0:1788530282.645101:0:10720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788530282.645115:0:10720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20cc00/0xb28d70e125750c28 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530282.645121:0:10720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20cc00/0xb28d70e125750c28 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530282.645157:0:10720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c800/0xb28d70e125750c1a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a55094b expref: 23 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530282.645170:0:10720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ca00/0xb28d70e125750c2f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a55094b expref: 22 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530282.645177:0:10720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a9f2b996a00) 00010000:00010000:2.0:1788530282.645180:0:10720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788530282.645188:0:10720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d20ca00, rc 0) 00000100:00100000:2.0:1788530282.645251:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+22:11320:x1875409531623296:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 821us (1094us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1788530282.645258:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 96 00000100:00100000:3.0:1788530282.656787:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530282.656822:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531623424 00000100:00100000:3.0:1788530282.656832:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531623424 00000100:00100000:3.0:1788530282.656958:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 97 00000100:00100000:3.0:1788530282.656969:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+22:11320:x1875409531623424:12345-192.168.202.41@tcp:54:lfs.0 00010000:00010000:3.0:1788530282.657057:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e125750c3d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530282.657077:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e125750c3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530282.657090:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e125750c3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530282.657126:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e125750c3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530282.657133:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e125750c3d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530282.657139:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e125750c3d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530282.657145:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f00031e00 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:3.0:1788530282.657149:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e125750c3d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530282.657156:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e125750c3d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530282.657168:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a9f2b996a00) 00010000:00010000:3.0:1788530282.657171:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788530282.657190:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e125750c3d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530282.657196:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e125750c3d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530282.657277:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+22:11320:x1875409531623424:12345-192.168.202.41@tcp:54:lfs.0 Request processed in 310us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530282.657285:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 97 00000100:00100000:3.0:1788530282.661605:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530282.661647:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531623680 00000100:00100000:3.0:1788530282.661657:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531623680 00000100:00100000:3.0:1788530282.662092:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 21 00000100:00100000:3.0:1788530282.662106:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3959c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+22:11320:x1875409531623680:12345-192.168.202.41@tcp:35:lfs.0 00000100:00100000:3.0:1788530282.662445:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3959c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+23:11320:x1875409531623680:12345-192.168.202.41@tcp:35:lfs.0 Request processed in 342us (852us total) trans 4294967367 rc 0/0 00000100:00100000:3.0:1788530282.662454:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 21 00010000:00010000:0.0:1788530282.688870:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788530282.701757:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530282.702164:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531623936 00000100:00100000:2.0:1788530282.702178:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531623936 00000100:00100000:2.0:1788530282.702275:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 98 00000100:00100000:2.0:1788530282.702288:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f05f47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+23:10844:x1875409531623936:12345-192.168.202.41@tcp:101:bash.0 00010000:00010000:2.0:1788530282.702325:0:8678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530282.702350:0:8678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c800/0xb28d70e125750c44 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550952 expref: -99 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530282.702480:0:8678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20cc00/0xb28d70e125750c4b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530282.702499:0:8678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ca00/0xb28d70e125750c2f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a55094b expref: 24 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530282.702509:0:8678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20cc00/0xb28d70e125750c4b lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530282.702543:0:8678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ca00/0xb28d70e125750c2f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a55094b expref: 24 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530282.702556:0:8678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ca00/0xb28d70e125750c2f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a55094b expref: 24 pid: 10720 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530282.702602:0:8678:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03e88000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8678:1875409555837696:192.168.202.41@tcp:104: 00000100:00100000:2.0:1788530282.702753:0:8678:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f33e240c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788530282.704751:0:8678:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03e88000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8678:1875409555837696:192.168.202.41@tcp:104: 00010000:00010000:2.0:1788530282.704785:0:8678:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20cc00/0xb28d70e125750c4b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530282.707041:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530282.707281:0:10347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531624064 00000100:00100000:0.0:1788530282.707295:0:10347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531624064 00010000:00010000:0.0:1788530282.707365:0:10347:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ca00/0xb28d70e125750c2f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a55094b expref: 25 pid: 10720 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530282.707409:0:10347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 74 00000100:00100000:0.0:1788530282.707421:0:10347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f05f45500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+25:2399:x1875409531624064:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788530282.707439:0:10347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788530282.707446:0:10347:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ca00/0xb28d70e125750c2f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a55094b expref: 25 pid: 10720 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530282.707462:0:10347:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ca00/0xb28d70e125750c2f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a55094b expref: 25 pid: 10720 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530282.707488:0:10347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ca00/0xb28d70e125750c2f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a55094b expref: 25 pid: 10720 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530282.707508:0:10347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a9f2b996a00) 00010000:00010000:0.0:1788530282.707514:0:10347:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20cc00/0xb28d70e125750c4b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530282.707525:0:10347:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20cc00/0xb28d70e125750c4b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530282.707533:0:10347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20cc00/0xb28d70e125750c4b lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530282.707607:0:10347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788530282.707670:0:10347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f05f45500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+24:2399:x1875409531624064:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 251us (639us total) trans 0 rc 0/0 00010000:00010000:1.0:1788530282.707749:0:8678:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20cc00/0xb28d70e125750c4b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530282.707756:0:10347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 74 00010000:00010000:1.0:1788530282.707767:0:8678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20cc00/0xb28d70e125750c4b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788530282.707788:0:8678:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:1.0:1788530282.707936:0:8678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c800/0xb28d70e125750c44 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550952 expref: 25 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530282.707952:0:8678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20cc00/0xb28d70e125750c4b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550952 expref: 24 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530282.707960:0:8678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a9f2b996a00) 00010000:00010000:1.0:1788530282.707963:0:8678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788530282.707965:0:8678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d20cc00, rc 0) 00000100:00100000:1.0:1788530282.707992:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f05f47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+24:10844:x1875409531623936:12345-192.168.202.41@tcp:101:bash.0 Request processed in 5708us (6252us total) trans 4294967368 rc 0/0 00000100:00100000:1.0:1788530282.708000:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 98 00000100:00100000:3.0:1788530282.712788:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530282.713080:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531624192 00000100:00100000:1.0:1788530282.713092:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531624192 00000100:00100000:1.0:1788530282.713178:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 99 00000100:00100000:1.0:1788530282.713189:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+24:10844:x1875409531624192:12345-192.168.202.41@tcp:101:bash.0 00010000:00010000:1.0:1788530282.713214:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530282.713235:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb200/0xb28d70e125750c59 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550959 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530282.713271:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e125750c60 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530282.713303:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e125750c60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530282.713315:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e125750c60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530282.713438:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb200/0xb28d70e125750c59 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550959 expref: 26 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530282.713451:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e125750c60 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550959 expref: 25 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530282.713458:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a9f2b996a00) 00010000:00010000:1.0:1788530282.713460:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788530282.713462:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f012eac00, rc 0) 00000100:00100000:1.0:1788530282.713513:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+25:10844:x1875409531624192:12345-192.168.202.41@tcp:101:bash.0 Request processed in 325us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530282.713519:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 99 00000100:00100000:3.0:1788530282.716500:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530282.716619:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531624448 00000100:00100000:1.0:1788530282.716632:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531624448 00000100:00100000:1.0:1788530282.716722:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 100 00000100:00100000:1.0:1788530282.716739:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+25:10844:x1875409531624448:12345-192.168.202.41@tcp:36:bash.0 00010000:00010000:1.0:1788530282.716976:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea200/0xb28d70e125750c67 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530282.716993:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea200/0xb28d70e125750c67 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530282.717021:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea200/0xb28d70e125750c67 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788530282.717070:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:1.0:1788530282.717093:0:6523:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f694159b reply state 0000000016a97b88 transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea200/0xb28d70e125750c67 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530282.717105:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea200/0xb28d70e125750c67 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530282.717112:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a9f2b996a00) 00010000:00010000:1.0:1788530282.717115:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788530282.717118:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1788530282.717154:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:1.0:1788530282.718344:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+29:10844:x1875409531624448:12345-192.168.202.41@tcp:36:bash.0 Request processed in 1603us (1849us total) trans 4294967371 rc 0/0 00000100:00100000:1.0:1788530282.720318:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 100 00000020:00080000:1.0:1788530282.720330:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1788530282.721116:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530282.721192:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531624576 00000100:00100000:1.0:1788530282.721204:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531624576 00000100:00100000:1.0:1788530282.721276:0:10719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 101 00000100:00100000:1.0:1788530282.721287:0:10719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+29:10844:x1875409531624576:12345-192.168.202.41@tcp:101:bash.0 00010000:00010000:1.0:1788530282.721311:0:10719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530282.721332:0:10719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ebe00/0xb28d70e125750c6e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550960 expref: -99 pid: 10719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530282.721391:0:10719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ebe00/0xb28d70e125750c6e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550960 expref: 30 pid: 10719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530282.721435:0:10719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ebe00/0xb28d70e125750c6e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550960 expref: 30 pid: 10719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530282.721461:0:10719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a9f2b996a00) 00010000:00010000:1.0:1788530282.721465:0:10719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788530282.721469:0:10719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f012ebe00, rc 0) 00000100:00100000:1.0:1788530282.721610:0:10719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+30:10844:x1875409531624576:12345-192.168.202.41@tcp:101:bash.0 Request processed in 324us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530282.721617:0:10719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 101 00000100:00100000:3.0:1788530282.724402:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530282.724510:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531624704 00000100:00100000:0.0:1788530282.724521:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531624704 00000100:00100000:0.0:1788530282.724855:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 41 00000100:00100000:0.0:1788530282.724867:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:10844:x1875409531624704:12345-192.168.202.41@tcp:101:bash.0 00010000:00010000:0.0:1788530282.724884:0:8752:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530282.724915:0:8752:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d8c35e1e/0xb28d70e125750c75 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550967 expref: -99 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788530282.724940:0:8752:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a9ace67, atime: 0x6a9ace65, ctime: 0x6a9ace67, blocks: 0x8 00010000:00010000:0.0:1788530282.724962:0:8752:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=490s v=(0 0) 00010000:00010000:0.0:1788530282.724967:0:8752:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788530282.724975:0:8752:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8c35e1e/0xb28d70e125750c75 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550967 expref: 7 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530282.724996:0:8752:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d8c35e1e/0xb28d70e125750c75 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550967 expref: 7 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530282.725010:0:8752:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d101600, rc 0) 00000100:00100000:0.0:1788530282.725083:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+7:10844:x1875409531624704:12345-192.168.202.41@tcp:101:bash.0 Request processed in 218us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530282.725090:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 41 00000100:00100000:3.0:1788530282.727493:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530282.727613:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531624832 00000100:00100000:1.0:1788530282.727622:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531624832 00002000:00010000:1.0:1788530282.727676:0:8442:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:1.0:1788530282.727689:0:8442:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a9f3d2b9c00 with x1875409531624832 ext(0->18446744073709551615) 00002000:00010000:1.0:1788530282.727701:0:8442:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a9f3d2b9c00. 00000100:00100000:1.0:1788530282.727735:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 1 00000100:00100000:1.0:1788530282.727745:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+7:2402:x1875409531624832:12345-192.168.202.41@tcp:10:bash.0 00002000:00010000:1.0:1788530282.728102:0:8442:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1788530282.728107:0:8442:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1788530279 -> 1788530282 00002000:00010000:1.0:1788530282.728109:0:8442:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 1788530277 -> 1788530277 00002000:00010000:1.0:1788530282.728112:0:8442:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1788530279 -> 1788530282 00002000:00010000:1.0:1788530282.728114:0:8442:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:1.0:1788530282.728186:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+8:2402:x1875409531624832:12345-192.168.202.41@tcp:10:bash.0 Request processed in 440us (703us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1788530282.728195:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 1 00002000:00010000:1.0:1788530282.728200:0:8442:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:1.0:1788530282.728214:0:8442:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a9f3d2b9c00 with x1875409531624832 ext(0->18446744073709551615) 00002000:00010000:1.0:1788530282.728222:0:8442:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a9f3d2b9c00. 00000100:00100000:3.0:1788530282.809073:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530282.809336:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531624960 00000100:00100000:2.0:1788530282.809346:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531624960 00000100:00100000:2.0:1788530282.809416:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 102 00000100:00100000:2.0:1788530282.809426:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+30:11334:x1875409531624960:12345-192.168.202.41@tcp:34:lfs.0 00010000:00010000:2.0:1788530282.809499:0:10720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d200/0xb28d70e125750c7c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530282.809518:0:10720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d200/0xb28d70e125750c7c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530282.809530:0:10720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d200/0xb28d70e125750c7c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530282.809546:0:10720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e125750c83 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530282.809553:0:10720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e125750c83 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530282.809591:0:10720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e125750c83 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530282.809673:0:10720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ce00/0xb28d70e125750c8a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530282.809690:0:10720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ce00/0xb28d70e125750c8a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530282.809713:0:10720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ce00/0xb28d70e125750c8a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788530282.809762:0:10720:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ce00/0xb28d70e125750c8a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530282.809773:0:10720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d200/0xb28d70e125750c7c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530282.809779:0:10720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d200/0xb28d70e125750c7c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530282.809786:0:10720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d200/0xb28d70e125750c7c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530282.809792:0:10720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d20d200 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:2.0:1788530282.809797:0:10720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d200/0xb28d70e125750c7c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530282.809803:0:10720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d200/0xb28d70e125750c7c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530282.809815:0:10720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a9e0241d100) 00010000:00010000:2.0:1788530282.809818:0:10720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788530282.809822:0:10720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d200/0xb28d70e125750c7c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530282.809827:0:10720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d200/0xb28d70e125750c7c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530282.809839:0:10720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e125750c83 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530282.809850:0:10720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e125750c83 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530282.809856:0:10720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e125750c83 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530282.809861:0:10720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d20c000 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:2.0:1788530282.809864:0:10720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e125750c83 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530282.809870:0:10720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e125750c83 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530282.809878:0:10720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9a9f2b996c00) 00010000:00010000:2.0:1788530282.809880:0:10720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788530282.809883:0:10720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e125750c83 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530282.809889:0:10720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e125750c83 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530282.809904:0:10720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ce00/0xb28d70e125750c8a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530282.809919:0:10720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ce00/0xb28d70e125750c8a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530282.809925:0:10720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ce00/0xb28d70e125750c8a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530282.809929:0:10720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d20ce00 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:2.0:1788530282.809938:0:10720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ce00/0xb28d70e125750c8a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530282.809944:0:10720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ce00/0xb28d70e125750c8a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530282.809952:0:10720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a9f2b996a00) 00010000:00010000:2.0:1788530282.809954:0:10720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788530282.809957:0:10720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ce00/0xb28d70e125750c8a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530282.809963:0:10720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ce00/0xb28d70e125750c8a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530282.810050:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+30:11334:x1875409531624960:12345-192.168.202.41@tcp:34:lfs.0 Request processed in 624us (986us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530282.810058:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 102 00000100:00100000:3.0:1788530282.860480:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530282.860914:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531625216 00000100:00100000:2.0:1788530282.860928:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531625216 00000100:00100000:2.0:1788530282.861081:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 103 00000100:00100000:2.0:1788530282.861093:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03edf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+30:11337:x1875409531625216:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:2.0:1788530282.861116:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530282.861141:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ce00/0xb28d70e125750c91 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a55096e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530282.861246:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e125750c98 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530282.861264:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e125750c98 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530282.861288:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e125750c98 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530282.861303:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d200/0xb28d70e125750c9f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530282.861310:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d200/0xb28d70e125750c9f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530282.861317:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d200/0xb28d70e125750c9f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530282.861452:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d800/0xb28d70e125750ca6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530282.861462:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d800/0xb28d70e125750ca6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530282.861469:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d800/0xb28d70e125750ca6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788530282.861481:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788530282.861896:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e125750c98 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530282.861915:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e125750c98 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530282.861923:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e125750c98 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530282.861928:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d20c000 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:2.0:1788530282.861940:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e125750c98 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530282.861949:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e125750c98 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530282.861962:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a9e0241d100) 00010000:00010000:2.0:1788530282.861965:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788530282.861971:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e125750c98 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530282.861978:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e125750c98 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530282.861994:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d200/0xb28d70e125750c9f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530282.862000:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d200/0xb28d70e125750c9f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530282.862016:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d200/0xb28d70e125750c9f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530282.862022:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d20d200 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:2.0:1788530282.862025:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d200/0xb28d70e125750c9f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530282.862031:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d200/0xb28d70e125750c9f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530282.862038:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9a9f2b996c00) 00010000:00010000:2.0:1788530282.862040:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788530282.862051:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d200/0xb28d70e125750c9f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530282.862057:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d200/0xb28d70e125750c9f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530282.862102:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ce00/0xb28d70e125750c91 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a55096e expref: 33 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530282.862118:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d800/0xb28d70e125750ca6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a55096e expref: 32 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530282.862125:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a9f2b996a00) 00010000:00010000:2.0:1788530282.862128:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788530282.862131:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d20d800, rc 0) 00000100:00100000:2.0:1788530282.862235:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03edf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+32:11337:x1875409531625216:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 1143us (1768us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1788530282.862243:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 103 00000100:00100000:3.0:1788530282.868016:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530282.868419:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531625344 00000100:00100000:1.0:1788530282.868428:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531625344 00000100:00100000:1.0:1788530282.868519:0:10719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 104 00000100:00100000:1.0:1788530282.868531:0:10719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03edfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+32:11337:x1875409531625344:12345-192.168.202.41@tcp:54:lfs.0 00010000:00010000:1.0:1788530282.868648:0:10719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb200/0xb28d70e125750cb4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530282.868666:0:10719:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20cc00/0xb28d70e125750c4b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550952 expref: 32 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530282.868676:0:10719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb200/0xb28d70e125750cb4 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530282.868809:0:10719:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20cc00/0xb28d70e125750c4b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550952 expref: 32 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530282.868826:0:10719:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20cc00/0xb28d70e125750c4b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550952 expref: 32 pid: 8678 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530282.868839:0:10719:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03ee0700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10719:1875409555837824:192.168.202.41@tcp:104: 00000100:00100000:1.0:1788530282.868952:0:10719:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e0247ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1788530282.873071:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530282.873283:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531625600 00000100:00100000:0.0:1788530282.873295:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531625600 00000100:00100000:0.0:1788530282.873367:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 22 00000100:00100000:0.0:1788530282.873380:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03edd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+33:6176:x1875409531625600:12345-192.168.202.41@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788530282.873924:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03edd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+34:6176:x1875409531625600:12345-192.168.202.41@tcp:35:ldlm_bl.0 Request processed in 544us (865us total) trans 4294967373 rc 0/0 00000100:00100000:0.0:1788530282.873950:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 22 00000100:00100000:1.0:1788530282.874108:0:10719:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03ee0700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10719:1875409555837824:192.168.202.41@tcp:104: 00010000:00010000:1.0:1788530282.874137:0:10719:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb200/0xb28d70e125750cb4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530282.883474:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530282.883615:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531625728 00000100:00100000:2.0:1788530282.883627:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531625728 00010000:00010000:2.0:1788530282.883696:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20cc00/0xb28d70e125750c4b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550952 expref: 34 pid: 8678 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530282.883745:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 75 00000100:00100000:2.0:1788530282.883758:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c58a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+34:2399:x1875409531625728:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788530282.883775:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788530282.883782:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20cc00/0xb28d70e125750c4b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550952 expref: 34 pid: 8678 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530282.883817:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20cc00/0xb28d70e125750c4b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550952 expref: 34 pid: 8678 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530282.883841:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20cc00/0xb28d70e125750c4b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550952 expref: 34 pid: 8678 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530282.883858:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a9f2b996a00) 00010000:00010000:2.0:1788530282.883864:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb200/0xb28d70e125750cb4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530282.883874:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb200/0xb28d70e125750cb4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530282.883883:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb200/0xb28d70e125750cb4 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530282.883922:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788530282.884011:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c58a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+33:2399:x1875409531625728:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 256us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530282.884020:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 75 00010000:00010000:1.0:1788530282.884288:0:10719:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb200/0xb28d70e125750cb4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530282.884304:0:10719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb200/0xb28d70e125750cb4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530282.884354:0:10719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb200/0xb28d70e125750cb4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530282.884364:0:10719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb200/0xb28d70e125750cb4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530282.884372:0:10719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb200/0xb28d70e125750cb4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530282.884379:0:10719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f012eb200 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:1.0:1788530282.884385:0:10719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb200/0xb28d70e125750cb4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530282.884395:0:10719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb200/0xb28d70e125750cb4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530282.884407:0:10719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a9f2b996a00) 00010000:00010000:1.0:1788530282.884411:0:10719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788530282.884415:0:10719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb200/0xb28d70e125750cb4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530282.884421:0:10719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb200/0xb28d70e125750cb4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530282.884476:0:10719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03edfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+32:11337:x1875409531625344:12345-192.168.202.41@tcp:54:lfs.0 Request processed in 15946us (16469us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530282.884484:0:10719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 104 00000100:00100000:3.0:1788530282.893874:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530282.894843:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531625984 00000100:00100000:0.0:1788530282.894856:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531625984 00000100:00100000:0.0:1788530282.894932:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 23 00000100:00100000:0.0:1788530282.894945:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03ede680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+32:11337:x1875409531625984:12345-192.168.202.41@tcp:35:lfs.0 00000100:00100000:0.0:1788530282.895277:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03ede680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+33:11337:x1875409531625984:12345-192.168.202.41@tcp:35:lfs.0 Request processed in 333us (1411us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1788530282.895285:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 23 00000100:00100000:0.0:1788530282.989018:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530282.989073:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530282.989341:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531626112 00000100:00100000:3.0:1788530282.989354:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531626112 00002000:00100000:3.0:1788530282.989420:0:8443:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x3:0x0] (0->7) req@ffff9a9e03c5a300 x1875409531626112/t0(0) o4->aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41@192.168.202.41@tcp:223/0 lens 496/0 e 0 to 0 dl 1788530293 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788530282.989448:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a9e03c5a300 with x1875409531626112 ext(0->7) 00002000:00010000:3.0:1788530282.989456:0:8443:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a9e03c5a300 00000100:00100000:3.0:1788530282.989499:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 2 00000100:00100000:3.0:1788530282.989509:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+8:2400:x1875409531626112:12345-192.168.202.41@tcp:4:bash.0 00000100:00100000:1.0:1788530282.990279:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531626240 00000100:00100000:1.0:1788530282.990287:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531626240 00000100:00100000:1.0:1788530282.990337:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 42 00000100:00100000:1.0:1788530282.990346:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+11:2400:x1875409531626240:12345-192.168.202.41@tcp:16:kworker.0 00000100:00100000:3.0:1788530282.992084:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+11:2400:x1875409531626112:12345-192.168.202.41@tcp:4:bash.0 Request processed in 2566us (3068us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1788530282.992097:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 2 00002000:00100000:3.0:1788530282.992109:0:8443:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x3:0x0] (0->7) req@ffff9a9e03c5a300 x1875409531626112/t4294967308(0) o4->aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41@192.168.202.41@tcp:223/0 lens 496/448 e 0 to 0 dl 1788530293 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788530282.992120:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a9e03c5a300 with x1875409531626112 ext(0->7) 00002000:00010000:3.0:1788530282.992125:0:8443:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a9e03c5a300 00000001:00080000:3.0:1788530282.995099:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:3.0:1788530282.995125:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000100:00100000:1.0:1788530283.006255:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:2400:x1875409531626240:12345-192.168.202.41@tcp:16:kworker.0 Request processed in 15900us (17170us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530283.006268:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 42 00000100:00100000:0.0:1788530283.036438:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530283.036518:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531626496 00000100:00100000:2.0:1788530283.036529:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531626496 00000100:00100000:2.0:1788530283.037408:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 105 00000100:00100000:2.0:1788530283.037422:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+33:11348:x1875409531626496:12345-192.168.202.41@tcp:101:cat.0 00010000:00010000:2.0:1788530283.037450:0:10720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530283.037472:0:10720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20cc00/0xb28d70e125750cbb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550975 expref: -99 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530283.037598:0:10720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ce00/0xb28d70e125750cc2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530283.037869:0:10720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ce00/0xb28d70e125750cc2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530283.037884:0:10720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ce00/0xb28d70e125750cc2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530283.037935:0:10720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d200/0xb28d70e125750cc9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530283.037944:0:10720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d200/0xb28d70e125750cc9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530283.037952:0:10720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d200/0xb28d70e125750cc9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530283.038164:0:10720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e125750cd0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530283.038237:0:10720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e125750cd0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530283.038246:0:10720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e125750cd0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788530283.038258:0:10720:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:2.0:1788530283.038376:0:10720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ce00/0xb28d70e125750cc2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530283.038399:0:10720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ce00/0xb28d70e125750cc2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530283.038408:0:10720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ce00/0xb28d70e125750cc2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530283.038415:0:10720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d20ce00 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:2.0:1788530283.038421:0:10720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ce00/0xb28d70e125750cc2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530283.038430:0:10720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ce00/0xb28d70e125750cc2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530283.038444:0:10720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a9e0241d100) 00010000:00010000:2.0:1788530283.038447:0:10720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788530283.038452:0:10720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ce00/0xb28d70e125750cc2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530283.038459:0:10720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ce00/0xb28d70e125750cc2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530283.038476:0:10720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d200/0xb28d70e125750cc9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530283.038484:0:10720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d200/0xb28d70e125750cc9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530283.038490:0:10720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d200/0xb28d70e125750cc9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530283.038494:0:10720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d20d200 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:2.0:1788530283.038504:0:10720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d200/0xb28d70e125750cc9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530283.038512:0:10720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d200/0xb28d70e125750cc9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530283.038521:0:10720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9a9f2b996c00) 00010000:00010000:2.0:1788530283.038524:0:10720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788530283.038527:0:10720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d200/0xb28d70e125750cc9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530283.038533:0:10720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d200/0xb28d70e125750cc9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530283.038878:0:10720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20cc00/0xb28d70e125750cbb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550975 expref: 36 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530283.038896:0:10720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e125750cd0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550975 expref: 35 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530283.038915:0:10720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a9f2b996a00) 00010000:00010000:2.0:1788530283.038918:0:10720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788530283.038921:0:10720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d20c000, rc 0) 00000100:00100000:2.0:1788530283.039082:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+35:11348:x1875409531626496:12345-192.168.202.41@tcp:101:cat.0 Request processed in 1663us (2657us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1788530283.039091:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 105 00000100:00100000:0.0:1788530283.044626:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530283.044700:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531626752 00000100:00100000:3.0:1788530283.044713:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531626752 00000100:00100000:3.0:1788530283.044780:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 24 00000100:00100000:3.0:1788530283.044793:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+35:11348:x1875409531626752:12345-192.168.202.41@tcp:35:cat.0 00000100:00100000:3.0:1788530283.045120:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+36:11348:x1875409531626752:12345-192.168.202.41@tcp:35:cat.0 Request processed in 329us (505us total) trans 4294967376 rc 0/0 00000100:00100000:3.0:1788530283.045128:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 24 00000100:00100000:0.0:1788530283.072394:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530283.072469:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531627008 00000100:00100000:1.0:1788530283.072481:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531627008 00000100:00100000:1.0:1788530283.072687:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 106 00000100:00100000:1.0:1788530283.072704:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+36:11349:x1875409531627008:12345-192.168.202.41@tcp:36:rm.0 00010000:00010000:1.0:1788530283.072763:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1788530283.072794:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ebe00/0xb28d70e125750c6e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550960 expref: 36 pid: 10719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530283.072818:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e125750cd0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550975 expref: 35 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530283.072829:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d800/0xb28d70e125750ca6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a55096e expref: 34 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530283.072841:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e125750c60 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550959 expref: 33 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530283.072851:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a9f2b996a00) 00010000:00010000:1.0:1788530283.072856:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788530283.072880:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eba00/0xb28d70e125750cde lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530283.072918:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eba00/0xb28d70e125750cde lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530283.072930:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eba00/0xb28d70e125750cde lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530283.072950:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea400/0xb28d70e125750ce5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530283.072956:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea400/0xb28d70e125750ce5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530283.072961:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea400/0xb28d70e125750ce5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530283.073072:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eaa00/0xb28d70e125750cec lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530283.073080:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eaa00/0xb28d70e125750cec lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530283.073088:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eaa00/0xb28d70e125750cec lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788530283.073366:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:1.0:1788530283.073393:0:6523:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 490975831857ns, next at 491975828274ns, rc = 0 00010000:00010000:1.0:1788530283.073449:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb200/0xb28d70e125750cf3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530283.073458:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb200/0xb28d70e125750cf3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530283.073477:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb200/0xb28d70e125750cf3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530283.073485:0:6523:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb200/0xb28d70e125750cf3 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530283.073492:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb200/0xb28d70e125750cf3 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530283.073497:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb200/0xb28d70e125750cf3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530283.073515:0:6523:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788530283.073535:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eaa00/0xb28d70e125750cec lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530283.073542:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eaa00/0xb28d70e125750cec lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530283.073549:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eaa00/0xb28d70e125750cec lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530283.073555:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f012eaa00 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:1.0:1788530283.073577:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eaa00/0xb28d70e125750cec lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530283.073586:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eaa00/0xb28d70e125750cec lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530283.073595:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a9f2b996a00) 00010000:00010000:1.0:1788530283.073598:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788530283.073609:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eaa00/0xb28d70e125750cec lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530283.073615:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eaa00/0xb28d70e125750cec lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530283.073632:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eba00/0xb28d70e125750cde lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530283.073638:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eba00/0xb28d70e125750cde lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530283.073643:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eba00/0xb28d70e125750cde lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530283.073648:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f012eba00 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:1.0:1788530283.073651:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eba00/0xb28d70e125750cde lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530283.073657:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eba00/0xb28d70e125750cde lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530283.073664:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a9e0241d100) 00010000:00010000:1.0:1788530283.073667:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788530283.073669:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eba00/0xb28d70e125750cde lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530283.073675:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eba00/0xb28d70e125750cde lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788530283.073699:0:6523:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b4597f19 reply state 00000000aeb30146 transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea400/0xb28d70e125750ce5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530283.073721:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea400/0xb28d70e125750ce5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530283.073727:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9a9f32abde00) 00010000:00010000:1.0:1788530283.073729:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788530283.073732:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788530283.073812:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+34:11349:x1875409531627008:12345-192.168.202.41@tcp:36:rm.0 Request processed in 1112us (1426us total) trans 4294967377 rc 0/0 00000100:00100000:1.0:1788530283.073821:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 106 00010000:00010000:0.0:1788530283.075381:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788530283.075397:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb200/0xb28d70e125750cf3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530283.075410:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f012eb200 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:0.0:1788530283.075415:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb200/0xb28d70e125750cf3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530283.075425:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb200/0xb28d70e125750cf3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530283.075446:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a9f2b996a00) 00010000:00010000:0.0:1788530283.075449:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788530283.075469:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb200/0xb28d70e125750cf3 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530283.075475:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb200/0xb28d70e125750cf3 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530283.075492:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530283.075495:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530283.075496:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788530283.179029:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530283.179919:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531627264 00000100:00100000:2.0:1788530283.179932:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531627264 00000100:00100000:2.0:1788530283.180510:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 107 00000100:00100000:2.0:1788530283.180524:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03ee0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+34:11355:x1875409531627264:12345-192.168.202.41@tcp:101:bash.0 00010000:00010000:2.0:1788530283.180815:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530283.180837:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20cc00/0xb28d70e125750cfa lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a55097c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530283.181764:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d200/0xb28d70e125750d01 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530283.181797:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d200/0xb28d70e125750d01 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530283.181814:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d200/0xb28d70e125750d01 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530283.181826:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ce00/0xb28d70e125750d08 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530283.181834:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ce00/0xb28d70e125750d08 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530283.181841:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ce00/0xb28d70e125750d08 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788530283.184952:0:6524:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:2.0:1788530283.186488:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d600/0xb28d70e125750d0f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530283.186520:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d600/0xb28d70e125750d0f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530283.186533:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d600/0xb28d70e125750d0f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530283.189130:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d200/0xb28d70e125750d01 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530283.189158:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d200/0xb28d70e125750d01 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530283.189448:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d200/0xb28d70e125750d01 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530283.189456:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d20d200 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:2.0:1788530283.189462:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d200/0xb28d70e125750d01 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530283.189472:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d200/0xb28d70e125750d01 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530283.189498:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a9e0241d100) 00010000:00010000:2.0:1788530283.189502:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788530283.189509:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d200/0xb28d70e125750d01 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530283.189516:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d200/0xb28d70e125750d01 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788530283.189539:0:6524:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007489859f reply state 00000000a2a2c926 transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ce00/0xb28d70e125750d08 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530283.189552:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ce00/0xb28d70e125750d08 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530283.189681:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9a9f32abde00) 00010000:00010000:2.0:1788530283.189701:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788530283.189705:0:6524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788530283.189758:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20cc00/0xb28d70e125750cfa lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a55097c expref: 37 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530283.189775:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d600/0xb28d70e125750d0f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a55097c expref: 36 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530283.189783:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a9f2b996c00) 00010000:00010000:2.0:1788530283.189784:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788530283.189787:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d20d600, rc 0) 00000100:00100000:2.0:1788530283.189882:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03ee0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+37:11355:x1875409531627264:12345-192.168.202.41@tcp:101:bash.0 Request processed in 9361us (10867us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1788530283.189891:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 107 00000100:00100000:1.0:1788530283.195836:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530283.195999:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531627392 00000100:00100000:2.0:1788530283.196010:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531627392 00000100:00100000:2.0:1788530283.196098:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 43 00000100:00100000:2.0:1788530283.196110:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03ee0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+7:2400:x1875409531627392:12345-192.168.202.41@tcp:101:bash.0 00010000:00010000:2.0:1788530283.196128:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530283.196147:0:8438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000947541ff/0xb28d70e125750d1d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550983 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788530283.196183:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788530283.196206:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=491s v=(0 0) 00010000:00010000:2.0:1788530283.196211:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788530283.196222:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000947541ff/0xb28d70e125750d1d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550983 expref: 8 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530283.196277:0:8438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000947541ff/0xb28d70e125750d1d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550983 expref: 8 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530283.196296:0:8438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d20dc00, rc 0) 00000100:00100000:2.0:1788530283.196377:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03ee0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+8:2400:x1875409531627392:12345-192.168.202.41@tcp:101:bash.0 Request processed in 268us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530283.196385:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 43 00000100:00080000:0.0:1788530283.198725:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788530283.204957:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530283.205147:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531627520 00000100:00100000:0.0:1788530283.205160:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531627520 00000100:00100000:0.0:1788530283.205248:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 44 00000100:00100000:0.0:1788530283.205261:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03eded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+8:11355:x1875409531627520:12345-192.168.202.41@tcp:101:bash.0 00010000:00010000:0.0:1788530283.205287:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530283.205309:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004333fe4/0xb28d70e125750d24 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a55098a expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530283.205346:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000947541ff/0xb28d70e125750d1d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550983 expref: 9 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530283.205357:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788530283.205362:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788530283.205369:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004333fe4/0xb28d70e125750d24 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a55098a expref: 9 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530283.205419:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000947541ff/0xb28d70e125750d1d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550983 expref: 9 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530283.205458:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000947541ff/0xb28d70e125750d1d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550983 expref: 9 pid: 8438 timeout: 591 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530283.205477:0:8436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03c59180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1875409555837952:192.168.202.41@tcp:104: 00000100:00100000:0.0:1788530283.205661:0:8436:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f0a96bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788530283.219067:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530283.219892:0:10347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531627648 00000100:00100000:2.0:1788530283.219916:0:10347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531627648 00010000:00010000:2.0:1788530283.219971:0:10347:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000947541ff/0xb28d70e125750d1d lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550983 expref: 10 pid: 8438 timeout: 591 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530283.220030:0:10347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 76 00000100:00100000:2.0:1788530283.220043:0:10347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03ee3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+10:2400:x1875409531627648:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788530283.220068:0:10347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788530283.220109:0:10347:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000947541ff/0xb28d70e125750d1d lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550983 expref: 10 pid: 8438 timeout: 591 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530283.220127:0:10347:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000947541ff/0xb28d70e125750d1d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550983 expref: 10 pid: 8438 timeout: 591 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530283.220161:0:10347:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788530283.220340:0:10347:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788530283.220352:0:10347:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000004333fe4/0xb28d70e125750d24 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a55098a expref: 10 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530283.220383:0:10347:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004333fe4/0xb28d70e125750d24 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a55098a expref: 10 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530283.220438:0:10347:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000004333fe4/0xb28d70e125750d24 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a55098a expref: 10 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530283.220457:0:10347:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03e88000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10347:1875409555838080:192.168.202.41@tcp:105: 00000100:00100000:2.0:1788530283.221161:0:10347:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f33e24f00 going to sleep for 11 seconds 00010000:00010000:0.0:1788530283.221956:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000947541ff/0xb28d70e125750d1d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550983 expref: 10 pid: 8438 timeout: 591 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530283.221986:0:8436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03c59180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1875409555837952:192.168.202.41@tcp:104: 00010000:00010000:0.0:1788530283.222016:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000004333fe4/0xb28d70e125750d24 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.41@tcp remote: 0x2b1406819a55098a expref: 9 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530283.222030:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d100c00, rc 0) 00000100:00100000:0.0:1788530283.222085:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03eded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+9:11355:x1875409531627520:12345-192.168.202.41@tcp:101:bash.0 Request processed in 16826us (17138us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530283.222102:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 44 00000100:00100000:1.0:1788530283.231738:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530283.231829:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531627904 00000100:00100000:3.0:1788530283.231838:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531627904 00000100:00100000:3.0:1788530283.231900:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 25 00000100:00100000:3.0:1788530283.231937:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03ee1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+37:11355:x1875409531627904:12345-192.168.202.41@tcp:35:bash.0 00000100:00100000:3.0:1788530283.232298:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03ee1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+38:11355:x1875409531627904:12345-192.168.202.41@tcp:35:bash.0 Request processed in 363us (575us total) trans 4294967379 rc 0/0 00000100:00100000:3.0:1788530283.232306:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 25 00000100:00100000:2.0:1788530283.233930:0:10347:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03e88000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10347:1875409555838080:192.168.202.41@tcp:105: 00010000:00010000:2.0:1788530283.233962:0:10347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788530283.234061:0:10347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03ee3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+8:2400:x1875409531627648:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 14019us (15011us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530283.234074:0:10347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 76 00000100:00100000:1.0:1788530283.557403:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530283.557640:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531628032 00000100:00100000:0.0:1788530283.557652:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531628032 00000100:00100000:0.0:1788530283.557760:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 108 00000100:00100000:0.0:1788530283.557771:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03ee2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+38:11371:x1875409531628032:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:0.0:1788530283.557806:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530283.557831:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100600/0xb28d70e125750d2b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550991 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530283.557957:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101400/0xb28d70e125750d32 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530283.557975:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101400/0xb28d70e125750d32 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530283.557991:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101400/0xb28d70e125750d32 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788530283.558064:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1788530283.558069:0:6525:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788530283.558103:0:6525:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101400/0xb28d70e125750d32 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530283.558139:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100600/0xb28d70e125750d2b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550991 expref: 40 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530283.558528:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101400/0xb28d70e125750d32 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550991 expref: 39 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530283.558541:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a9e0241d100) 00010000:00010000:0.0:1788530283.558544:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788530283.558549:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d101400, rc 0) 00000100:00100000:0.0:1788530283.558958:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03ee2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+39:11371:x1875409531628032:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 1188us (1579us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530283.558969:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 108 00000100:00100000:1.0:1788530283.571061:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530283.571826:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531628288 00000100:00100000:3.0:1788530283.571842:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531628288 00000100:00100000:3.0:1788530283.571934:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 109 00000100:00100000:3.0:1788530283.571948:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03ee1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+39:11371:x1875409531628288:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:3.0:1788530283.571970:0:8678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788530283.571991:0:8678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e125750d39 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550998 expref: -99 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530283.572117:0:8678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030000/0xb28d70e125750d40 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530283.572139:0:8678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030000/0xb28d70e125750d40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530283.572156:0:8678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030000/0xb28d70e125750d40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788530283.572178:0:8678:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788530283.572354:0:8678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e125750d39 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550998 expref: 42 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530283.572380:0:8678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030000/0xb28d70e125750d40 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550998 expref: 41 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530283.572416:0:8678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a9f2b996c00) 00010000:00010000:3.0:1788530283.572420:0:8678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788530283.572426:0:8678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f00030000, rc 0) 00000100:00100000:3.0:1788530283.572510:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03ee1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+41:11371:x1875409531628288:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 565us (1466us total) trans 4294967380 rc 0/0 00000100:00100000:3.0:1788530283.572517:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 109 00000100:00100000:3.0:1788530283.581640:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530283.582538:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531628544 00000100:00100000:1.0:1788530283.582604:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531628544 00000100:00100000:2.0:1788530283.582812:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 110 00000100:00100000:2.0:1788530283.582828:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03eddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+41:11371:x1875409531628544:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:2.0:1788530283.582861:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530283.582883:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d400/0xb28d70e125750d4e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a55099f expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530283.583043:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c200/0xb28d70e125750d55 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530283.583065:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c200/0xb28d70e125750d55 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530283.583115:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c200/0xb28d70e125750d55 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788530283.583133:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788530283.583304:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d400/0xb28d70e125750d4e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a55099f expref: 44 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530283.583330:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c200/0xb28d70e125750d55 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a55099f expref: 43 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530283.583342:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a9f2b996c00) 00010000:00010000:2.0:1788530283.583346:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788530283.583351:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d20c200, rc 0) 00000100:00100000:2.0:1788530283.583489:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03eddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+43:11371:x1875409531628544:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 665us (1871us total) trans 4294967381 rc 0/0 00000100:00100000:2.0:1788530283.583497:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 110 00000100:00100000:0.0:1788530283.588660:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530283.588991:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531628672 00000100:00100000:2.0:1788530283.589006:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531628672 00000100:00100000:2.0:1788530283.589112:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 4 00000100:00100000:2.0:1788530283.589124:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c59180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+43:2400:x1875409531628672:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788530283.589153:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788530283.589367:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030000/0xb28d70e125750d40 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550998 expref: 43 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530283.589400:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a9f2b996c00) 00010000:00010000:2.0:1788530283.589407:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788530283.589661:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c59180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+42:2400:x1875409531628672:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 539us (1017us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530283.589669:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 4 00000100:00100000:1.0:1788530283.595512:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530283.597416:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531628800 00000100:00100000:2.0:1788530283.597431:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531628800 00000100:00100000:2.0:1788530283.597550:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 45 00000100:00100000:2.0:1788530283.597588:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03ee3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+8:2399:x1875409531628800:12345-192.168.202.41@tcp:1:lfs.0 00010000:00010000:2.0:1788530283.597660:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000870096cb/0xb28d70e125750d63 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530283.597685:0:8438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000004333fe4/0xb28d70e125750d24 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.41@tcp remote: 0x2b1406819a55098a expref: 8 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530283.597695:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788530283.597699:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788530283.597712:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000870096cb/0xb28d70e125750d63 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530283.597758:0:8438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000004333fe4/0xb28d70e125750d24 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.41@tcp remote: 0x2b1406819a55098a expref: 8 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530283.597772:0:8438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000004333fe4/0xb28d70e125750d24 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.41@tcp remote: 0x2b1406819a55098a expref: 8 pid: 8436 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530283.597787:0:8438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03e88000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8438:1875409555838208:192.168.202.41@tcp:104: 00000100:00100000:2.0:1788530283.597888:0:8438:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f33e24780 going to sleep for 11 seconds 00000100:00100000:1.0:1788530283.602597:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530283.602692:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531628928 00000100:00100000:3.0:1788530283.602713:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531628928 00002000:00100000:3.0:1788530283.602773:0:8444:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9a9e03ee1880 x1875409531628928/t0(0) o4->aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41@192.168.202.41@tcp:224/0 lens 504/0 e 0 to 0 dl 1788530294 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788530283.602784:0:8444:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a9e03ee1880 with x1875409531628928 ext(0->8) 00010000:00010000:3.0:1788530283.602793:0:8444:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000004333fe4/0xb28d70e125750d24 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.41@tcp remote: 0x2b1406819a55098a expref: 9 pid: 8436 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530283.602809:0:8444:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000004333fe4/0xb28d70e125750d24 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.41@tcp remote: 0x2b1406819a55098a expref: 9 pid: 8436 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788530283.602817:0:8444:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9a9e03ee1880 00000100:00100000:3.0:1788530283.602852:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 1 00000100:00100000:3.0:1788530283.602863:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03ee1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+9:2399:x1875409531628928:12345-192.168.202.41@tcp:4:lfs.0 00000100:00100000:1.0:1788530283.605106:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03ee1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+11:2399:x1875409531628928:12345-192.168.202.41@tcp:4:lfs.0 Request processed in 2224us (2528us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1788530283.605123:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 1 00002000:00100000:1.0:1788530283.605142:0:8444:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9a9e03ee1880 x1875409531628928/t4294967303(0) o4->aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41@192.168.202.41@tcp:224/0 lens 504/448 e 0 to 0 dl 1788530294 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788530283.605154:0:8444:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a9e03ee1880 with x1875409531628928 ext(0->8) 00010000:00010000:1.0:1788530283.605174:0:8444:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000004333fe4/0xb28d70e125750d24 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.41@tcp remote: 0x2b1406819a55098a expref: 11 pid: 8436 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530283.605213:0:8444:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000004333fe4/0xb28d70e125750d24 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.41@tcp remote: 0x2b1406819a55098a expref: 11 pid: 8436 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788530283.605222:0:8444:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9a9e03ee1880 00000001:00080000:1.0:1788530283.606273:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:1.0:1788530283.606289:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:3.0:1788530283.610036:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530283.611177:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531629056 00000100:00100000:1.0:1788530283.611204:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531629056 00010000:00010000:1.0:1788530283.611281:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000004333fe4/0xb28d70e125750d24 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.41@tcp remote: 0x2b1406819a55098a expref: 7 pid: 8436 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530283.611356:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 77 00000100:00100000:1.0:1788530283.611373:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03edc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+7:2402:x1875409531629056:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788530283.611395:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788530283.611422:0:6509:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788530283.611425:0:6509:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1788530282 00002000:00010000:1.0:1788530283.611427:0:6509:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1788530283 00002000:00010000:1.0:1788530283.611430:0:6509:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1788530282 00002000:00010000:1.0:1788530283.611432:0:6509:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1788530283.611440:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000004333fe4/0xb28d70e125750d24 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.41@tcp remote: 0x2b1406819a55098a expref: 7 pid: 8436 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530283.611458:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000004333fe4/0xb28d70e125750d24 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.41@tcp remote: 0x2b1406819a55098a expref: 7 pid: 8436 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530283.611516:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788530283.611521:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788530283.611529:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000870096cb/0xb28d70e125750d63 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530283.611540:0:6509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000870096cb/0xb28d70e125750d63 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530283.611628:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788530283.611698:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03edc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+7:2402:x1875409531629056:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 331us (2001us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530283.613749:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 77 00010000:00010000:2.0:1788530283.614273:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004333fe4/0xb28d70e125750d24 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.41@tcp remote: 0x2b1406819a55098a expref: 6 pid: 8436 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530283.614333:0:8438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03e88000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8438:1875409555838208:192.168.202.41@tcp:104: 00010000:00010000:2.0:1788530283.614373:0:8438:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000870096cb/0xb28d70e125750d63 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530283.614388:0:8438:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000870096cb/0xb28d70e125750d63 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530283.614396:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000870096cb/0xb28d70e125750d63 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530283.614444:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000870096cb/0xb28d70e125750d63 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530283.614454:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000870096cb/0xb28d70e125750d63 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530283.614464:0:8438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000870096cb/0xb28d70e125750d63 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530283.614471:0:8438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d20d400 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:2.0:1788530283.614476:0:8438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000870096cb/0xb28d70e125750d63 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530283.614488:0:8438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000870096cb/0xb28d70e125750d63 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530283.614521:0:8438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000870096cb/0xb28d70e125750d63 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530283.614529:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000870096cb/0xb28d70e125750d63 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530283.614682:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03ee3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2399:x1875409531628800:12345-192.168.202.41@tcp:1:lfs.0 Request processed in 17121us (19181us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530283.614693:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 45 00000100:00100000:3.0:1788530283.622808:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530283.623153:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531629312 00000100:00100000:0.0:1788530283.623207:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531629312 00000100:00100000:0.0:1788530283.623309:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 26 00000100:00100000:0.0:1788530283.623323:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3959d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+42:11371:x1875409531629312:12345-192.168.202.41@tcp:35:lfs.0 00000004:00010000:0.0:1788530283.623428:0:6526:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c200/0xb28d70e125750d55 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a55099f expref: 42 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788530283.624304:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:0.0:1788530283.624347:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:0.0:1788530283.626018:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:0.0:1788530283.626235:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e125750d6a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530283.626265:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d600/0xb28d70e125750d0f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a55097c expref: 46 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530283.626278:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e125750d6a lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530283.626339:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d600/0xb28d70e125750d0f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a55097c expref: 46 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530283.626363:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d600/0xb28d70e125750d0f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a55097c expref: 46 pid: 6524 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530283.626383:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03c5a680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6526:1875409555838336:192.168.202.41@tcp:104: 00000100:00100000:0.0:1788530283.626939:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f0a96bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788530283.638522:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03c5a680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6526:1875409555838336:192.168.202.41@tcp:104: 00010000:00010000:0.0:1788530283.638613:0:6526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e125750d6a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530283.641784:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530283.642350:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531629440 00000100:00100000:0.0:1788530283.642366:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531629440 00010000:00010000:0.0:1788530283.642445:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d600/0xb28d70e125750d0f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a55097c expref: 47 pid: 6524 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530283.642504:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 78 00000100:00100000:0.0:1788530283.642519:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f396c0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+47:2399:x1875409531629440:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788530283.642542:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788530283.642551:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d600/0xb28d70e125750d0f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a55097c expref: 47 pid: 6524 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530283.642589:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d600/0xb28d70e125750d0f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a55097c expref: 47 pid: 6524 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530283.642622:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d600/0xb28d70e125750d0f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a55097c expref: 47 pid: 6524 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530283.642645:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a9f2b996c00) 00010000:00010000:0.0:1788530283.642651:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e125750d6a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530283.642664:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e125750d6a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530283.642672:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e125750d6a lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530283.642938:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788530283.643033:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f396c0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+46:2399:x1875409531629440:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 516us (1342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530283.643043:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 78 00010000:00010000:0.0:1788530283.643496:0:6526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e125750d6a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530283.643508:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e125750d6a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788530283.643749:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:0.0:1788530283.643910:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:0.0:1788530283.644036:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03c58a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6526:1875409555838464:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788530283.644128:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530283.644192:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f0a96b480 going to sleep for 11 seconds 00000100:00100000:3.0:1788530283.646817:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555838464 00000100:00100000:3.0:1788530283.646843:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555838464 00000100:00100000:3.0:1788530283.646980:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788530283.646996:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6526:x1875409555838464:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788530283.647235:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6526:x1875409555838464:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 243us (3107us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530283.647244:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1788530283.647623:0:6526:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967302 gen 2 00000004:00080000:1.0:1788530283.647633:0:6526:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967302 00000004:00080000:1.0:1788530283.647666:0:6526:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a9e03c51c00, transno 4294967302 00000100:00100000:1.0:1788530283.647691:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03c58a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6526:1875409555838464:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788530283.647910:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:1.0:1788530283.648034:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03ee0a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6526:1875409555838592:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788530283.648102:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530283.648143:0:14186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555838592 00000100:00100000:1.0:1788530283.648151:0:14186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555838592 00000100:00100000:1.0:1788530283.648423:0:14186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1788530283.648434:0:14186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03ee2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6526:x1875409555838592:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788530283.649477:0:14186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03ee2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6526:x1875409555838592:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 1033us (1363us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1788530283.649518:0:14186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1788530283.649635:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e03639e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788530283.649681:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03ee0a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6526:1875409555838592:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788530283.649775:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:1.0:1788530283.649838:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e125750d6a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530283.649851:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e125750d6a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530283.649860:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e125750d6a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530283.649867:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d101800 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:1.0:1788530283.649872:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e125750d6a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530283.649881:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e125750d6a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530283.649909:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a9f2b996c00) 00010000:00010000:1.0:1788530283.649913:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788530283.649918:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e125750d6a lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530283.649924:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e125750d6a lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788530283.650072:0:6526:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000100:00080000:0.0:1788530283.650925:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:1.0:1788530283.652122:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:1.0:1788530283.653018:0:6526:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 491555454794ns, next at 492555445141ns, rc = 0 00000001:00080000:1.0:1788530283.653049:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:1.0:1788530283.653457:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a9f2b996c00) 00010000:00010000:1.0:1788530283.653463:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788530283.653486:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c200/0xb28d70e125750d55 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a55099f expref: 50 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530283.653771:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3959d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+49:11371:x1875409531629312:12345-192.168.202.41@tcp:35:lfs.0 Request processed in 30449us (30980us total) trans 4294967390 rc 0/0 00000100:00100000:1.0:1788530283.653782:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 26 00000020:00080000:1.0:1788530283.653789:0:6526:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788530283.657520:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530283.657818:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531629568 00000100:00100000:2.0:1788530283.657830:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531629568 00000100:00100000:2.0:1788530283.657920:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 111 00000100:00100000:2.0:1788530283.657930:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03edc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+49:11371:x1875409531629568:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:2.0:1788530283.657960:0:10720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530283.657989:0:10720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d400/0xb28d70e125750d71 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a5509a6 expref: -99 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530283.658058:0:10720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d400/0xb28d70e125750d71 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5509a6 expref: 50 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530283.658072:0:10720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d400/0xb28d70e125750d71 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5509a6 expref: 50 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530283.658099:0:10720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a9f2b996600) 00010000:00010000:2.0:1788530283.658102:0:10720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788530283.658121:0:10720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d20d400, rc 0) 00000100:00100000:2.0:1788530283.658196:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03edc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+50:11371:x1875409531629568:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 267us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530283.658204:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 111 00000100:00100000:3.0:1788530283.662526:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530283.666597:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531629824 00000100:00100000:0.0:1788530283.668574:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531629824 00000100:00100000:1.0:1788530283.668924:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 27 00000100:00100000:1.0:1788530283.668939:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03edf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+50:11371:x1875409531629824:12345-192.168.202.41@tcp:35:lfs.0 00000100:00100000:1.0:1788530283.669389:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03edf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+51:11371:x1875409531629824:12345-192.168.202.41@tcp:35:lfs.0 Request processed in 453us (6877us total) trans 4294967391 rc 0/0 00000100:00100000:1.0:1788530283.669398:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 27 00010000:00010000:1.0:1788530283.717716:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788530283.804445:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530283.804809:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531629952 00000100:00100000:3.0:1788530283.804823:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531629952 00000100:00100000:3.0:1788530283.804921:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 112 00000100:00100000:3.0:1788530283.804936:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03ee1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+51:11381:x1875409531629952:12345-192.168.202.41@tcp:34:lfs.0 00010000:00010000:3.0:1788530283.805057:0:8678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e125750d78 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530283.805082:0:8678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e125750d78 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530283.805304:0:8678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e125750d78 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530283.805319:0:8678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e125750d7f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530283.805327:0:8678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e125750d7f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530283.805332:0:8678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e125750d7f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530283.806287:0:8678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030000/0xb28d70e125750d86 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530283.806305:0:8678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030000/0xb28d70e125750d86 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530283.806315:0:8678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030000/0xb28d70e125750d86 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788530283.806389:0:8678:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030000/0xb28d70e125750d86 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530283.806404:0:8678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e125750d78 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530283.806411:0:8678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e125750d78 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530283.806418:0:8678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e125750d78 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530283.806425:0:8678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f00031e00 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:3.0:1788530283.806428:0:8678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e125750d78 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530283.806437:0:8678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e125750d78 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530283.807334:0:8678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a9e0241d100) 00010000:00010000:3.0:1788530283.807341:0:8678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788530283.807349:0:8678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e125750d78 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530283.807376:0:8678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e125750d78 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530283.807401:0:8678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e125750d7f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530283.807408:0:8678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e125750d7f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530283.807415:0:8678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e125750d7f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530283.807420:0:8678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f00031800 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:3.0:1788530283.807424:0:8678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e125750d7f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530283.807430:0:8678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e125750d7f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530283.807443:0:8678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9a9f32abde00) 00010000:00010000:3.0:1788530283.807447:0:8678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788530283.807450:0:8678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e125750d7f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530283.807456:0:8678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e125750d7f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530283.807467:0:8678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030000/0xb28d70e125750d86 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530283.807473:0:8678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030000/0xb28d70e125750d86 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530283.807487:0:8678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030000/0xb28d70e125750d86 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530283.807492:0:8678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f00030000 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:3.0:1788530283.807496:0:8678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030000/0xb28d70e125750d86 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530283.807501:0:8678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030000/0xb28d70e125750d86 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530283.807509:0:8678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a9f2b996600) 00010000:00010000:3.0:1788530283.807512:0:8678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788530283.807515:0:8678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030000/0xb28d70e125750d86 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530283.807521:0:8678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030000/0xb28d70e125750d86 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530283.809873:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03ee1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+51:11381:x1875409531629952:12345-192.168.202.41@tcp:34:lfs.0 Request processed in 4927us (5436us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530283.809890:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 112 00000100:00100000:3.0:1788530283.882099:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530283.882638:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531630208 00000100:00100000:2.0:1788530283.882654:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531630208 00000100:00100000:2.0:1788530283.882788:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 113 00000100:00100000:2.0:1788530283.882802:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03eddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+51:11384:x1875409531630208:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:2.0:1788530283.882848:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530283.882889:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20da00/0xb28d70e125750d8d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a5509ad expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530283.883266:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d000/0xb28d70e125750d94 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530283.883292:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d000/0xb28d70e125750d94 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530283.883309:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d000/0xb28d70e125750d94 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530283.883327:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c200/0xb28d70e125750d9b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530283.883337:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c200/0xb28d70e125750d9b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530283.883344:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c200/0xb28d70e125750d9b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530283.883545:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d600/0xb28d70e125750da2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530283.883626:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d600/0xb28d70e125750da2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530283.883634:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d600/0xb28d70e125750da2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788530283.883647:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788530283.883767:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d000/0xb28d70e125750d94 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530283.883776:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d000/0xb28d70e125750d94 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530283.883784:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d000/0xb28d70e125750d94 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530283.883792:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d20d000 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:2.0:1788530283.883799:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d000/0xb28d70e125750d94 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530283.883809:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d000/0xb28d70e125750d94 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530283.883826:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a9e0241d100) 00010000:00010000:2.0:1788530283.883843:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788530283.883852:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d000/0xb28d70e125750d94 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530283.883860:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d000/0xb28d70e125750d94 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530283.883879:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c200/0xb28d70e125750d9b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530283.883937:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c200/0xb28d70e125750d9b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530283.883943:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c200/0xb28d70e125750d9b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530283.883949:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d20c200 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:2.0:1788530283.883953:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c200/0xb28d70e125750d9b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530283.883960:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c200/0xb28d70e125750d9b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530283.883978:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9a9f32abde00) 00010000:00010000:2.0:1788530283.883982:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788530283.883985:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c200/0xb28d70e125750d9b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530283.883991:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c200/0xb28d70e125750d9b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530283.884051:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20da00/0xb28d70e125750d8d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5509ad expref: 54 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530283.884068:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d600/0xb28d70e125750da2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5509ad expref: 53 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530283.884077:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a9f2b996600) 00010000:00010000:2.0:1788530283.884079:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788530283.884099:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d20d600, rc 0) 00000100:00100000:2.0:1788530283.885727:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03eddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+53:11384:x1875409531630208:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 2905us (3631us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1788530283.885745:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 113 00000100:00100000:3.0:1788530283.892278:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530283.892860:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531630336 00000100:00100000:2.0:1788530283.892877:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531630336 00000100:00100000:2.0:1788530283.893004:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 114 00000100:00100000:2.0:1788530283.893018:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03edea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+53:11384:x1875409531630336:12345-192.168.202.41@tcp:54:lfs.0 00010000:00010000:2.0:1788530283.893813:0:10720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20dc00/0xb28d70e125750db0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530283.894111:0:10720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20dc00/0xb28d70e125750db0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530283.894135:0:10720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20dc00/0xb28d70e125750db0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530283.894531:0:10720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20dc00/0xb28d70e125750db0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530283.894539:0:10720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20dc00/0xb28d70e125750db0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530283.894549:0:10720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20dc00/0xb28d70e125750db0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530283.894631:0:10720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d20dc00 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:3.0:1788530283.894637:0:10720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20dc00/0xb28d70e125750db0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530283.894645:0:10720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20dc00/0xb28d70e125750db0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530283.894662:0:10720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a9f2b996600) 00010000:00010000:3.0:1788530283.894665:0:10720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788530283.894672:0:10720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20dc00/0xb28d70e125750db0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530283.894679:0:10720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20dc00/0xb28d70e125750db0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530283.894828:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03edea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+53:11384:x1875409531630336:12345-192.168.202.41@tcp:54:lfs.0 Request processed in 1807us (2564us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530283.894847:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 114 00000100:00100000:0.0:1788530283.900282:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530283.900768:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531630592 00000100:00100000:1.0:1788530283.900785:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531630592 00000100:00100000:1.0:1788530283.900862:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 28 00000100:00100000:1.0:1788530283.900876:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+53:11384:x1875409531630592:12345-192.168.202.41@tcp:35:lfs.0 00000100:00100000:1.0:1788530283.902284:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+54:11384:x1875409531630592:12345-192.168.202.41@tcp:35:lfs.0 Request processed in 1398us (2189us total) trans 4294967393 rc 0/0 00000100:00100000:1.0:1788530283.902298:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 28 00000100:00100000:0.0:1788530284.049760:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530284.049941:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531630848 00000100:00100000:2.0:1788530284.049957:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531630848 00000100:00100000:2.0:1788530284.050097:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 115 00000100:00100000:2.0:1788530284.050112:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+54:11394:x1875409531630848:12345-192.168.202.41@tcp:101:bash.0 00010000:00010000:2.0:1788530284.050167:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530284.050172:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788530284.050220:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101400/0xb28d70e125750d32 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550991 expref: 54 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530284.050253:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a9e0241d100) 00010000:00010000:2.0:1788530284.050258:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788530284.050275:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20da00/0xb28d70e125750db7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a5509b4 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530284.050431:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c200/0xb28d70e125750dbe lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530284.050452:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c200/0xb28d70e125750dbe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530284.050466:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c200/0xb28d70e125750dbe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788530284.050479:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788530284.050687:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20da00/0xb28d70e125750db7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5509b4 expref: 56 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530284.050703:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c200/0xb28d70e125750dbe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5509b4 expref: 55 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530284.050711:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a9f2b996600) 00010000:00010000:2.0:1788530284.050714:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788530284.050717:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d20c200, rc 0) 00000100:00100000:2.0:1788530284.050782:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+55:11394:x1875409531630848:12345-192.168.202.41@tcp:101:bash.0 Request processed in 674us (1043us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1788530284.050789:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 115 00000100:00080000:0.0:1788530284.051405:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788530284.059847:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530284.060603:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531630976 00000100:00100000:1.0:1788530284.060655:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531630976 00000100:00100000:1.0:1788530284.060775:0:10719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 116 00000100:00100000:1.0:1788530284.060788:0:10719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03edd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+55:11394:x1875409531630976:12345-192.168.202.41@tcp:101:bash.0 00010000:00010000:1.0:1788530284.060842:0:10719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530284.060873:0:10719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea600/0xb28d70e125750dcc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a5509bb expref: -99 pid: 10719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530284.060923:0:10719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb600/0xb28d70e125750dd3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530284.060943:0:10719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb600/0xb28d70e125750dd3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530284.060958:0:10719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb600/0xb28d70e125750dd3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530284.061838:0:10719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea600/0xb28d70e125750dcc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5509bb expref: 57 pid: 10719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530284.061870:0:10719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb600/0xb28d70e125750dd3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5509bb expref: 56 pid: 10719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530284.061881:0:10719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a9f2b996600) 00010000:00010000:1.0:1788530284.061884:0:10719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788530284.061889:0:10719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f012eb600, rc 0) 00000100:00100000:1.0:1788530284.063391:0:10719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03edd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+56:11394:x1875409531630976:12345-192.168.202.41@tcp:101:bash.0 Request processed in 2584us (3552us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530284.063410:0:10719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 116 00000100:00100000:0.0:1788530284.070786:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530284.071367:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531631232 00000100:00100000:1.0:1788530284.071404:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531631232 00000100:00100000:1.0:1788530284.071517:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 117 00000100:00100000:1.0:1788530284.071530:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+56:11394:x1875409531631232:12345-192.168.202.41@tcp:36:bash.0 00010000:00010000:1.0:1788530284.071642:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788530284.071681:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c200/0xb28d70e125750dbe lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5509b4 expref: 56 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530284.071711:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d600/0xb28d70e125750da2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5509ad expref: 55 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530284.071726:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a9f2b996600) 00010000:00010000:1.0:1788530284.071735:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788530284.072073:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea000/0xb28d70e125750dda lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530284.077545:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea000/0xb28d70e125750dda lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530284.077627:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea000/0xb28d70e125750dda lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788530284.077806:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:1.0:1788530284.077917:0:6525:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005a32b595 reply state 00000000f6810f2b transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea000/0xb28d70e125750dda lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530284.077935:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea000/0xb28d70e125750dda lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530284.077945:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a9f2b996600) 00010000:00010000:1.0:1788530284.077948:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788530284.077995:0:6525:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788530284.078244:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+57:11394:x1875409531631232:12345-192.168.202.41@tcp:36:bash.0 Request processed in 6707us (7473us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1788530284.078259:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 117 00000020:00080000:1.0:1788530284.078268:0:6525:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788530284.086110:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530284.086387:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531631360 00000100:00100000:1.0:1788530284.086407:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531631360 00000100:00100000:1.0:1788530284.086505:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 118 00000100:00100000:1.0:1788530284.086518:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+57:11394:x1875409531631360:12345-192.168.202.41@tcp:101:bash.0 00010000:00010000:1.0:1788530284.086545:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530284.087942:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ebc00/0xb28d70e125750de1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a5509c2 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530284.088272:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb400/0xb28d70e125750de8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530284.088290:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb400/0xb28d70e125750de8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530284.088304:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb400/0xb28d70e125750de8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788530284.088338:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788530284.088344:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788530284.088449:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb400/0xb28d70e125750de8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530284.088489:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ebc00/0xb28d70e125750de1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5509c2 expref: 59 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530284.088512:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb400/0xb28d70e125750de8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5509c2 expref: 58 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530284.088539:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a9f2b996600) 00010000:00010000:0.0:1788530284.088542:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788530284.088545:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f012eb400, rc 0) 00000100:00100000:0.0:1788530284.089238:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+58:11394:x1875409531631360:12345-192.168.202.41@tcp:101:bash.0 Request processed in 2718us (3136us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530284.089250:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 118 00000100:00100000:3.0:1788530284.095258:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530284.095666:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531631616 00000100:00100000:0.0:1788530284.095681:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531631616 00000100:00100000:0.0:1788530284.095760:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 29 00000100:00100000:0.0:1788530284.095773:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03edf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+58:11394:x1875409531631616:12345-192.168.202.41@tcp:35:bash.0 00000100:00100000:0.0:1788530284.096096:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03edf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+59:11394:x1875409531631616:12345-192.168.202.41@tcp:35:bash.0 Request processed in 322us (851us total) trans 4294967397 rc 0/0 00000100:00100000:0.0:1788530284.096104:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 29 00000100:00100000:2.0:1788530284.168871:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530284.169038:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531631744 00000100:00100000:3.0:1788530284.169049:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531631744 00000100:00100000:3.0:1788530284.169177:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 119 00000100:00100000:3.0:1788530284.169189:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03e88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+59:11400:x1875409531631744:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:3.0:1788530284.169215:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788530284.169236:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030000/0xb28d70e125750def lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a5509c9 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530284.169347:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e125750df6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530284.169362:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e125750df6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530284.169375:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e125750df6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788530284.169433:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1788530284.169437:0:6524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788530284.169458:0:6524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e125750df6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530284.169487:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030000/0xb28d70e125750def lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5509c9 expref: 61 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530284.169511:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e125750df6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5509c9 expref: 60 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530284.169521:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a9e0241d100) 00010000:00010000:3.0:1788530284.169524:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788530284.169527:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f00031800, rc 0) 00000100:00100000:3.0:1788530284.169666:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03e88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+60:11400:x1875409531631744:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 479us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530284.169673:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 119 00000100:00100000:0.0:1788530284.177606:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530284.177771:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531631872 00000100:00100000:3.0:1788530284.177788:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531631872 00000100:00100000:3.0:1788530284.177916:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 120 00000100:00100000:3.0:1788530284.177928:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+60:11400:x1875409531631872:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:3.0:1788530284.177950:0:10720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788530284.177971:0:10720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e125750dfd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a5509d0 expref: -99 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530284.178058:0:10720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91d600/0xb28d70e125750e04 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530284.178314:0:10720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91d600/0xb28d70e125750e04 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530284.178327:0:10720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91d600/0xb28d70e125750e04 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530284.178343:0:10720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b000/0xb28d70e125750e0b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530284.178351:0:10720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b000/0xb28d70e125750e0b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530284.178358:0:10720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b000/0xb28d70e125750e0b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530284.178463:0:10720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36ac00/0xb28d70e125750e12 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530284.178473:0:10720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36ac00/0xb28d70e125750e12 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530284.178480:0:10720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36ac00/0xb28d70e125750e12 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788530284.178550:0:10720:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788530284.178555:0:10720:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788530284.178933:0:10720:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36ac00/0xb28d70e125750e12 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530284.178948:0:10720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36ac00/0xb28d70e125750e12 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530284.178957:0:10720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91d600/0xb28d70e125750e04 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530284.178964:0:10720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91d600/0xb28d70e125750e04 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530284.178971:0:10720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91d600/0xb28d70e125750e04 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530284.178985:0:10720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f0c91d600 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:0.0:1788530284.178990:0:10720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91d600/0xb28d70e125750e04 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530284.178997:0:10720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91d600/0xb28d70e125750e04 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530284.179011:0:10720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a9e0241d100) 00010000:00010000:0.0:1788530284.179014:0:10720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788530284.179019:0:10720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91d600/0xb28d70e125750e04 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530284.179025:0:10720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f0c91d600/0xb28d70e125750e04 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530284.179039:0:10720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b000/0xb28d70e125750e0b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530284.179044:0:10720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b000/0xb28d70e125750e0b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530284.179050:0:10720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b000/0xb28d70e125750e0b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530284.179056:0:10720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d36b000 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:0.0:1788530284.179059:0:10720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b000/0xb28d70e125750e0b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530284.179065:0:10720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b000/0xb28d70e125750e0b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530284.179084:0:10720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9a9f32abde00) 00010000:00010000:0.0:1788530284.179087:0:10720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788530284.179090:0:10720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b000/0xb28d70e125750e0b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530284.179096:0:10720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b000/0xb28d70e125750e0b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530284.179125:0:10720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e125750dfd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5509d0 expref: 62 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530284.179141:0:10720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36ac00/0xb28d70e125750e12 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5509d0 expref: 61 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530284.179149:0:10720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a9f2b996600) 00010000:00010000:0.0:1788530284.179151:0:10720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788530284.179154:0:10720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d36ac00, rc 0) 00000100:00100000:0.0:1788530284.179228:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+61:11400:x1875409531631872:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 1302us (1667us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530284.179237:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 120 00000100:00100000:0.0:1788530284.184512:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530284.184669:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530284.184790:0:10347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531632256 00000100:00100000:2.0:1788530284.184807:0:10347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531632256 00000100:00100000:2.0:1788530284.184910:0:10347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 5 00000100:00100000:2.0:1788530284.184923:0:10347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c59c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+61:2402:x1875409531632256:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788530284.184978:0:10347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788530284.185023:0:10347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36ac00/0xb28d70e125750e12 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5509d0 expref: 61 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530284.185053:0:10347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a9f2b996600) 00010000:00010000:2.0:1788530284.185060:0:10347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788530284.185174:0:10347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c59c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+60:2402:x1875409531632256:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 253us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530284.185183:0:10347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 5 00000100:00100000:3.0:1788530284.186847:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531632128 00000100:00100000:3.0:1788530284.186865:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531632128 00000100:00100000:3.0:1788530284.187022:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 121 00000100:00100000:3.0:1788530284.187034:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+60:11400:x1875409531632128:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:3.0:1788530284.187077:0:8678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788530284.187118:0:8678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36ae00/0xb28d70e125750e19 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a5509d7 expref: -99 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530284.187288:0:8678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36be00/0xb28d70e125750e20 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530284.187308:0:8678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb400/0xb28d70e125750de8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5509c2 expref: 61 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530284.187319:0:8678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36be00/0xb28d70e125750e20 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530284.187356:0:8678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb400/0xb28d70e125750de8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a5509c2 expref: 61 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530284.187372:0:8678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb400/0xb28d70e125750de8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a5509c2 expref: 61 pid: 6523 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530284.187387:0:8678:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03edd880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8678:1875409555838720:192.168.202.41@tcp:104: 00000100:00100000:3.0:1788530284.187532:0:8678:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f396d56c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788530284.190708:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530284.190840:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531632384 00000100:00100000:1.0:1788530284.190849:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531632384 00010000:00010000:1.0:1788530284.190923:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb400/0xb28d70e125750de8 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a5509c2 expref: 62 pid: 6523 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530284.190975:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 79 00000100:00100000:1.0:1788530284.190986:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+62:2400:x1875409531632384:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788530284.191027:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788530284.191036:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb400/0xb28d70e125750de8 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a5509c2 expref: 62 pid: 6523 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530284.191052:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb400/0xb28d70e125750de8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a5509c2 expref: 62 pid: 6523 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530284.191105:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a9f2b996600) 00010000:00010000:1.0:1788530284.191114:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36be00/0xb28d70e125750e20 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530284.191130:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36be00/0xb28d70e125750e20 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530284.191141:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36be00/0xb28d70e125750e20 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530284.191164:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788530284.191235:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+62:2400:x1875409531632384:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 250us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530284.191243:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 79 00010000:00010000:3.0:1788530284.192365:0:8678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb400/0xb28d70e125750de8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a5509c2 expref: 61 pid: 6523 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530284.192391:0:8678:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03edd880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8678:1875409555838720:192.168.202.41@tcp:104: 00010000:00010000:3.0:1788530284.192433:0:8678:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36be00/0xb28d70e125750e20 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530284.192688:0:8678:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36be00/0xb28d70e125750e20 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530284.192698:0:8678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36be00/0xb28d70e125750e20 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788530284.192752:0:8678:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788530284.193050:0:8678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36ae00/0xb28d70e125750e19 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5509d7 expref: 62 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530284.193072:0:8678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36be00/0xb28d70e125750e20 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5509d7 expref: 61 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530284.193162:0:8678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a9f2b996600) 00010000:00010000:0.0:1788530284.193166:0:8678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788530284.193171:0:8678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d36be00, rc 0) 00000100:00100000:0.0:1788530284.193344:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+61:11400:x1875409531632128:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 6310us (8850us total) trans 4294967398 rc 0/0 00000100:00100000:0.0:1788530284.193353:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 121 00000100:00100000:0.0:1788530284.197374:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530284.197995:0:10347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531632640 00000100:00100000:2.0:1788530284.198013:0:10347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531632640 00000100:00100000:2.0:1788530284.198281:0:10347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 6 00000100:00100000:2.0:1788530284.198294:0:10347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c5b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+61:11400:x1875409531632640:12345-192.168.202.41@tcp:103:lfs.0 00010000:00010000:2.0:1788530284.198317:0:10347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788530284.198348:0:10347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d400/0xb28d70e125750d71 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5509a6 expref: 61 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530284.198368:0:10347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a9f2b996600) 00010000:00010000:2.0:1788530284.198373:0:10347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788530284.198447:0:10347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c5b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+60:11400:x1875409531632640:12345-192.168.202.41@tcp:103:lfs.0 Request processed in 156us (1094us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530284.198453:0:10347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 6 00000100:00100000:2.0:1788530284.205590:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530284.205733:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531632768 00000100:00100000:1.0:1788530284.205743:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531632768 00000100:00100000:1.0:1788530284.205813:0:10719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 122 00000100:00100000:1.0:1788530284.205830:0:10719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03e8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+60:11400:x1875409531632768:12345-192.168.202.41@tcp:58:lfs.0 00010000:00010000:1.0:1788530284.205977:0:10719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea600/0xb28d70e125750e2e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530284.205996:0:10719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea600/0xb28d70e125750e2e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530284.206013:0:10719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea600/0xb28d70e125750e2e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788530284.206135:0:10719:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:1.0:1788530284.206243:0:10719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03e8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+60:11400:x1875409531632768:12345-192.168.202.41@tcp:58:lfs.0 Request processed in 414us (690us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530284.206251:0:10719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 122 00000100:00100000:0.0:1788530284.208742:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530284.208850:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531632896 00000100:00100000:1.0:1788530284.208862:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531632896 00000100:00100000:1.0:1788530284.208965:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 123 00000100:00100000:1.0:1788530284.208980:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+60:11400:x1875409531632896:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:1.0:1788530284.209007:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530284.209034:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea800/0xb28d70e125750e35 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a5509de expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530284.209241:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea600/0xb28d70e125750e2e lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530284.209254:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea800/0xb28d70e125750e35 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5509de expref: 61 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530284.209277:0:6525:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea600/0xb28d70e125750e2e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530284.209291:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea800/0xb28d70e125750e35 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5509de expref: 61 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530284.209304:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a9f2b996600) 00010000:00010000:1.0:1788530284.209322:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788530284.209327:0:6525:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea800/0xb28d70e125750e35 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5509de expref: 61 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530284.209335:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f012ea800, rc 0) 00000100:00100000:1.0:1788530284.209405:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+61:11400:x1875409531632896:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 428us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530284.209412:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 123 00010000:00010000:0.0:1788530284.737158:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788530284.994650:0:13811:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788530284.994663:0:13811:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788530284.994720:0:13811:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:3.0:1788530284.994733:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788530284.994905:0:13811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03edd880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13811:1875409555838848:192.168.202.41@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788530284.995077:0:13811:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f396d53c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788530285.001257:0:13811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03edd880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13811:1875409555838848:192.168.202.41@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788530285.002820:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530285.002993:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531633024 00000100:00100000:0.0:1788530285.003003:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531633024 00000100:00100000:0.0:1788530285.003516:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 124 00000100:00100000:0.0:1788530285.003531:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03e89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+61:11401:x1875409531633024:12345-192.168.202.41@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788530285.003612:0:6523:0:(mdt_handler.c:7977:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788530285.003746:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03e89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+61:11401:x1875409531633024:12345-192.168.202.41@tcp:53:lhsmtool_posix.0 Request processed in 219us (934us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530285.003754:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 124 00000100:00100000:0.0:1788530285.019929:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530285.020247:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531633152 00000100:00100000:1.0:1788530285.020258:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531633152 00000100:00100000:1.0:1788530285.020337:0:10719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 125 00000100:00100000:1.0:1788530285.020348:0:10719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+61:11401:x1875409531633152:12345-192.168.202.41@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788530285.020418:0:10719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb800/0xb28d70e125750e3c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.020436:0:10719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb800/0xb28d70e125750e3c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.020448:0:10719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb800/0xb28d70e125750e3c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.020465:0:10719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ebe00/0xb28d70e125750e43 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.020473:0:10719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ebe00/0xb28d70e125750e43 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.020480:0:10719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ebe00/0xb28d70e125750e43 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.020502:0:10719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e125750e4a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.020536:0:10719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e125750e4a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.020544:0:10719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e125750e4a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788530285.021043:0:10719:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788530285.021048:0:10719:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788530285.021060:0:10719:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e125750e4a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.021072:0:10719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb800/0xb28d70e125750e3c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.021079:0:10719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb800/0xb28d70e125750e3c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.021085:0:10719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb800/0xb28d70e125750e3c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.021091:0:10719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f012eb800 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:1.0:1788530285.021096:0:10719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb800/0xb28d70e125750e3c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.021104:0:10719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb800/0xb28d70e125750e3c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.021116:0:10719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a9f2b992000) 00010000:00010000:1.0:1788530285.021213:0:10719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788530285.021220:0:10719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb800/0xb28d70e125750e3c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.021238:0:10719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb800/0xb28d70e125750e3c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.021253:0:10719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ebe00/0xb28d70e125750e43 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.021260:0:10719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ebe00/0xb28d70e125750e43 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.021265:0:10719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ebe00/0xb28d70e125750e43 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.021270:0:10719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f012ebe00 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:1.0:1788530285.021273:0:10719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ebe00/0xb28d70e125750e43 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.021468:0:10719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ebe00/0xb28d70e125750e43 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.021479:0:10719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff9a9f32abdb00) 00010000:00010000:1.0:1788530285.021481:0:10719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788530285.021486:0:10719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ebe00/0xb28d70e125750e43 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.021491:0:10719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ebe00/0xb28d70e125750e43 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.021510:0:10719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e125750e4a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.021760:0:10719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e125750e4a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.021772:0:10719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e125750e4a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.021777:0:10719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f012eac00 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:1.0:1788530285.021781:0:10719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e125750e4a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.021787:0:10719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e125750e4a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.021795:0:10719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a9f2b996600) 00010000:00010000:1.0:1788530285.021798:0:10719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788530285.021801:0:10719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e125750e4a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.021808:0:10719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e125750e4a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530285.021938:0:10719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+61:11401:x1875409531633152:12345-192.168.202.41@tcp:34:lhsmtool_posix.0 Request processed in 1587us (2015us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530285.021949:0:10719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 125 00000100:00100000:1.0:1788530285.027069:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530285.027376:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531633408 00000100:00100000:0.0:1788530285.027403:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531633408 00000100:00100000:0.0:1788530285.027484:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 126 00000100:00100000:0.0:1788530285.027495:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03ee0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+61:11401:x1875409531633408:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788530285.028291:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530285.028340:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100800/0xb28d70e125750e51 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a5509e5 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.028505:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100400/0xb28d70e125750e58 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.028786:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100400/0xb28d70e125750e58 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.028800:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100400/0xb28d70e125750e58 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788530285.028813:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788530285.029080:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100400/0xb28d70e125750e58 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.029088:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100400/0xb28d70e125750e58 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.029095:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100400/0xb28d70e125750e58 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.029102:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d100400 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:0.0:1788530285.029107:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100400/0xb28d70e125750e58 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.029114:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100400/0xb28d70e125750e58 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.029142:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a9f2b996600) 00010000:00010000:0.0:1788530285.029145:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788530285.029216:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100400/0xb28d70e125750e58 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.029224:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100400/0xb28d70e125750e58 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.029274:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100800/0xb28d70e125750e51 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5509e5 expref: 63 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.029287:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a9f2b992000) 00010000:00010000:0.0:1788530285.029291:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788530285.029295:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100800/0xb28d70e125750e51 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5509e5 expref: 63 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.029304:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d100800, rc 0) 00000100:00100000:0.0:1788530285.029458:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03ee0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+62:11401:x1875409531633408:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 1964us (2399us total) trans 4294967399 rc 301/301 00000100:00100000:0.0:1788530285.029468:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 126 00000100:00100000:2.0:1788530285.035211:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530285.036069:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531633536 00000100:00100000:0.0:1788530285.036084:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531633536 00000100:00100000:0.0:1788530285.036283:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 127 00000100:00100000:0.0:1788530285.036296:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03e8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+62:11401:x1875409531633536:12345-192.168.202.41@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788530285.036332:0:8678:0:(mdt_handler.c:7977:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788530285.036458:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03e8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+62:11401:x1875409531633536:12345-192.168.202.41@tcp:53:lhsmtool_posix.0 Request processed in 165us (1320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530285.036485:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 127 00000100:00100000:3.0:1788530285.040341:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530285.041948:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531633792 00000100:00100000:2.0:1788530285.041990:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531633792 00000100:00100000:2.0:1788530285.042116:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 128 00000100:00100000:2.0:1788530285.042132:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03edd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+62:11401:x1875409531633792:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788530285.042345:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530285.042350:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788530285.042388:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e125750df6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5509c9 expref: 62 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530285.042415:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a9e0241d100) 00010000:00010000:2.0:1788530285.042422:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788530285.042443:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c800/0xb28d70e125750e66 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a5509ec expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788530285.043216:0:6523:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:2.0:1788530285.043422:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ca00/0xb28d70e125750e6d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530285.043439:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ca00/0xb28d70e125750e6d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530285.043450:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ca00/0xb28d70e125750e6d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530285.043507:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c800/0xb28d70e125750e66 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5509ec expref: 64 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530285.043525:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ca00/0xb28d70e125750e6d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5509ec expref: 63 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530285.043549:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9a9f2b996300) 00010000:00010000:2.0:1788530285.043552:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788530285.043556:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d20ca00, rc 0) 00000100:00100000:2.0:1788530285.043863:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03edd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+63:11401:x1875409531633792:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 1733us (3544us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1788530285.044024:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 128 00000100:00100000:1.0:1788530285.049452:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530285.049837:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531634048 00000100:00100000:3.0:1788530285.049851:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531634048 00000100:00100000:3.0:1788530285.050117:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 129 00000100:00100000:3.0:1788530285.050132:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03ee0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+63:11401:x1875409531634048:12345-192.168.202.41@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788530285.050222:0:10720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788530285.050256:0:10720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ca00/0xb28d70e125750e6d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5509ec expref: 63 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530285.050276:0:10720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9a9f2b996300) 00010000:00010000:3.0:1788530285.050290:0:10720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788530285.050315:0:10720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e125750e7b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530285.050354:0:10720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e125750e7b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530285.050365:0:10720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e125750e7b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530285.050384:0:10720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e125750e82 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xc25fd940 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530285.050392:0:10720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e125750e82 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xc25fd940 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530285.050399:0:10720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e125750e82 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xc25fd940 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530285.050458:0:10720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e125750e7b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530285.050465:0:10720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e125750e7b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530285.050472:0:10720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e125750e7b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530285.050477:0:10720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d36b800 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:3.0:1788530285.050481:0:10720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e125750e7b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530285.050490:0:10720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e125750e7b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530285.050498:0:10720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a9e0241d100) 00010000:00010000:3.0:1788530285.050507:0:10720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788530285.050512:0:10720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e125750e7b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530285.050531:0:10720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e125750e7b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530285.050542:0:10720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e125750e82 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xc25fd940 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530285.050548:0:10720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e125750e82 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xc25fd940 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530285.050554:0:10720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e125750e82 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xc25fd940 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530285.050590:0:10720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d36b200 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:3.0:1788530285.050593:0:10720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e125750e82 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xc25fd940 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530285.050616:0:10720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e125750e82 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xc25fd940 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530285.050624:0:10720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xc25fd940 (ffff9a9f0cf59900) 00010000:00010000:3.0:1788530285.050627:0:10720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788530285.050630:0:10720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e125750e82 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xc25fd940 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530285.050636:0:10720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e125750e82 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xc25fd940 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530285.050745:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03ee0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+62:11401:x1875409531634048:12345-192.168.202.41@tcp:36:lhsmtool_posix.0 Request processed in 616us (1305us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788530285.050758:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 129 00000100:00100000:2.0:1788530285.055147:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530285.055304:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531634176 00000100:00100000:0.0:1788530285.055317:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531634176 00000100:00100000:0.0:1788530285.055435:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 130 00000100:00100000:0.0:1788530285.055451:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03e89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+62:11401:x1875409531634176:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788530285.055478:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530285.055526:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100800/0xb28d70e125750e89 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a5509f3 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.055595:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100400/0xb28d70e125750e90 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.056056:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100400/0xb28d70e125750e90 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.056072:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100400/0xb28d70e125750e90 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.056237:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100800/0xb28d70e125750e89 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5509f3 expref: 64 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.056263:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100400/0xb28d70e125750e90 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5509f3 expref: 63 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.056274:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9a9e0241dd00) 00010000:00010000:0.0:1788530285.056277:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788530285.056283:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d100400, rc 0) 00000100:00100000:0.0:1788530285.056393:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03e89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+63:11401:x1875409531634176:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 946us (1260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530285.056411:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 130 00000100:00100000:2.0:1788530285.062857:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530285.063472:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531634432 00000100:00100000:0.0:1788530285.063486:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531634432 00000100:00100000:0.0:1788530285.063622:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 131 00000100:00100000:0.0:1788530285.063636:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03e8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+63:11401:x1875409531634432:12345-192.168.202.41@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788530285.063757:0:8678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e125750e97 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.063778:0:8678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e125750e97 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.063791:0:8678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e125750e97 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788530285.064395:0:8678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:0.0:1788530285.064407:0:8678:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 492966845232ns, next at 493966841766ns, rc = 0 00000004:00010000:0.0:1788530285.064465:0:8678:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000588b2b64 reply state 000000004ed84245 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e125750e97 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.064480:0:8678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e125750e97 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.064489:0:8678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9a9e0241dd00) 00010000:00010000:0.0:1788530285.064492:0:8678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788530285.064497:0:8678:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788530285.065489:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03e8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+65:11401:x1875409531634432:12345-192.168.202.41@tcp:36:lhsmtool_posix.0 Request processed in 1845us (2632us total) trans 4294967401 rc 0/0 00000100:00100000:0.0:1788530285.065504:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 131 00000100:00100000:1.0:1788530285.071125:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530285.071306:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531634560 00000100:00100000:0.0:1788530285.071343:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531634560 00000100:00100000:0.0:1788530285.071506:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 132 00000100:00100000:0.0:1788530285.071535:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03ee3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+65:11401:x1875409531634560:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788530285.071615:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530285.071648:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101a00/0xb28d70e125750e9e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a5509fa expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.071748:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101a00/0xb28d70e125750e9e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5509fa expref: 66 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.071768:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101a00/0xb28d70e125750e9e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5509fa expref: 66 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.071795:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9a9e0241dd00) 00010000:00010000:0.0:1788530285.071799:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788530285.071803:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d101a00, rc 0) 00000100:00100000:0.0:1788530285.071870:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03ee3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+66:11401:x1875409531634560:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 351us (767us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530285.071893:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 132 00000100:00100000:2.0:1788530285.076848:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530285.077248:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531634688 00000100:00100000:1.0:1788530285.077261:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531634688 00000100:00100000:1.0:1788530285.077397:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 46 00000100:00100000:1.0:1788530285.077409:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03e89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:2400:x1875409531634688:12345-192.168.202.41@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788530285.078081:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03e89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+7:2400:x1875409531634688:12345-192.168.202.41@tcp:2:lhsmtool_posix.0 Request processed in 673us (1249us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788530285.078092:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 46 00000100:00080000:0.0:1788530285.078302:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788530285.081856:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530285.082095:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531634944 00000100:00100000:1.0:1788530285.082112:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531634944 00000100:00100000:1.0:1788530285.082302:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 30 00000100:00100000:1.0:1788530285.082318:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03e88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+66:11401:x1875409531634944:12345-192.168.202.41@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788530285.082633:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03e88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+67:11401:x1875409531634944:12345-192.168.202.41@tcp:35:lhsmtool_posix.0 Request processed in 318us (787us total) trans 4294967402 rc 0/0 00000100:00100000:1.0:1788530285.082642:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 30 00000100:00100000:2.0:1788530285.085284:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530285.085405:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531635200 00000100:00100000:3.0:1788530285.085423:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531635200 00000100:00100000:3.0:1788530285.085534:0:10719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 133 00000100:00100000:3.0:1788530285.085546:0:10719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03e8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+67:11401:x1875409531635200:12345-192.168.202.41@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788530285.085762:0:10719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03e8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+67:11401:x1875409531635200:12345-192.168.202.41@tcp:57:lhsmtool_posix.0 Request processed in 217us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530285.085770:0:10719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 133 00000100:00100000:2.0:1788530285.090852:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530285.090960:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531635328 00000100:00100000:3.0:1788530285.090970:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531635328 00000100:00100000:3.0:1788530285.091039:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 134 00000100:00100000:3.0:1788530285.091050:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03e88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+67:11401:x1875409531635328:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788530285.091069:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788530285.091090:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e125750ea5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550a01 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530285.091173:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e125750eac lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530285.091188:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e125750eac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530285.091199:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e125750eac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788530285.091244:0:6524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788530285.091261:0:6524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e125750eac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530285.091300:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e125750ea5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a01 expref: 69 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530285.091317:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e125750eac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a01 expref: 68 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530285.091326:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9a9e0241dd00) 00010000:00010000:3.0:1788530285.091329:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788530285.091332:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d36b800, rc 0) 00000100:00100000:3.0:1788530285.091388:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03e88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+68:11401:x1875409531635328:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 340us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530285.091395:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 134 00000100:00100000:2.0:1788530285.094973:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530285.095145:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531635456 00000100:00100000:3.0:1788530285.095165:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531635456 00000100:00100000:3.0:1788530285.095227:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 47 00000100:00100000:3.0:1788530285.095238:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03e88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+7:2399:x1875409531635456:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788530285.095259:0:8752:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788530285.095282:0:8752:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000adf81c4e/0xb28d70e125750eb3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550a08 expref: -99 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788530285.095313:0:8752:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9ace6c, blocks: 0x0 00010000:00010000:3.0:1788530285.095334:0:8752:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=492s v=(0 0) 00010000:00010000:3.0:1788530285.095338:0:8752:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788530285.095347:0:8752:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000adf81c4e/0xb28d70e125750eb3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a08 expref: 8 pid: 8752 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530285.095382:0:8752:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000adf81c4e/0xb28d70e125750eb3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a08 expref: 8 pid: 8752 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530285.095396:0:8752:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d36b400, rc 0) 00000100:00100000:3.0:1788530285.095464:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03e88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+8:2399:x1875409531635456:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 227us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530285.095472:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 47 00000100:00100000:2.0:1788530285.100115:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530285.100297:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531635712 00000100:00100000:3.0:1788530285.100309:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531635712 00000100:00100000:3.0:1788530285.100442:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 135 00000100:00100000:3.0:1788530285.100454:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03e8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+68:11401:x1875409531635712:12345-192.168.202.41@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788530285.100805:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03e8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+68:11401:x1875409531635712:12345-192.168.202.41@tcp:57:lhsmtool_posix.0 Request processed in 352us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530285.100814:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 135 00000100:00100000:0.0:1788530285.108644:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530285.108804:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531635840 00000100:00100000:1.0:1788530285.108818:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531635840 00000100:00100000:1.0:1788530285.108909:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 48 00000100:00100000:1.0:1788530285.108925:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+8:11401:x1875409531635840:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788530285.108960:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530285.108991:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000db00bf6e/0xb28d70e125750eba lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550a0f expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.109039:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000adf81c4e/0xb28d70e125750eb3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a08 expref: 9 pid: 8752 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.109048:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1788530285.109053:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788530285.109059:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000db00bf6e/0xb28d70e125750eba lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a0f expref: 9 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.109138:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000adf81c4e/0xb28d70e125750eb3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a08 expref: 9 pid: 8752 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.109168:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000adf81c4e/0xb28d70e125750eb3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a08 expref: 9 pid: 8752 timeout: 593 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530285.109186:0:8436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03ee3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1875409555838976:192.168.202.41@tcp:104: 00000100:00100000:1.0:1788530285.109316:0:8436:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e03639600 going to sleep for 11 seconds 00000100:00100000:2.0:1788530285.116961:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530285.117326:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531635968 00000100:00100000:0.0:1788530285.117341:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531635968 00010000:00010000:0.0:1788530285.117418:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000adf81c4e/0xb28d70e125750eb3 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a08 expref: 10 pid: 8752 timeout: 593 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530285.117484:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 80 00000100:00100000:0.0:1788530285.117497:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03e8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+10:2399:x1875409531635968:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788530285.117553:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788530285.117631:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000adf81c4e/0xb28d70e125750eb3 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a08 expref: 10 pid: 8752 timeout: 593 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.117649:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000adf81c4e/0xb28d70e125750eb3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a08 expref: 10 pid: 8752 timeout: 593 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.117685:0:6510:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788530285.117690:0:6510:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788530285.117703:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000db00bf6e/0xb28d70e125750eba lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a0f expref: 10 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.117715:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000db00bf6e/0xb28d70e125750eba lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a0f expref: 10 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.117770:0:6510:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000db00bf6e/0xb28d70e125750eba lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a0f expref: 10 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530285.117789:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03c5b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6510:1875409555839104:192.168.202.41@tcp:105: 00000100:00100000:0.0:1788530285.118146:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f07d236c0 going to sleep for 11 seconds 00010000:00010000:3.0:1788530285.119510:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000adf81c4e/0xb28d70e125750eb3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a08 expref: 10 pid: 8752 timeout: 593 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530285.119765:0:8436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03ee3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1875409555838976:192.168.202.41@tcp:104: 00010000:00010000:3.0:1788530285.119809:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000db00bf6e/0xb28d70e125750eba lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a0f expref: 9 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530285.119829:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f012eb800, rc 0) 00000100:00100000:2.0:1788530285.120288:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+9:11401:x1875409531635840:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 11362us (11654us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530285.120302:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 48 00000100:00100000:3.0:1788530285.127616:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f05f45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555839232:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788530285.127727:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530285.127861:0:14186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555839232 00000100:00100000:1.0:1788530285.127872:0:14186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555839232 00000100:00100000:1.0:1788530285.127962:0:14186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1788530285.127974:0:14186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03edca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555839232:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788530285.128016:0:14186:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1788530285.128682:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03c5b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6510:1875409555839104:192.168.202.41@tcp:105: 00010000:00010000:0.0:1788530285.128721:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788530285.128793:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03e8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+8:2399:x1875409531635968:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 11297us (11858us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530285.128806:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 80 00000100:00100000:1.0:1788530285.129144:0:14186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03edca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555839232:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1171us (1417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530285.129153:0:14186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1788530285.129281:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f05f45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555839232:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788530285.132480:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530285.132767:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531636096 00000100:00100000:3.0:1788530285.132783:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531636096 00002000:00100000:2.0:1788530285.133052:0:8443:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff9a9e03e89180 x1875409531636096/t0(0) o4->aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41@192.168.202.41@tcp:226/0 lens 504/0 e 0 to 0 dl 1788530296 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788530285.133065:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a9e03e89180 with x1875409531636096 ext(0->12) 00002000:00010000:2.0:1788530285.133071:0:8443:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a9e03e89180 00000100:00100000:2.0:1788530285.133105:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 3 00000100:00100000:2.0:1788530285.133132:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03e89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+8:2400:x1875409531636096:12345-192.168.202.41@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788530285.135079:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03e89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+10:2400:x1875409531636096:12345-192.168.202.41@tcp:4:lhsmtool_posix.0 Request processed in 1937us (2600us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788530285.135102:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 3 00002000:00100000:2.0:1788530285.135116:0:8443:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff9a9e03e89180 x1875409531636096/t4294967310(0) o4->aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41@192.168.202.41@tcp:226/0 lens 504/448 e 0 to 0 dl 1788530296 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788530285.135128:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a9e03e89180 with x1875409531636096 ext(0->12) 00002000:00010000:2.0:1788530285.135136:0:8443:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a9e03e89180 00000100:00100000:2.0:1788530285.138390:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530285.138512:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531636224 00000100:00100000:3.0:1788530285.138805:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531636224 00000100:00100000:2.0:1788530285.140102:0:10719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 136 00000100:00100000:2.0:1788530285.140120:0:10719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03e89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+68:11401:x1875409531636224:12345-192.168.202.41@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788530285.143459:0:6502:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:3.0:1788530285.143481:0:6502:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000004:00080000:3.0:1788530285.143679:0:6502:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00010000:00010000:1.0:1788530285.143793:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031400/0xb28d70e125750bbf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.143808:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031400/0xb28d70e125750bbf lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.143819:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031400/0xb28d70e125750bbf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.143826:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f00031400 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:1.0:1788530285.143849:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031400/0xb28d70e125750bbf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.143858:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031400/0xb28d70e125750bbf lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.143896:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9a9e0241da00) 00010000:00010000:1.0:1788530285.143900:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788530285.143907:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031400/0xb28d70e125750bbf lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.143915:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031400/0xb28d70e125750bbf lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.143948:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea200/0xb28d70e125750c67 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.143965:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea200/0xb28d70e125750c67 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.143971:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea200/0xb28d70e125750c67 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.143976:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f012ea200 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:1.0:1788530285.143979:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea200/0xb28d70e125750c67 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.143985:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea200/0xb28d70e125750c67 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.143993:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a9f2b996a00) 00010000:00010000:1.0:1788530285.143996:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788530285.144007:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea200/0xb28d70e125750c67 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.144013:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea200/0xb28d70e125750c67 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.144033:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea400/0xb28d70e125750ce5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.144040:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea400/0xb28d70e125750ce5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.144045:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea400/0xb28d70e125750ce5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.144050:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f012ea400 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:1.0:1788530285.144053:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea400/0xb28d70e125750ce5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.144058:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea400/0xb28d70e125750ce5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.144065:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9a9f32abde00) 00010000:00010000:1.0:1788530285.144068:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788530285.144070:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea400/0xb28d70e125750ce5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.144075:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea400/0xb28d70e125750ce5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.144084:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ce00/0xb28d70e125750d08 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.144100:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ce00/0xb28d70e125750d08 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.144107:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ce00/0xb28d70e125750d08 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.144112:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d20ce00 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:1.0:1788530285.144115:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ce00/0xb28d70e125750d08 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.144122:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ce00/0xb28d70e125750d08 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.144131:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9a9f32abde00) 00010000:00010000:1.0:1788530285.144133:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788530285.144136:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ce00/0xb28d70e125750d08 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.144142:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ce00/0xb28d70e125750d08 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.144169:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea000/0xb28d70e125750dda lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.144176:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea000/0xb28d70e125750dda lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.144182:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea000/0xb28d70e125750dda lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.144187:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f012ea000 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:1.0:1788530285.144196:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea000/0xb28d70e125750dda lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.144203:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea000/0xb28d70e125750dda lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.144211:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a9f2b996600) 00010000:00010000:1.0:1788530285.144213:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788530285.144216:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea000/0xb28d70e125750dda lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.144221:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea000/0xb28d70e125750dda lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.144233:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e125750e97 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.144239:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e125750e97 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.144244:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e125750e97 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.144249:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d101c00 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:1.0:1788530285.144252:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e125750e97 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.144258:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e125750e97 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.144267:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9a9e0241dd00) 00010000:00010000:1.0:1788530285.144269:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788530285.144279:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e125750e97 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.144285:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e125750e97 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530285.144733:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788530285.144761:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03c5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555839488:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788530285.144901:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530285.145157:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555839488 00000100:00100000:0.0:1788530285.145170:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555839488 00000100:00100000:0.0:1788530285.145255:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788530285.145268:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f06273100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555839488:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1788530285.145460:0:8752:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788530285.145464:0:8752:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1788530284 00002000:00010000:0.0:1788530285.145466:0:8752:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788530285.145469:0:8752:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1788530284 -> 1788530284 00002000:00010000:0.0:1788530285.145471:0:8752:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1788530285.145518:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f06273100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3650:x1875409555839488:12345-0@lo:2:osp-syn-1-0.0 Request processed in 253us (618us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1788530285.145527:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:0.0:1788530285.145549:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788530285.145615:0:3650:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:0.0:1788530285.145621:0:3650:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:0.0:1788530285.145649:0:3650:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9a9e03c5b800 x1875409555839488/t4294967311(4294967311) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1788530301 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1788530285.145662:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a9e03c5b800/2, rc 0, transno 4294967311 00000100:00100000:0.0:1788530285.145668:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03c5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555839488:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788530285.146033:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f05f45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555839360:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788530285.146076:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530285.146127:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555839360 00000100:00100000:1.0:1788530285.146133:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555839360 00000100:00100000:1.0:1788530285.146235:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788530285.146244:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03ee1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3648:x1875409555839360:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788530285.146269:0:8439:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00010000:00010000:1.0:1788530285.146303:0:8439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089f84ccb/0xb28d70e125750ec1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.146335:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d8c35e1e/0xb28d70e125750c75 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550967 expref: 9 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.146346:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=3s v=(0 0) 00010000:00010000:1.0:1788530285.146351:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788530285.146357:0:8439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000089f84ccb/0xb28d70e125750ec1 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.146400:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d8c35e1e/0xb28d70e125750c75 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550967 expref: 9 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.146416:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d8c35e1e/0xb28d70e125750c75 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550967 expref: 9 pid: 8752 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530285.146453:0:8439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03ee2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8439:1875409555839616:192.168.202.41@tcp:104: 00000100:00100000:1.0:1788530285.146544:0:8439:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e03639600 going to sleep for 11 seconds 00000100:00100000:1.0:1788530285.147026:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788530285.147040:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03e8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555839744:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788530285.147083:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530285.147327:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555839744 00000100:00100000:2.0:1788530285.147335:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555839744 00000100:00100000:2.0:1788530285.147392:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788530285.147401:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03ee2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3649:x1875409555839744:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788530285.147426:0:8752:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00002000:00010000:2.0:1788530285.147466:0:8752:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a9ace6a, atime: 0x6a9ace6b, ctime: 0x6a9ace6a, blocks: 0x8 00010000:00010000:2.0:1788530285.147474:0:8752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038101456/0xb28d70e125750ec8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530285.147489:0:8752:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=493s v=(0 0) 00010000:00010000:2.0:1788530285.147493:0:8752:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788530285.147500:0:8752:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000038101456/0xb28d70e125750ec8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530285.147535:0:8752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000038101456/0xb28d70e125750ec8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530285.147546:0:8752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038101456/0xb28d70e125750ec8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530285.147554:0:8752:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000038101456/0xb28d70e125750ec8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530285.147599:0:8752:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:0.0:1788530285.147690:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788530285.147701:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788530285.147708:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000038101456/0xb28d70e125750ec8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.147730:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d20d600 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:0.0:1788530285.147735:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000038101456/0xb28d70e125750ec8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.147744:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000038101456/0xb28d70e125750ec8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.147766:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000038101456/0xb28d70e125750ec8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.147774:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000038101456/0xb28d70e125750ec8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.147799:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530285.147801:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530285.147803:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788530285.149299:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03ee2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3649:x1875409555839744:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1890us (2205us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788530285.149313:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000004:00080000:1.0:1788530285.149599:0:3649:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a9e03e8a680/2, rc 0, transno 4294967305 00000100:00100000:1.0:1788530285.149615:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03e8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555839744:0@lo:6:osp-syn-0-0.0 00000020:00080000:3.0:1788530285.149876:0:6502:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a9f0a96b180 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:3.0:1788530285.149882:0:6502:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a9e02572500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a9f05781f00 00000020:00080000:3.0:1788530285.149893:0:6502:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a9e02572000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a9e0240ec00 00000004:00080000:3.0:1788530285.149926:0:6502:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:3.0:1788530285.150095:0:6502:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a9f3d05a0c0 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:3.0:1788530285.150100:0:6502:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a9e02572200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a9f3d05a9c0 00000020:00080000:3.0:1788530285.150102:0:6502:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a9e02572100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a9f03d88e00 00000020:00080000:3.0:1788530285.150138:0:6555:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:3.0:1788530285.150212:0:6555:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1788530285.150451:0:10719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03e89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+16:11401:x1875409531636224:12345-192.168.202.41@tcp:44:lhsmtool_posix.0 Request processed in 10330us (12077us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530285.150465:0:10719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 136 00000100:00100000:2.0:1788530285.155203:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530285.156625:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531636352 00000100:00100000:0.0:1788530285.156641:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531636352 00000100:00100000:0.0:1788530285.156725:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 52 00000100:00100000:0.0:1788530285.156740:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37377480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+10:2400:x1875409531636352:12345-192.168.202.41@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1788530285.160413:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:3.0:1788530285.160440:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000100:00100000:0.0:1788530285.161187:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37377480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+7:2400:x1875409531636352:12345-192.168.202.41@tcp:16:lhsmtool_posix.0 Request processed in 4441us (5991us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530285.161224:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 52 00000100:00100000:3.0:1788530285.164207:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530285.164386:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531636480 00000100:00100000:2.0:1788530285.164400:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531636480 00010000:00010000:2.0:1788530285.164462:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d8c35e1e/0xb28d70e125750c75 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550967 expref: 7 pid: 8752 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530285.164525:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 81 00000100:00100000:2.0:1788530285.164537:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03ede300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+7:2399:x1875409531636480:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788530285.164603:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788530285.164612:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d8c35e1e/0xb28d70e125750c75 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550967 expref: 7 pid: 8752 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530285.164664:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d8c35e1e/0xb28d70e125750c75 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550967 expref: 7 pid: 8752 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530285.164701:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788530285.164708:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788530285.164718:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000089f84ccb/0xb28d70e125750ec1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530285.164730:0:6509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000089f84ccb/0xb28d70e125750ec1 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530285.164756:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788530285.164824:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03ede300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+7:2399:x1875409531636480:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 288us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530285.164832:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 81 00010000:00010000:1.0:1788530285.169600:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d8c35e1e/0xb28d70e125750c75 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550967 expref: 6 pid: 8752 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530285.169633:0:8439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03ee2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8439:1875409555839616:192.168.202.41@tcp:104: 00010000:00010000:1.0:1788530285.169673:0:8439:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000089f84ccb/0xb28d70e125750ec1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.169686:0:8439:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000089f84ccb/0xb28d70e125750ec1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.169695:0:8439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000089f84ccb/0xb28d70e125750ec1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.169709:0:8439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089f84ccb/0xb28d70e125750ec1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.169750:0:8439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000089f84ccb/0xb28d70e125750ec1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.169789:0:8439:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788530285.169974:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00010000:00010000:2.0:1788530285.170388:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788530285.170400:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000089f84ccb/0xb28d70e125750ec1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530285.170410:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f012eba00 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:2.0:1788530285.170415:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000089f84ccb/0xb28d70e125750ec1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530285.170427:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000089f84ccb/0xb28d70e125750ec1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530285.170468:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000089f84ccb/0xb28d70e125750ec1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530285.170479:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530285.170481:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530285.170483:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530285.170522:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000089f84ccb/0xb28d70e125750ec1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530285.171621:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03ee1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3648:x1875409555839360:12345-0@lo:6:osp-syn-1-0.0 Request processed in 25318us (25484us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1788530285.171636:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788530285.172376:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531636736 00000100:00100000:0.0:1788530285.172397:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531636736 00000100:00100000:0.0:1788530285.172522:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 137 00000100:00100000:0.0:1788530285.172533:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03edc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+16:11401:x1875409531636736:12345-192.168.202.41@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788530285.172657:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788530285.172708:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e125750eac lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a01 expref: 16 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.172737:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9a9e0241dd00) 00010000:00010000:0.0:1788530285.172743:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788530285.172784:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101400/0xb28d70e125750ecf lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.172801:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101400/0xb28d70e125750ecf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.172812:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101400/0xb28d70e125750ecf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788530285.173001:0:6524:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d80b7826 reply state 000000002c72a5ed transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101400/0xb28d70e125750ecf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.173014:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101400/0xb28d70e125750ecf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.173020:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9a9e0241dd00) 00010000:00010000:0.0:1788530285.173024:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788530285.173046:0:6524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788530285.173229:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03edc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+17:11401:x1875409531636736:12345-192.168.202.41@tcp:36:lhsmtool_posix.0 Request processed in 697us (3257us total) trans 4294967403 rc 0/0 00000100:00100000:0.0:1788530285.173238:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 137 00000100:00100000:3.0:1788530285.173751:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:3.0:1788530285.173760:0:3648:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a9e03c5b800, transno 4294967311 00000100:00100000:3.0:1788530285.173781:0:3648:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9a9f05f45500 x1875409555839360/t4294967312(4294967312) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788530301 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1788530285.173814:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a9f05f45500/2, rc 0, transno 4294967312 00000100:00100000:3.0:1788530285.173822:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f05f45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555839360:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788530285.178277:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530285.178495:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531636864 00000100:00100000:2.0:1788530285.178509:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531636864 00000100:00100000:2.0:1788530285.178636:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 53 00000100:00100000:2.0:1788530285.178648:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03edce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:2399:x1875409531636864:12345-192.168.202.41@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788530285.178841:0:8752:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1788530285.178844:0:8752:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 1788530284 -> 1788530283 00002000:00010000:2.0:1788530285.178847:0:8752:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1788530283 00002000:00010000:2.0:1788530285.178849:0:8752:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1788530284 -> 1788530283 00002000:00010000:2.0:1788530285.178851:0:8752:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1788530285.180206:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03edce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+7:2399:x1875409531636864:12345-192.168.202.41@tcp:2:lhsmtool_posix.0 Request processed in 304us (688us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1788530285.180222:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 53 00000100:00100000:1.0:1788530285.183243:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530285.183397:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531637120 00000100:00100000:0.0:1788530285.183413:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531637120 00000100:00100000:0.0:1788530285.183520:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 138 00000100:00100000:0.0:1788530285.183535:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03ee2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+17:11401:x1875409531637120:12345-192.168.202.41@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788530285.183940:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eba00/0xb28d70e125750ed6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.184028:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100400/0xb28d70e125750e90 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5509f3 expref: 17 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.184041:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eba00/0xb28d70e125750ed6 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.184102:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100400/0xb28d70e125750e90 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a5509f3 expref: 17 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.184123:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100400/0xb28d70e125750e90 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a5509f3 expref: 17 pid: 6523 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530285.184146:0:6525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03ee1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6525:1875409555839872:192.168.202.41@tcp:104: 00000100:00100000:1.0:1788530285.184352:0:6525:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e03639780 going to sleep for 11 seconds 00000100:00100000:1.0:1788530285.187555:0:6525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03ee1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6525:1875409555839872:192.168.202.41@tcp:104: 00010000:00010000:1.0:1788530285.187752:0:6525:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eba00/0xb28d70e125750ed6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530285.189837:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530285.190265:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531637248 00000100:00100000:2.0:1788530285.190278:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531637248 00010000:00010000:2.0:1788530285.190329:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100400/0xb28d70e125750e90 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a5509f3 expref: 18 pid: 6523 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530285.190416:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 82 00000100:00100000:2.0:1788530285.190428:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03ee1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+18:2400:x1875409531637248:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788530285.190469:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788530285.190476:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100400/0xb28d70e125750e90 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a5509f3 expref: 18 pid: 6523 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530285.190491:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100400/0xb28d70e125750e90 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a5509f3 expref: 18 pid: 6523 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530285.190516:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100400/0xb28d70e125750e90 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a5509f3 expref: 18 pid: 6523 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530285.190536:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9a9e0241dd00) 00010000:00010000:2.0:1788530285.190542:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eba00/0xb28d70e125750ed6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530285.190552:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eba00/0xb28d70e125750ed6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530285.190601:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eba00/0xb28d70e125750ed6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530285.190650:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788530285.190724:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03ee1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+17:2400:x1875409531637248:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 297us (898us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530285.190732:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 82 00010000:00010000:1.0:1788530285.191232:0:6525:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eba00/0xb28d70e125750ed6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.191243:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eba00/0xb28d70e125750ed6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.191289:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eba00/0xb28d70e125750ed6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.191298:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eba00/0xb28d70e125750ed6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.191307:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eba00/0xb28d70e125750ed6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.191315:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f012eba00 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:1.0:1788530285.191320:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eba00/0xb28d70e125750ed6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.191331:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eba00/0xb28d70e125750ed6 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.191345:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9a9e0241dd00) 00010000:00010000:1.0:1788530285.191349:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788530285.191353:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eba00/0xb28d70e125750ed6 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.191371:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eba00/0xb28d70e125750ed6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530285.191444:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03ee2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+16:11401:x1875409531637120:12345-192.168.202.41@tcp:55:lhsmtool_posix.0 Request processed in 7910us (8217us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788530285.191453:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 138 00000100:00100000:3.0:1788530285.194109:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530285.194374:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531637376 00000100:00100000:0.0:1788530285.194385:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531637376 00000100:00100000:0.0:1788530285.194464:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 54 00000100:00100000:0.0:1788530285.194473:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03edd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+7:2399:x1875409531637376:12345-192.168.202.41@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788530285.194516:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008d24c096/0xb28d70e125750edd lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.194538:0:8438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000db00bf6e/0xb28d70e125750eba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a0f expref: 7 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.194546:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788530285.194551:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788530285.194556:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d24c096/0xb28d70e125750edd lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.194839:0:8438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000db00bf6e/0xb28d70e125750eba lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a0f expref: 7 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.194856:0:8438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000db00bf6e/0xb28d70e125750eba lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a0f expref: 7 pid: 8436 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530285.194902:0:8438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f06273b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8438:1875409555840000:192.168.202.41@tcp:104: 00000100:00100000:0.0:1788530285.195002:0:8438:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f07d23480 going to sleep for 11 seconds 00000100:00100000:2.0:1788530285.198873:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530285.198961:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531637504 00000100:00100000:1.0:1788530285.198969:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531637504 00010000:00010000:1.0:1788530285.199005:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000db00bf6e/0xb28d70e125750eba lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a0f expref: 8 pid: 8436 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530285.199041:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 83 00000100:00100000:1.0:1788530285.199048:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f396c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+8:2399:x1875409531637504:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788530285.199060:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788530285.199079:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000db00bf6e/0xb28d70e125750eba lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a0f expref: 8 pid: 8436 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.199091:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000db00bf6e/0xb28d70e125750eba lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a0f expref: 8 pid: 8436 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.199113:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788530285.199116:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788530285.199122:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008d24c096/0xb28d70e125750edd lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.199132:0:6509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d24c096/0xb28d70e125750edd lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.199299:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788530285.199346:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f396c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+8:2399:x1875409531637504:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 298us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530285.199351:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 83 00010000:00010000:0.0:1788530285.205217:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000db00bf6e/0xb28d70e125750eba lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a0f expref: 7 pid: 8436 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530285.205247:0:8438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f06273b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8438:1875409555840000:192.168.202.41@tcp:104: 00010000:00010000:0.0:1788530285.205285:0:8438:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008d24c096/0xb28d70e125750edd lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.205429:0:8438:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008d24c096/0xb28d70e125750edd lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.205438:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008d24c096/0xb28d70e125750edd lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.205479:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008d24c096/0xb28d70e125750edd lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.205486:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008d24c096/0xb28d70e125750edd lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.205494:0:8438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008d24c096/0xb28d70e125750edd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.205499:0:8438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d100000 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:1.0:1788530285.205502:0:8438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008d24c096/0xb28d70e125750edd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.205510:0:8438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008d24c096/0xb28d70e125750edd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.205837:0:8438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008d24c096/0xb28d70e125750edd lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.205848:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008d24c096/0xb28d70e125750edd lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530285.206071:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03edd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:2399:x1875409531637376:12345-192.168.202.41@tcp:1:lhsmtool_posix.0 Request processed in 11596us (11972us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530285.206084:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 54 00000100:00100000:2.0:1788530285.209634:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530285.209786:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531637760 00000100:00100000:0.0:1788530285.209797:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531637760 00000100:00100000:0.0:1788530285.209905:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 139 00000100:00100000:0.0:1788530285.209918:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37374a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+16:11401:x1875409531637760:12345-192.168.202.41@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788530285.210033:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e125750ee4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.210065:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb600/0xb28d70e125750dd3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5509bb expref: 16 pid: 10719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.210077:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e125750ee4 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.210125:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb600/0xb28d70e125750dd3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a5509bb expref: 16 pid: 10719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.210177:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb600/0xb28d70e125750dd3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a5509bb expref: 16 pid: 10719 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530285.210197:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f06273b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6523:1875409555840128:192.168.202.41@tcp:104: 00000100:00100000:0.0:1788530285.210305:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f07d23480 going to sleep for 11 seconds 00000100:00100000:2.0:1788530285.215212:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530285.215299:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531637888 00000100:00100000:1.0:1788530285.215312:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531637888 00010000:00010000:1.0:1788530285.215362:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb600/0xb28d70e125750dd3 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a5509bb expref: 17 pid: 10719 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530285.215407:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 84 00000100:00100000:1.0:1788530285.215419:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03734700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+17:2399:x1875409531637888:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788530285.215436:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788530285.215444:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb600/0xb28d70e125750dd3 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a5509bb expref: 17 pid: 10719 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.215461:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb600/0xb28d70e125750dd3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a5509bb expref: 17 pid: 10719 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.215492:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a9f2b996600) 00010000:00010000:1.0:1788530285.215499:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea800/0xb28d70e125750e35 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5509de expref: 17 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.215530:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e125750ee4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.215539:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e125750ee4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.215546:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e125750ee4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.215617:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788530285.215688:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03734700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+17:2399:x1875409531637888:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 271us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530285.215696:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 84 00010000:00010000:0.0:1788530285.217222:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb600/0xb28d70e125750dd3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a5509bb expref: 16 pid: 10719 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530285.217254:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f06273b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6523:1875409555840128:192.168.202.41@tcp:104: 00010000:00010000:0.0:1788530285.217290:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e125750ee4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.217302:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e125750ee4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.217308:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e125750ee4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.217589:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e125750eeb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.217612:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101a00/0xb28d70e125750e9e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5509fa expref: 16 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.217622:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e125750eeb lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.217664:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101a00/0xb28d70e125750e9e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a5509fa expref: 16 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.217699:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101a00/0xb28d70e125750e9e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a5509fa expref: 16 pid: 6525 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530285.217718:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f06273b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6523:1875409555840256:192.168.202.41@tcp:104: 00000100:00100000:0.0:1788530285.217818:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f07d23600 going to sleep for 11 seconds 00000100:00100000:0.0:1788530285.223207:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f06273b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6523:1875409555840256:192.168.202.41@tcp:104: 00010000:00010000:0.0:1788530285.223246:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e125750eeb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530285.224636:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530285.225034:0:10347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531638016 00000100:00100000:2.0:1788530285.225047:0:10347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531638016 00010000:00010000:2.0:1788530285.225115:0:10347:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101a00/0xb28d70e125750e9e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a5509fa expref: 17 pid: 6525 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530285.225167:0:10347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 85 00000100:00100000:2.0:1788530285.225178:0:10347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03ede680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+17:2400:x1875409531638016:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788530285.225192:0:10347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788530285.225198:0:10347:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101a00/0xb28d70e125750e9e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a5509fa expref: 17 pid: 6525 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530285.225211:0:10347:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101a00/0xb28d70e125750e9e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a5509fa expref: 17 pid: 6525 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530285.225233:0:10347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101a00/0xb28d70e125750e9e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a5509fa expref: 17 pid: 6525 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530285.225251:0:10347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9a9e0241dd00) 00010000:00010000:2.0:1788530285.225256:0:10347:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e125750eeb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530285.225265:0:10347:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e125750eeb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530285.225273:0:10347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e125750eeb lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530285.225301:0:10347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788530285.225364:0:10347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03ede680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+16:2400:x1875409531638016:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 187us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530285.225372:0:10347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 85 00010000:00010000:0.0:1788530285.225467:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e125750eeb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.225476:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e125750eeb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788530285.225627:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:0.0:1788530285.225750:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:0.0:1788530285.225786:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:0.0:1788530285.225866:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f06273b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6523:1875409555840384:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788530285.225933:0:6523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530285.225967:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f328d7e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788530285.226096:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555840384 00000100:00100000:2.0:1788530285.226102:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555840384 00000100:00100000:2.0:1788530285.226135:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1788530285.226143:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f06271180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6523:x1875409555840384:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788530285.226250:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f06271180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6523:x1875409555840384:12345-0@lo:1000:mdt00_000.0 Request processed in 107us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530285.226257:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1788530285.226514:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f06273b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6523:1875409555840384:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1788530285.228295:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:2.0:1788530285.228742:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d3fb100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6523:1875409555840512:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788530285.228833:0:6523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530285.228865:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f33e24780 going to sleep for 11 seconds 00000100:00100000:1.0:1788530285.229159:0:14186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555840512 00000100:00100000:1.0:1788530285.229171:0:14186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555840512 00000100:00100000:1.0:1788530285.229248:0:14186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1788530285.229261:0:14186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6523:x1875409555840512:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788530285.229463:0:14186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6523:x1875409555840512:12345-0@lo:1000:mdt00_000.0 Request processed in 203us (628us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1788530285.229472:0:14186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788530285.229733:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d3fb100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6523:1875409555840512:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1788530285.229786:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e125750eeb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.229798:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e125750eeb lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.229824:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e125750eeb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.229832:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d101800 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:0.0:1788530285.229837:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e125750eeb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.229845:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e125750eeb lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.229862:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9a9e0241dd00) 00010000:00010000:0.0:1788530285.229865:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788530285.229871:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e125750eeb lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.229879:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e125750eeb lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.229927:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea600/0xb28d70e125750e2e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.229934:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea600/0xb28d70e125750e2e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.229941:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea600/0xb28d70e125750e2e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.229946:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f012ea600 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:0.0:1788530285.229949:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea600/0xb28d70e125750e2e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.229965:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea600/0xb28d70e125750e2e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.229973:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a9f2b996600) 00010000:00010000:0.0:1788530285.229976:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788530285.229984:0:6523:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea800/0xb28d70e125750e35 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5509de expref: 19 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.229998:0:6523:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea800/0xb28d70e125750e35 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5509de expref: 19 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.230008:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea800/0xb28d70e125750e35 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5509de expref: 19 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.230050:0:6523:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea800/0xb28d70e125750e35 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5509de expref: 19 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530285.230064:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f06272680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6523:1875409555840640:192.168.202.41@tcp:105: 00000100:00100000:0.0:1788530285.230256:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f328d7c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788530285.235233:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f06272680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6523:1875409555840640:192.168.202.41@tcp:105: 00010000:00010000:0.0:1788530285.235283:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea600/0xb28d70e125750e2e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.235296:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea600/0xb28d70e125750e2e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.235339:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101000/0xb28d70e125750ef2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.235375:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101000/0xb28d70e125750ef2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.235389:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101000/0xb28d70e125750ef2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.235402:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101000/0xb28d70e125750ef2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.235409:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101000/0xb28d70e125750ef2 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.235416:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101000/0xb28d70e125750ef2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.235423:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d101000 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:0.0:1788530285.235427:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101000/0xb28d70e125750ef2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.235435:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101000/0xb28d70e125750ef2 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.235447:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a9f2b996600) 00010000:00010000:0.0:1788530285.235451:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788530285.235455:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101000/0xb28d70e125750ef2 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.235461:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101000/0xb28d70e125750ef2 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.235472:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e125750ee4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.235487:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e125750ee4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.235493:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e125750ee4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.235499:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d100c00 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:0.0:1788530285.235502:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e125750ee4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.235509:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e125750ee4 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.235517:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a9f2b996600) 00010000:00010000:0.0:1788530285.235519:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788530285.235522:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e125750ee4 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.235528:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e125750ee4 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530285.235757:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37374a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+19:11401:x1875409531637760:12345-192.168.202.41@tcp:57:lhsmtool_posix.0 Request processed in 25840us (26149us total) trans 4294967408 rc 0/0 00000100:00100000:0.0:1788530285.235767:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 139 00000020:00080000:0.0:1788530285.235773:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1788530285.236405:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530285.236690:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531638144 00000100:00100000:1.0:1788530285.236703:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531638144 00000100:00100000:1.0:1788530285.236764:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 31 00000100:00100000:1.0:1788530285.236774:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+19:11400:x1875409531638144:12345-192.168.202.41@tcp:49:lfs.0 00000100:00100000:1.0:1788530285.236899:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+19:11400:x1875409531638144:12345-192.168.202.41@tcp:49:lfs.0 Request processed in 126us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530285.236906:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 31 00000040:00080000:3.0:1788530285.237406:0:13811:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788530285.237412:0:13811:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788530285.237434:0:13811:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:3.0:1788530285.237443:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788530285.239799:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530285.239933:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530285.242539:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531638656 00000100:00100000:0.0:1788530285.242556:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531638656 00000100:00100000:0.0:1788530285.242659:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 140 00000100:00100000:0.0:1788530285.242671:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+19:11400:x1875409531638656:12345-192.168.202.41@tcp:58:lfs.0 00000040:00080000:0.0:1788530285.242892:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:0.0:1788530285.243007:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+19:11400:x1875409531638656:12345-192.168.202.41@tcp:58:lfs.0 Request processed in 338us (3072us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530285.243015:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 140 00000100:00100000:1.0:1788530285.247100:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531638400 00000100:00100000:1.0:1788530285.247117:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531638400 00000100:00100000:1.0:1788530285.247605:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 32 00000100:00100000:1.0:1788530285.247618:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3959c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+19:11401:x1875409531638400:12345-192.168.202.41@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788530285.247911:0:6526:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788530285.247945:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:1.0:1788530285.247990:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea200/0xb28d70e125750ef9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.248013:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea200/0xb28d70e125750ef9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.248026:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea200/0xb28d70e125750ef9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.248036:0:6526:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea200/0xb28d70e125750ef9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.248043:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea200/0xb28d70e125750ef9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.248051:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea200/0xb28d70e125750ef9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.248073:0:6526:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788530285.248216:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3959c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+21:11401:x1875409531638400:12345-192.168.202.41@tcp:35:lhsmtool_posix.0 Request processed in 599us (8425us total) trans 4294967410 rc 0/0 00000100:00100000:1.0:1788530285.248225:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 32 00000020:00080000:1.0:1788530285.248231:0:6526:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788530285.249105:0:10348:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788530285.249116:0:10348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea200/0xb28d70e125750ef9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.249126:0:10348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f012ea200 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:0.0:1788530285.249132:0:10348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea200/0xb28d70e125750ef9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.249141:0:10348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea200/0xb28d70e125750ef9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.249159:0:10348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9a9e0241dd00) 00010000:00010000:0.0:1788530285.249162:0:10348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788530285.249168:0:10348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea200/0xb28d70e125750ef9 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.249174:0:10348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea200/0xb28d70e125750ef9 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.249190:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530285.249192:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530285.249193:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788530285.292138:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530285.292245:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531638784 00000100:00100000:3.0:1788530285.292254:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531638784 00000100:00100000:3.0:1788530285.292364:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 141 00000100:00100000:3.0:1788530285.292375:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+21:11403:x1875409531638784:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:3.0:1788530285.292398:0:10720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788530285.292419:0:10720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e125750f00 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550a16 expref: -99 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530285.292485:0:10720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b400/0xb28d70e125750f07 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530285.292514:0:10720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b400/0xb28d70e125750f07 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530285.292527:0:10720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b400/0xb28d70e125750f07 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530285.292584:0:10720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e125750f0e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530285.292593:0:10720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e125750f0e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530285.292611:0:10720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e125750f0e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530285.292872:0:10720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36ae00/0xb28d70e125750f15 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530285.292893:0:10720:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36be00/0xb28d70e125750e20 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5509d7 expref: 22 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530285.292902:0:10720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36ae00/0xb28d70e125750f15 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530285.292939:0:10720:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36be00/0xb28d70e125750e20 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a5509d7 expref: 22 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530285.292953:0:10720:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36be00/0xb28d70e125750e20 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a5509d7 expref: 22 pid: 8678 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530285.292968:0:10720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03edc700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:10720:1875409555840768:192.168.202.41@tcp:104: 00000100:00100000:3.0:1788530285.293079:0:10720:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f396d50c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788530285.295512:0:10720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03edc700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:10720:1875409555840768:192.168.202.41@tcp:104: 00010000:00010000:0.0:1788530285.295544:0:10720:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36ae00/0xb28d70e125750f15 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530285.295755:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530285.296002:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531639040 00000100:00100000:2.0:1788530285.296010:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531639040 00000100:00100000:2.0:1788530285.296061:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 33 00000100:00100000:2.0:1788530285.296072:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03edc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+23:6176:x1875409531639040:12345-192.168.202.41@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788530285.296474:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03edc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+24:6176:x1875409531639040:12345-192.168.202.41@tcp:35:ldlm_bl.0 Request processed in 403us (719us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1788530285.296483:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 33 00000100:00100000:0.0:1788530285.302056:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530285.302412:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531639168 00000100:00100000:1.0:1788530285.302425:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531639168 00010000:00010000:1.0:1788530285.302491:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36be00/0xb28d70e125750e20 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a5509d7 expref: 24 pid: 8678 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530285.302947:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 86 00000100:00100000:1.0:1788530285.302960:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f06272680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+24:2399:x1875409531639168:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788530285.302979:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788530285.302987:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36be00/0xb28d70e125750e20 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a5509d7 expref: 24 pid: 8678 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.303003:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36be00/0xb28d70e125750e20 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a5509d7 expref: 24 pid: 8678 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.303030:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36be00/0xb28d70e125750e20 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a5509d7 expref: 24 pid: 8678 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.303049:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a9f2b996600) 00010000:00010000:1.0:1788530285.303055:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36ae00/0xb28d70e125750f15 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.303067:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36ae00/0xb28d70e125750f15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.303076:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36ae00/0xb28d70e125750f15 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530285.303116:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788530285.303315:0:10720:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36ae00/0xb28d70e125750f15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.303324:0:10720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36ae00/0xb28d70e125750f15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788530285.303395:0:10720:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788530285.303401:0:10720:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788530285.303426:0:10720:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36ae00/0xb28d70e125750f15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.303442:0:10720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36ae00/0xb28d70e125750f15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.303452:0:10720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b400/0xb28d70e125750f07 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.303458:0:10720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b400/0xb28d70e125750f07 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.303464:0:10720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b400/0xb28d70e125750f07 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.303470:0:10720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d36b400 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:0.0:1788530285.303474:0:10720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b400/0xb28d70e125750f07 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.303482:0:10720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b400/0xb28d70e125750f07 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.303491:0:10720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a9e0241d100) 00000100:00100000:1.0:1788530285.304004:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f06272680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+23:2399:x1875409531639168:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 1037us (1950us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530285.304017:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 86 00010000:00010000:0.0:1788530285.304107:0:10720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788530285.304114:0:10720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b400/0xb28d70e125750f07 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.304122:0:10720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b400/0xb28d70e125750f07 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.304142:0:10720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e125750f0e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.304158:0:10720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e125750f0e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.304165:0:10720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e125750f0e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.304171:0:10720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d36b800 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:0.0:1788530285.304174:0:10720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e125750f0e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.304181:0:10720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e125750f0e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.304192:0:10720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9a9f0cf59e00) 00010000:00010000:0.0:1788530285.304195:0:10720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788530285.304198:0:10720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e125750f0e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.304203:0:10720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e125750f0e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.304253:0:10720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e125750f00 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a16 expref: 23 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.304282:0:10720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36ae00/0xb28d70e125750f15 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a16 expref: 22 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530285.304290:0:10720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a9f2b996600) 00010000:00010000:0.0:1788530285.304293:0:10720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788530285.304296:0:10720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d36ae00, rc 0) 00000100:00100000:0.0:1788530285.304332:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+22:11403:x1875409531638784:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 11959us (12205us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530285.304339:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 141 00000100:00100000:2.0:1788530285.633086:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03ee1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555840896:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788530285.633217:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530285.633796:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555840896 00000100:00100000:1.0:1788530285.633806:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555840896 00000100:00100000:1.0:1788530285.633889:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788530285.633904:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1875409555840896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788530285.633939:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33943232 pending 0 free 3923509248 avail 3691958272 00000100:00100000:1.0:1788530285.634003:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1875409555840896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (786us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530285.634012:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788530285.634982:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f06272d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3649:1875409555841152:0@lo:400:kworker.0 00000100:00100000:1.0:1788530285.635047:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530285.635086:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f06273480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875409555841664:0@lo:400:kworker.0 00000100:00100000:1.0:1788530285.635119:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530285.635216:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788530285.635225:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f06271f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875409555841280:0@lo:400:kworker.0 00000100:00100000:1.0:1788530285.635254:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530285.635272:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f06271c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875409555841792:0@lo:400:kworker.0 00000100:00100000:1.0:1788530285.635292:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530285.635321:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555841664 00000100:00100000:1.0:1788530285.635327:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555841664 00000100:00100000:1.0:1788530285.635381:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555841280 00000100:00100000:1.0:1788530285.635385:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555841280 00000100:00100000:1.0:1788530285.635403:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555841792 00000100:00100000:1.0:1788530285.635407:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555841792 00000100:00100000:1.0:1788530285.635430:0:10719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:1.0:1788530285.635437:0:10719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03e88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875409555841664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530285.635476:0:10719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03e88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875409555841664:12345-0@lo:400:kworker.0 Request processed in 39us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530285.635501:0:10719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:0.0:1788530285.635746:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f06273800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875409555842304:0@lo:400:kworker.0 00000100:00100000:0.0:1788530285.635774:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530285.635788:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788530285.635793:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f06271500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875409555842176:0@lo:400:kworker.0 00000100:00100000:2.0:1788530285.635923:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f06270700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875409555841408:0@lo:400:kworker.0 00000100:00100000:0.0:1788530285.636030:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530285.636225:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555842304 00000100:00100000:1.0:1788530285.636230:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555842304 00000100:00100000:1.0:1788530285.636251:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555842176 00000100:00100000:1.0:1788530285.636254:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555842176 00000100:00100000:1.0:1788530285.636271:0:10719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:1.0:1788530285.636277:0:10719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03e8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875409555841280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530285.636309:0:10719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03e8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875409555841280:12345-0@lo:400:kworker.0 Request processed in 33us (1054us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530285.636316:0:10719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:1.0:1788530285.636331:0:10719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:1.0:1788530285.636336:0:10719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03691180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875409555841792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530285.636362:0:10719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03691180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875409555841792:12345-0@lo:400:kworker.0 Request processed in 26us (1069us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530285.636367:0:10719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:1.0:1788530285.636378:0:10719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1788530285.636382:0:10719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f06270a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875409555842304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530285.636415:0:10719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f06270a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875409555842304:12345-0@lo:400:kworker.0 Request processed in 33us (641us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530285.636421:0:10719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1788530285.636431:0:10719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1788530285.636436:0:10719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f06272300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875409555842176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530285.636476:0:10719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f06272300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875409555842176:12345-0@lo:400:kworker.0 Request processed in 40us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530285.636482:0:10719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1788530285.636644:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03ee3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555841024:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788530285.636686:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530285.636707:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f06270000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555841536:0@lo:400:kworker.0 00000100:00100000:3.0:1788530285.636730:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530285.636749:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03ee3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555842048:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788530285.636769:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530285.636800:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555841024 00000100:00100000:3.0:1788530285.636805:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555841024 00000100:00100000:3.0:1788530285.636862:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555842048 00000100:00100000:3.0:1788530285.637270:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555842048 00000100:00100000:3.0:1788530285.637296:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788530285.637304:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03edf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1875409555841024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788530285.637327:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1788530285.637367:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03edf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1875409555841024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530285.637373:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788530285.637388:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788530285.637394:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03ede300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555842048:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788530285.637403:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1788530285.637425:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03ede300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555842048:12345-0@lo:13:osp-pre-0-1.0 Request processed in 31us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530285.637430:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788530285.637450:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555841152 00000100:00100000:3.0:1788530285.637454:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555841152 00000100:00100000:3.0:1788530285.637479:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 440 00000100:00100000:3.0:1788530285.637485:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f396c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:3649:x1875409555841152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530285.637788:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f396c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:3649:x1875409555841152:12345-0@lo:400:kworker.0 Request processed in 302us (2740us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530285.637804:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 440 00000100:00100000:3.0:1788530285.638265:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555841536 00000100:00100000:3.0:1788530285.638271:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555841536 00000100:00100000:3.0:1788530285.638304:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1788530285.638312:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03edf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555841536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530285.638353:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03edf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555841536:12345-0@lo:400:kworker.0 Request processed in 43us (1622us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530285.638359:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1788530285.638449:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03c51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555842560:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788530285.638501:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530285.638989:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788530285.639022:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788530285.639028:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788530285.639031:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788530285.639045:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555841408 00000100:00100000:1.0:1788530285.639049:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555841408 00000100:00100000:1.0:1788530285.639110:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1788530285.639120:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875409555841408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530285.646085:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f06272a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555841920:0@lo:400:kworker.0 00000100:00100000:2.0:1788530285.646216:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530285.646254:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f06271880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555842432:0@lo:400:kworker.0 00000100:00100000:2.0:1788530285.646279:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530285.646353:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03ee1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555840896:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788530285.646421:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555841920 00000100:00100000:2.0:1788530285.646430:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555841920 00000100:00100000:2.0:1788530285.646481:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555842432 00000100:00100000:2.0:1788530285.646484:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555842432 00000100:00100000:2.0:1788530285.646533:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788530285.646545:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555841920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530285.646643:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555841920:12345-0@lo:400:kworker.0 Request processed in 100us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530285.646651:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788530285.646673:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788530285.646679:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555842432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530285.646710:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555842432:12345-0@lo:400:kworker.0 Request processed in 30us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530285.646716:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788530285.646745:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f06272a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555841920:0@lo:400:kworker.0 00000100:00100000:2.0:1788530285.646753:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f06271880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555842432:0@lo:400:kworker.0 00000100:00100000:2.0:1788530285.649598:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555842560 00000100:00100000:2.0:1788530285.649626:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555842560 00000100:00100000:2.0:1788530285.649684:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788530285.649694:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03effb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555842560:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788530285.649718:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33943232 pending 0 free 3923509248 avail 3691958272 00000100:00100000:2.0:1788530285.649803:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03effb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555842560:12345-0@lo:13:osp-pre-1-1.0 Request processed in 111us (11302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530285.649823:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788530285.656083:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875409555841408:12345-0@lo:400:kworker.0 Request processed in 16950us (17078us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530285.656106:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1788530285.656245:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f06271500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875409555842176:0@lo:400:kworker.0 00010000:00080000:1.0:1788530285.656268:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f06273800 x1875409555842304/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530301 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530285.656280:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f06273800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875409555842304:0@lo:400:kworker.0 00000100:00100000:1.0:1788530285.656333:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f06271f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875409555841280:0@lo:400:kworker.0 00010000:00080000:1.0:1788530285.656349:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f06271c00 x1875409555841792/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530301 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530285.656358:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f06271c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875409555841792:0@lo:400:kworker.0 00000100:00100000:1.0:1788530285.656370:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f06272d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3649:1875409555841152:0@lo:400:kworker.0 00000100:00100000:1.0:1788530285.656381:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f06273480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875409555841664:0@lo:400:kworker.0 00000100:00080000:1.0:1788530285.656405:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788530285.656965:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f06270700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875409555841408:0@lo:400:kworker.0 00000100:00100000:3.0:1788530285.657093:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03c51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555842560:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788530285.657115:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03ee3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555841024:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788530285.657130:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f06270000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555841536:0@lo:400:kworker.0 00000100:00100000:3.0:1788530285.657148:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03ee3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555842048:0@lo:13:osp-pre-0-1.0 00000040:00080000:3.0:1788530285.697328:0:13816:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788530285.769988:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788530286.099804:0:14276:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788530286.099813:0:14276:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788530286.099851:0:14276:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788530286.099857:0:14276:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1788530286.273789:0:13811:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788530286.273799:0:13811:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788530286.273834:0:13811:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788530286.273842:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788530286.274009:0:13811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03efd180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13811:1875409555842688:192.168.202.41@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788530286.274124:0:13811:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f396d5cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788530286.278477:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530286.278552:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531639296 00000100:00100000:2.0:1788530286.278606:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531639296 00000100:00100000:2.0:1788530286.278705:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 142 00000100:00100000:2.0:1788530286.278716:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f06270380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+23:11415:x1875409531639296:12345-192.168.202.41@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788530286.278752:0:6524:0:(mdt_handler.c:7977:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788530286.278888:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f06270380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+23:11415:x1875409531639296:12345-192.168.202.41@tcp:53:lhsmtool_posix.0 Request processed in 174us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530286.278895:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 142 00000100:00100000:3.0:1788530286.279957:0:13811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03efd180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13811:1875409555842688:192.168.202.41@tcp:107:hsm_cdtr.0 00000100:00080000:0.0:1788530286.280425:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788530286.282211:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530286.282364:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531639552 00000100:00100000:3.0:1788530286.282381:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531639552 00000100:00100000:3.0:1788530286.282454:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 143 00000100:00100000:3.0:1788530286.282463:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+22:11415:x1875409531639552:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788530286.282490:0:10720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788530286.282517:0:10720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b000/0xb28d70e125750f1c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550a1d expref: -99 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530286.282690:0:10720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36ac00/0xb28d70e125750f23 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530286.282706:0:10720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36ac00/0xb28d70e125750f23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530286.282721:0:10720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36ac00/0xb28d70e125750f23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788530286.282732:0:10720:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788530286.282856:0:10720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b000/0xb28d70e125750f1c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a1d expref: 25 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530286.282885:0:10720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36ac00/0xb28d70e125750f23 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a1d expref: 24 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530286.282894:0:10720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a9f2b996600) 00010000:00010000:3.0:1788530286.282898:0:10720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788530286.282903:0:10720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d36ac00, rc 0) 00000100:00100000:3.0:1788530286.282973:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+24:11415:x1875409531639552:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 511us (769us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1788530286.282980:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 143 00000100:00100000:3.0:1788530286.293723:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530286.295232:0:10347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531639680 00000100:00100000:0.0:1788530286.295253:0:10347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531639680 00000100:00100000:0.0:1788530286.295395:0:10347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 7 00000100:00100000:0.0:1788530286.295412:0:10347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03efd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+24:2400:x1875409531639680:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788530286.295439:0:10347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788530286.295478:0:10347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36ac00/0xb28d70e125750f23 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a1d expref: 24 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530286.295508:0:10347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a9f2b996600) 00010000:00010000:0.0:1788530286.295533:0:10347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788530286.295651:0:10347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03efd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+23:2400:x1875409531639680:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 243us (1952us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530286.295659:0:10347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 7 00000100:00100000:0.0:1788530286.305847:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530286.305921:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531639936 00000100:00100000:2.0:1788530286.305931:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531639936 00000100:00100000:2.0:1788530286.306000:0:10719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 144 00000100:00100000:2.0:1788530286.306011:0:10719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f06270e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+23:11415:x1875409531639936:12345-192.168.202.41@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788530286.306224:0:10719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ca00/0xb28d70e125750f31 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530286.306243:0:10719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ca00/0xb28d70e125750f31 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530286.306257:0:10719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ca00/0xb28d70e125750f31 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530286.306444:0:10719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ca00/0xb28d70e125750f31 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530286.306465:0:10719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ca00/0xb28d70e125750f31 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530286.306473:0:10719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ca00/0xb28d70e125750f31 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530286.306481:0:10719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d20ca00 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:2.0:1788530286.306486:0:10719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ca00/0xb28d70e125750f31 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530286.306494:0:10719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ca00/0xb28d70e125750f31 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530286.306507:0:10719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a9f2b996600) 00010000:00010000:2.0:1788530286.306510:0:10719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788530286.306516:0:10719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ca00/0xb28d70e125750f31 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530286.306522:0:10719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ca00/0xb28d70e125750f31 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788530286.307292:0:13811:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788530286.307300:0:13811:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788530286.307962:0:13811:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1788530286.307974:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788530286.308179:0:10719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f06270e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+24:11415:x1875409531639936:12345-192.168.202.41@tcp:57:lhsmtool_posix.0 Request processed in 2164us (2335us total) trans 4294967413 rc 0/0 00000100:00100000:2.0:1788530286.308190:0:10719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 144 00000100:00100000:0.0:1788530286.319490:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530286.319703:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531640192 00000100:00100000:2.0:1788530286.319719:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531640192 00000100:00100000:2.0:1788530286.319793:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 34 00000100:00100000:2.0:1788530286.319806:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f06270000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+24:11415:x1875409531640192:12345-192.168.202.41@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788530286.320977:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f06270000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+25:11415:x1875409531640192:12345-192.168.202.41@tcp:35:lhsmtool_posix.0 Request processed in 1163us (1491us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1788530286.320998:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 34 00000100:00100000:2.0:1788530286.571782:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530286.571846:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530286.571883:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530286.571919:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530286.571936:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530286.571958:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530286.571980:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530286.572008:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531640448 00000100:00100000:2.0:1788530286.572018:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531640448 00000100:00100000:2.0:1788530286.572084:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531640960 00000100:00100000:2.0:1788530286.572087:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531640960 00000100:00100000:2.0:1788530286.572119:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531640576 00000100:00100000:2.0:1788530286.572122:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531640576 00000100:00100000:0.0:1788530286.572290:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531641088 00000100:00100000:0.0:1788530286.572295:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531641088 00000100:00100000:0.0:1788530286.572327:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 359 00000100:00100000:0.0:1788530286.572340:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+25:2402:x1875409531640448:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1788530286.572449:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+25:2402:x1875409531640448:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 113us (687us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530286.572458:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 359 00000100:00100000:0.0:1788530286.572478:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 360 00000100:00100000:0.0:1788530286.572485:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2402:x1875409531640960:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1788530286.572509:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2402:x1875409531640960:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 25us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530286.572516:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 360 00000100:00100000:0.0:1788530286.572528:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 361 00000100:00100000:0.0:1788530286.572535:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2402:x1875409531641088:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1788530286.572557:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2402:x1875409531641088:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 23us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530286.572629:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 361 00000100:00080000:0.0:1788530286.572780:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788530286.572785:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788530286.573036:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531640704 00000100:00100000:3.0:1788530286.573041:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531640704 00000100:00100000:3.0:1788530286.573080:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531640832 00000100:00100000:3.0:1788530286.573083:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531640832 00000100:00100000:3.0:1788530286.573102:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 102 00000100:00100000:3.0:1788530286.573109:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2402:x1875409531640704:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1788530286.573323:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2402:x1875409531640704:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 213us (1484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530286.573330:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 102 00000100:00100000:3.0:1788530286.573344:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 103 00000100:00100000:3.0:1788530286.573350:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:2402:x1875409531640832:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1788530286.573373:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:2402:x1875409531640832:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 23us (1413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530286.573379:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 103 00000100:00100000:3.0:1788530286.573396:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531640320 00000100:00100000:3.0:1788530286.573399:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531640320 00000100:00100000:3.0:1788530286.573423:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 441 00000100:00100000:3.0:1788530286.573429:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f396c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f442bcd-b742-4e76-ad7b-709f731358a0+14:2402:x1875409531640320:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1788530286.573451:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f396c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f442bcd-b742-4e76-ad7b-709f731358a0+14:2402:x1875409531640320:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 23us (1532us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530286.573457:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 441 00000100:00100000:2.0:1788530286.573984:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 362 00000100:00100000:2.0:1788530286.573994:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2402:x1875409531640576:12345-192.168.202.41@tcp:400:kworker.0 00000100:00080000:0.0:1788530286.574344:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788530286.574349:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788530286.579611:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2402:x1875409531640576:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 5602us (7657us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530286.579632:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 362 00000100:00100000:1.0:1788530286.657120:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555842816:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788530286.657230:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530286.657609:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555842816 00000100:00100000:3.0:1788530286.657620:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555842816 00000100:00100000:3.0:1788530286.658792:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1788530286.658807:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03cc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555842816:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788530286.658865:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446453248 avail 1300213760 00000100:00100000:3.0:1788530286.669343:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03cc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555842816:12345-0@lo:41:osp-pre-1-0.0 Request processed in 10531us (12102us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530286.669358:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1788530286.680954:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555842816:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788530286.799183:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530287.810139:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788530288.183826:0:14327:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788530288.183835:0:14327:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788530288.183890:0:14327:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788530288.183896:0:14327:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788530288.392260:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530288.393501:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531641344 00000100:00100000:0.0:1788530288.393517:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531641344 00000100:00080000:1.0:1788530288.393589:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788530288.393642:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 145 00000100:00100000:0.0:1788530288.393656:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03cc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+25:11435:x1875409531641344:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:0.0:1788530288.393683:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530288.393735:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100800/0xb28d70e125750f38 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550a24 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530288.393863:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100600/0xb28d70e125750f3f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530288.393881:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100600/0xb28d70e125750f3f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530288.393895:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100600/0xb28d70e125750f3f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788530288.393907:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788530288.394030:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100800/0xb28d70e125750f38 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a24 expref: 28 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530288.394048:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100600/0xb28d70e125750f3f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a24 expref: 27 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530288.394079:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a9f2b996600) 00010000:00010000:0.0:1788530288.394082:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788530288.394086:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d100600, rc 0) 00000100:00100000:0.0:1788530288.394171:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03cc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+27:11435:x1875409531641344:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 520us (1921us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1788530288.394178:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 145 00000100:00100000:2.0:1788530288.396373:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530288.396541:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531641472 00000100:00100000:3.0:1788530288.396551:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531641472 00000100:00100000:3.0:1788530288.396645:0:10719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 146 00000100:00100000:3.0:1788530288.396655:0:10719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+27:11435:x1875409531641472:12345-192.168.202.41@tcp:54:lfs.0 00010000:00010000:3.0:1788530288.396721:0:10719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b000/0xb28d70e125750f4d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530288.396739:0:10719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b000/0xb28d70e125750f4d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530288.396749:0:10719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b000/0xb28d70e125750f4d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530288.396785:0:10719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b000/0xb28d70e125750f4d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530288.396791:0:10719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b000/0xb28d70e125750f4d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530288.396798:0:10719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b000/0xb28d70e125750f4d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530288.396804:0:10719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d36b000 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:3.0:1788530288.396808:0:10719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b000/0xb28d70e125750f4d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530288.396827:0:10719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b000/0xb28d70e125750f4d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530288.396840:0:10719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a9f2b996600) 00010000:00010000:3.0:1788530288.396843:0:10719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788530288.396849:0:10719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b000/0xb28d70e125750f4d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530288.396865:0:10719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b000/0xb28d70e125750f4d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530288.396941:0:10719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+27:11435:x1875409531641472:12345-192.168.202.41@tcp:54:lfs.0 Request processed in 287us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530288.396950:0:10719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 146 00000100:00100000:1.0:1788530288.513105:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530288.513224:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531641600 00000100:00100000:3.0:1788530288.513235:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531641600 00000100:00100000:3.0:1788530288.513305:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 55 00000100:00100000:3.0:1788530288.513316:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03cc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:2399:x1875409531641600:12345-192.168.202.41@tcp:101:cat.0 00010000:00010000:3.0:1788530288.513333:0:8752:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788530288.513352:0:8752:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003e9f6c68/0xb28d70e125750f54 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550a2b expref: -99 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788530288.513374:0:8752:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a9ace6b, atime: 0x6a9ace6b, ctime: 0x6a9ace6b, blocks: 0x8 00010000:00010000:3.0:1788530288.513392:0:8752:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=496s v=(0 0) 00010000:00010000:3.0:1788530288.513396:0:8752:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788530288.513405:0:8752:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e9f6c68/0xb28d70e125750f54 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a2b expref: 7 pid: 8752 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530288.513455:0:8752:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003e9f6c68/0xb28d70e125750f54 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a2b expref: 7 pid: 8752 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530288.513469:0:8752:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d36ac00, rc 0) 00000100:00080000:1.0:1788530288.513618:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788530288.514023:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03cc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+7:2399:x1875409531641600:12345-192.168.202.41@tcp:101:cat.0 Request processed in 707us (926us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530288.514032:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 55 00000100:00100000:3.0:1788530288.522841:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530288.523166:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531641728 00000100:00100000:1.0:1788530288.523187:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531641728 00002000:00100000:1.0:1788530288.523284:0:8444:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff9a9e03efe680 x1875409531641728/t0(0) o3->aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41@192.168.202.41@tcp:229/0 lens 488/0 e 0 to 0 dl 1788530299 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788530288.523301:0:8444:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a9e03efe680 with x1875409531641728 ext(0->4095) 00002000:00010000:1.0:1788530288.523311:0:8444:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a9e03efe680 00000100:00100000:1.0:1788530288.523377:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 4 00000100:00100000:1.0:1788530288.523396:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03efe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+7:2400:x1875409531641728:12345-192.168.202.41@tcp:3:cat.0 00000100:00100000:1.0:1788530288.523745:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03efe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+7:2400:x1875409531641728:12345-192.168.202.41@tcp:3:cat.0 Request processed in 355us (922us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1788530288.523755:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 4 00002000:00100000:1.0:1788530288.523762:0:8444:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff9a9e03efe680 x1875409531641728/t0(0) o3->aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41@192.168.202.41@tcp:229/0 lens 488/4536 e 0 to 0 dl 1788530299 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788530288.523771:0:8444:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a9e03efe680 with x1875409531641728 ext(0->4095) 00002000:00010000:1.0:1788530288.523776:0:8444:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a9e03efe680 00010000:00010000:1.0:1788530288.833417:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788530289.225010:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00010000:00010000:2.0:1788530289.857251:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788530290.241219:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788530290.241259:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f06270700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555842944:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788530290.241949:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530290.242058:0:14186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555842944 00000100:00100000:0.0:1788530290.242072:0:14186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555842944 00000100:00100000:0.0:1788530290.242186:0:14186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1788530290.242199:0:14186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f06273480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555842944:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788530290.242260:0:14186:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1788530290.242342:0:14186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f06273480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555842944:12345-0@lo:41:osp-pre-0-1.0 Request processed in 143us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530290.242353:0:14186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1788530290.242871:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f06270700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555842944:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788530290.754241:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788530290.754273:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03efed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555843072:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788530290.754398:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530290.755610:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788530290.755695:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03cc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555843200:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788530290.755759:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530290.755856:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555843072 00000100:00100000:2.0:1788530290.755868:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555843072 00000100:00100000:2.0:1788530290.755940:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555843200 00000100:00100000:2.0:1788530290.755944:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555843200 00000100:00100000:2.0:1788530290.755986:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788530290.755998:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03efdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555843072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788530290.756058:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788530290.756107:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03efdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555843072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (1709us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530290.756115:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788530290.756148:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788530290.756155:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555843200:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788530290.756164:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788530290.756189:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555843200:12345-0@lo:13:osp-pre-0-1.0 Request processed in 36us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530290.756194:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788530290.756255:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03cc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555843200:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788530290.756870:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000100:00100000:0.0:1788530290.757062:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f06270700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555843328:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788530290.757122:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788530290.757387:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788530290.757400:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788530290.757409:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03cc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555843456:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788530290.757443:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1788530290.757548:0:3648:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:3.0:1788530290.757606:0:3648:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a9e03e8a680, transno 4294967305 00000100:00100000:3.0:1788530290.757722:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03efed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555843072:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788530290.757749:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788530290.757757:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875409555843712:0@lo:400:kworker.0 00000100:00100000:3.0:1788530290.757797:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530290.757820:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3648:1875409555843584:0@lo:400:kworker.0 00000100:00100000:3.0:1788530290.757862:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530290.757970:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555843328 00000100:00100000:1.0:1788530290.757976:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555843712 00000100:00100000:2.0:1788530290.757980:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555843328 00000100:00100000:1.0:1788530290.757983:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555843712 00000100:00100000:2.0:1788530290.758036:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555843456 00000100:00100000:2.0:1788530290.758041:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555843456 00000100:00100000:1.0:1788530290.758058:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:2.0:1788530290.758066:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788530290.758073:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03efed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875409555843712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530290.758079:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f06272d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555843328:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788530290.758106:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33943232 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1788530290.758161:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f06272d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555843328:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (1039us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530290.758174:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788530290.758190:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788530290.758197:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03cc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3649:x1875409555843456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788530290.758208:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33943232 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1788530290.758233:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03cc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3649:x1875409555843456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 37us (789us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530290.758239:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788530290.758280:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03ee0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875409555843840:0@lo:400:kworker.0 00000100:00100000:2.0:1788530290.758302:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530290.758318:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875409555844352:0@lo:400:kworker.0 00000100:00100000:2.0:1788530290.758335:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530290.758367:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03cc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555843456:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788530290.758381:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f06270700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555843328:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788530290.758394:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788530290.758399:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03ee3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555843968:0@lo:400:kworker.0 00000100:00100000:2.0:1788530290.758420:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530290.758435:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875409555844480:0@lo:400:kworker.0 00000100:00100000:2.0:1788530290.758451:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530290.758470:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03ee3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875409555844096:0@lo:400:kworker.0 00000100:00100000:2.0:1788530290.758491:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530290.758505:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788530290.758509:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03ee1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875409555844224:0@lo:400:kworker.0 00000100:00100000:2.0:1788530290.758526:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530290.759047:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03efed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875409555843712:12345-0@lo:400:kworker.0 Request processed in 976us (1247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530290.759057:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:2.0:1788530290.760117:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555843840 00000100:00100000:2.0:1788530290.760129:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555843840 00000100:00100000:1.0:1788530290.762406:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555844352 00000100:00100000:1.0:1788530290.762426:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555844352 00000100:00100000:1.0:1788530290.762470:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555844480 00000100:00100000:1.0:1788530290.762474:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555844480 00000100:00100000:1.0:1788530290.762487:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555844096 00000100:00100000:1.0:1788530290.762490:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555844096 00000100:00100000:1.0:1788530290.762503:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555844224 00000100:00100000:1.0:1788530290.762506:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555844224 00000100:00100000:1.0:1788530290.762523:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:1.0:1788530290.762533:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875409555843840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530290.763121:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:3.0:1788530290.763133:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875409555844352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530290.763823:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875409555843840:12345-0@lo:400:kworker.0 Request processed in 1289us (5516us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530290.764530:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:1.0:1788530290.764592:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:1.0:1788530290.764619:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:1.0:1788530290.764628:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875409555844096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530290.764645:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875409555844480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530290.764709:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875409555844096:12345-0@lo:400:kworker.0 Request processed in 83us (6215us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530290.764730:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:1.0:1788530290.764760:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:1.0:1788530290.764770:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875409555844224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530290.765085:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875409555844224:12345-0@lo:400:kworker.0 Request processed in 92us (6332us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530290.765153:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00080000:1.0:1788530290.765195:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788530290.765203:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788530290.765208:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788530290.765269:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e03ee1f80 x1875409555844224/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530290.765293:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03ee1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875409555844224:0@lo:400:kworker.0 00000100:00100000:1.0:1788530290.765312:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03ee3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875409555844096:0@lo:400:kworker.0 00000100:00100000:0.0:1788530290.770351:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555843968 00000100:00100000:0.0:1788530290.770376:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555843968 00000100:00100000:0.0:1788530290.770449:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1788530290.770460:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555843968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530290.770777:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875409555844352:12345-0@lo:400:kworker.0 Request processed in 7644us (12438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530290.770792:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:3.0:1788530290.770823:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555843584 00000100:00100000:3.0:1788530290.770828:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555843584 00000100:00100000:3.0:1788530290.770904:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 442 00000100:00100000:3.0:1788530290.770912:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f396c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:3648:x1875409555843584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530290.770950:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f396c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:3648:x1875409555843584:12345-0@lo:400:kworker.0 Request processed in 39us (13088us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530290.770957:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 442 00000100:00100000:3.0:1788530290.771381:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3648:1875409555843584:0@lo:400:kworker.0 00000100:00100000:3.0:1788530290.771422:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875409555843712:0@lo:400:kworker.0 00000001:00080000:3.0:1788530290.779474:0:6502:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:3.0:1788530290.779536:0:6502:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a9f396d5840 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:3.0:1788530290.779542:0:6502:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a9f033d2700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a9f396d53c0 00000020:00080000:3.0:1788530290.779546:0:6502:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a9f033d2d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a9f3d0c8c00 00000020:00080000:3.0:1788530290.779598:0:6502:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:3.0:1788530290.779613:0:6555:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:3.0:1788530290.779699:0:6555:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:3.0:1788530290.779744:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101400/0xb28d70e125750ecf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530290.779758:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101400/0xb28d70e125750ecf lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530290.779768:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101400/0xb28d70e125750ecf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530290.779797:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d101400 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:3.0:1788530290.779803:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101400/0xb28d70e125750ecf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530290.779812:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101400/0xb28d70e125750ecf lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530290.779897:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9a9e0241dd00) 00010000:00010000:3.0:1788530290.779901:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788530290.779909:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101400/0xb28d70e125750ecf lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530290.779917:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101400/0xb28d70e125750ecf lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530290.780331:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875409555844480:12345-0@lo:400:kworker.0 Request processed in 15781us (21871us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530290.780346:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:0.0:1788530290.783504:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555843968:12345-0@lo:400:kworker.0 Request processed in 13027us (25063us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530290.783522:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00010000:00080000:1.0:1788530290.784252:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e03d83480 x1875409555844480/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530290.784274:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875409555844480:0@lo:400:kworker.0 00000100:00100000:1.0:1788530290.784296:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03ee0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875409555843840:0@lo:400:kworker.0 00000100:00100000:1.0:1788530290.784310:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875409555844352:0@lo:400:kworker.0 00000100:00100000:1.0:1788530290.784355:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03ee3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555843968:0@lo:400:kworker.0 00010000:00010000:1.0:1788530290.881529:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788530291.268750:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000001:00080000:0.0:1788530291.268768:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000100:00100000:0.0:1788530291.704202:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530291.704250:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530291.704276:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530291.704293:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530291.704310:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530291.704327:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530291.704353:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530291.704383:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531641856 00000100:00100000:0.0:1788530291.704394:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531641856 00000100:00100000:0.0:1788530291.704449:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 443 00000100:00100000:0.0:1788530291.704459:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f396c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f442bcd-b742-4e76-ad7b-709f731358a0+14:2399:x1875409531641856:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1788530291.704529:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f396c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f442bcd-b742-4e76-ad7b-709f731358a0+14:2399:x1875409531641856:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 71us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530291.704537:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 443 00000100:00100000:0.0:1788530291.704589:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531642112 00000100:00100000:0.0:1788530291.704593:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531642112 00000100:00100000:0.0:1788530291.704641:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531642624 00000100:00100000:0.0:1788530291.704645:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531642624 00000100:00100000:0.0:1788530291.704666:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531641984 00000100:00100000:0.0:1788530291.704668:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531641984 00000100:00100000:0.0:1788530291.704679:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531642496 00000100:00100000:0.0:1788530291.704681:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531642496 00000100:00100000:0.0:1788530291.704696:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 369 00000100:00100000:0.0:1788530291.704712:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f06271c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2399:x1875409531642112:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1788530291.704745:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f06271c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2399:x1875409531642112:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 34us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530291.704752:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 369 00000100:00100000:0.0:1788530291.704767:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 370 00000100:00100000:0.0:1788530291.704773:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f06271f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2399:x1875409531642624:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1788530291.704798:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f06271f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2399:x1875409531642624:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 24us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530291.704804:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 370 00000100:00100000:0.0:1788530291.704816:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 371 00000100:00100000:0.0:1788530291.704834:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f06273800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+13:2399:x1875409531641984:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1788530291.704861:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f06273800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+13:2399:x1875409531641984:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 39us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530291.704867:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 371 00000100:00100000:0.0:1788530291.704880:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 372 00000100:00100000:0.0:1788530291.704886:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f06271880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2399:x1875409531642496:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1788530291.704908:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f06271880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2399:x1875409531642496:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 23us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530291.704915:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 372 00000100:00100000:0.0:1788530291.704934:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531642368 00000100:00100000:0.0:1788530291.704937:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531642368 00000100:00100000:0.0:1788530291.704965:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531642240 00000100:00100000:0.0:1788530291.704968:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531642240 00000100:00100000:0.0:1788530291.704989:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 104 00000100:00100000:0.0:1788530291.705002:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f33f99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:2399:x1875409531642368:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1788530291.705029:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f33f99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:2399:x1875409531642368:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 28us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530291.705036:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 104 00000100:00100000:0.0:1788530291.705155:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 105 00000100:00100000:0.0:1788530291.705163:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f06271500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2399:x1875409531642240:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1788530291.705187:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f06271500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2399:x1875409531642240:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 26us (859us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530291.705193:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 105 00000100:00080000:0.0:1788530291.705356:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788530291.705360:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788530291.705363:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788530291.705365:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788530291.776912:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788530291.776940:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555844608:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788530291.777027:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530291.777171:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555844608 00000100:00100000:2.0:1788530291.777182:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555844608 00000100:00100000:2.0:1788530291.777244:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1788530291.779861:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f06273100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555844608:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788530291.780197:0:6529:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446453248 avail 1300213760 00000100:00100000:3.0:1788530291.780452:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f06273100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555844608:12345-0@lo:41:osp-pre-1-0.0 Request processed in 3194us (3420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530291.780465:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1788530291.780607:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555844608:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788530291.908292:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530292.929004:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530293.955852:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788530294.533188:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530294.533358:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531642752 00000100:00100000:1.0:1788530294.533372:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531642752 00000100:00100000:1.0:1788530294.533500:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 147 00000100:00100000:1.0:1788530294.533514:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f06272a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+13:11088:x1875409531642752:12345-192.168.202.41@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788530294.533708:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f06272a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+13:11088:x1875409531642752:12345-192.168.202.41@tcp:60:lhsmtool_posix.0 Request processed in 197us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530294.533718:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 147 00000100:00080000:0.0:1788530294.533949:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788530294.536768:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530294.536884:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531642880 00000100:00100000:2.0:1788530294.536897:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531642880 00000100:00100000:2.0:1788530294.537006:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 148 00000100:00100000:2.0:1788530294.537019:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f06273b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:11088:x1875409531642880:12345-192.168.202.41@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788530294.537177:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f06273b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:11088:x1875409531642880:12345-192.168.202.41@tcp:60:lhsmtool_posix.0 Request processed in 161us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530294.537186:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 148 00000100:00080000:0.0:1788530294.537756:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788530294.541269:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530294.541443:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531643136 00000100:00100000:2.0:1788530294.541459:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531643136 00000100:00100000:2.0:1788530294.541547:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 35 00000100:00100000:2.0:1788530294.541594:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03efc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+13:11088:x1875409531643136:12345-192.168.202.41@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788530294.542030:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03efc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+14:11088:x1875409531643136:12345-192.168.202.41@tcp:35:lhsmtool_posix.0 Request processed in 472us (769us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1788530294.542038:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 35 00000100:00100000:3.0:1788530294.830595:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530294.830676:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531643264 00000100:00100000:1.0:1788530294.830687:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531643264 00000100:00080000:0.0:1788530294.830724:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788530294.830823:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 149 00000100:00100000:1.0:1788530294.830835:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03efc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:11894:x1875409531643264:12345-192.168.202.41@tcp:101:lsof.0 00010000:00010000:1.0:1788530294.830856:0:10720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530294.830876:0:10720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea000/0xb28d70e125750f5b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550a32 expref: -99 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530294.831255:0:10720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea400/0xb28d70e125750f62 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530294.831273:0:10720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea400/0xb28d70e125750f62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530294.831289:0:10720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea400/0xb28d70e125750f62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788530294.831355:0:10720:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788530294.831360:0:10720:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788530294.831408:0:10720:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea400/0xb28d70e125750f62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530294.831465:0:10720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea000/0xb28d70e125750f5b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a32 expref: 7 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530294.831487:0:10720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea400/0xb28d70e125750f62 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a32 expref: 6 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530294.831496:0:10720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a9f32abdf00) 00010000:00010000:1.0:1788530294.831499:0:10720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788530294.831503:0:10720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f012ea400, rc 0) 00000100:00100000:1.0:1788530294.831752:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03efc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+6:11894:x1875409531643264:12345-192.168.202.41@tcp:101:lsof.0 Request processed in 918us (1201us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530294.831760:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 149 00010000:00010000:1.0:1788530294.977179:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788530295.361548:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f06270700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555844736:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788530295.361658:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530295.362049:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555844736 00000100:00100000:0.0:1788530295.362061:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555844736 00000100:00100000:0.0:1788530295.362146:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1788530295.362157:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03cc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555844736:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788530295.362204:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1788530295.362324:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03cc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555844736:12345-0@lo:41:osp-pre-0-1.0 Request processed in 169us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530295.362345:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1788530295.362507:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f06270700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555844736:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1788530295.552934:0:13811:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788530295.552954:0:13811:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788530295.553258:0:13811:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:3.0:1788530295.553270:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788530295.872965:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875409555845120:0@lo:400:kworker.0 00000100:00100000:2.0:1788530295.873025:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875409555845248:0@lo:400:kworker.0 00000100:00100000:3.0:1788530295.873051:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530295.873386:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555844864:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788530295.873437:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530295.873528:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555845760:0@lo:400:kworker.0 00000100:00100000:2.0:1788530295.873557:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530295.873618:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555846272:0@lo:400:kworker.0 00000100:00100000:2.0:1788530295.873641:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530295.873671:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788530295.873677:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875409555845632:0@lo:400:kworker.0 00000100:00100000:2.0:1788530295.873699:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530295.873717:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875409555846144:0@lo:400:kworker.0 00000100:00100000:2.0:1788530295.873739:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530295.873758:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03cc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555846656:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788530295.873791:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530295.873827:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555846656 00000100:00100000:2.0:1788530295.873837:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555846656 00000100:00100000:2.0:1788530295.873909:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788530295.874399:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03767b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555846656:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788530295.874429:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788530295.874491:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03767b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555846656:12345-0@lo:13:osp-pre-0-1.0 Request processed in 571us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530295.874499:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788530295.874536:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555845120 00000100:00100000:2.0:1788530295.874541:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555845120 00000100:00100000:2.0:1788530295.874612:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555845248 00000100:00100000:2.0:1788530295.874633:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555845248 00000100:00100000:2.0:1788530295.874658:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555845632 00000100:00100000:2.0:1788530295.874660:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555845632 00000100:00100000:2.0:1788530295.874673:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555846144 00000100:00100000:2.0:1788530295.874675:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555846144 00000100:00100000:2.0:1788530295.874695:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:2.0:1788530295.874701:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03eff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875409555845120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530295.874735:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03eff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875409555845120:12345-0@lo:400:kworker.0 Request processed in 34us (1684us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530295.874740:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:2.0:1788530295.874753:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:2.0:1788530295.874758:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d3f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875409555845248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530295.874798:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d3f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875409555845248:12345-0@lo:400:kworker.0 Request processed in 40us (1361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530295.874805:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:2.0:1788530295.874818:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:2.0:1788530295.874824:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875409555845632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530295.874861:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875409555845632:12345-0@lo:400:kworker.0 Request processed in 26us (1150us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530295.874867:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:2.0:1788530295.874878:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:2.0:1788530295.874884:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03766300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875409555846144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530295.874909:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03766300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875409555846144:12345-0@lo:400:kworker.0 Request processed in 25us (1169us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530295.874916:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00010000:00080000:2.0:1788530295.874965:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e03d82d80 x1875409555845632/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530295.875106:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875409555845632:0@lo:400:kworker.0 00010000:00080000:2.0:1788530295.875124:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e03d80000 x1875409555846144/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530295.875132:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875409555846144:0@lo:400:kworker.0 00000100:00100000:2.0:1788530295.875153:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03cc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555846656:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788530295.875164:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875409555845248:0@lo:400:kworker.0 00000100:00100000:3.0:1788530295.875191:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875409555845120:0@lo:400:kworker.0 00000100:00100000:0.0:1788530295.875481:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3650:1875409555844992:0@lo:400:kworker.0 00000100:00100000:0.0:1788530295.875529:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530295.875588:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875409555845504:0@lo:400:kworker.0 00000100:00100000:0.0:1788530295.875623:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530295.875643:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875409555846016:0@lo:400:kworker.0 00000100:00100000:0.0:1788530295.875666:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530295.875682:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03cc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555846528:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788530295.875706:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530295.875741:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555845760 00000100:00100000:0.0:1788530295.875748:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555845760 00000100:00100000:0.0:1788530295.875795:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555846272 00000100:00100000:0.0:1788530295.875799:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555846272 00000100:00100000:0.0:1788530295.875823:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788530295.875831:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d3fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555845760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530295.875879:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d3fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555845760:12345-0@lo:400:kworker.0 Request processed in 48us (2320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530295.875885:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788530295.875899:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788530295.875905:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555846272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530295.875930:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555846272:12345-0@lo:400:kworker.0 Request processed in 25us (2289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530295.875936:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788530295.875957:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555846528 00000100:00100000:0.0:1788530295.875961:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555846528 00000100:00100000:0.0:1788530295.876008:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788530295.876015:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555846528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788530295.876035:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33943232 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1788530295.876068:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555846528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530295.876074:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788530295.876110:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555845504 00000100:00100000:0.0:1788530295.876114:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555845504 00000100:00100000:0.0:1788530295.876149:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555846016 00000100:00100000:0.0:1788530295.876152:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555846016 00000100:00100000:3.0:1788530295.876530:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555844992 00000100:00100000:3.0:1788530295.876536:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555844992 00000100:00100000:0.0:1788530295.876552:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:0.0:1788530295.876576:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875409555845504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530295.876584:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 444 00000100:00100000:3.0:1788530295.876591:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f396c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:3650:x1875409555844992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530295.876617:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875409555845504:12345-0@lo:400:kworker.0 Request processed in 58us (993us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530295.876619:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f396c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:3650:x1875409555844992:12345-0@lo:400:kworker.0 Request processed in 29us (1091us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530295.876623:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:3.0:1788530295.876625:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 444 00000100:00100000:0.0:1788530295.876635:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:0.0:1788530295.876640:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875409555846016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530295.876668:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875409555846016:12345-0@lo:400:kworker.0 Request processed in 27us (1001us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530295.876673:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00080000:0.0:1788530295.876689:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788530295.876693:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788530295.876695:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788530295.876698:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788530295.876707:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788530295.876718:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f06270700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555846784:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788530295.876745:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530295.876781:0:9912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555846784 00000100:00100000:0.0:1788530295.876808:0:9912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555846784 00000100:00100000:0.0:1788530295.876838:0:9912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788530295.876844:0:9912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555846784:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788530295.876872:0:9912:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33943232 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1788530295.876907:0:9912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555846784:12345-0@lo:13:osp-pre-1-1.0 Request processed in 63us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530295.876914:0:9912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788530295.876960:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3650:1875409555844992:0@lo:400:kworker.0 00000100:00100000:0.0:1788530295.877099:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875409555845504:0@lo:400:kworker.0 00000100:00100000:0.0:1788530295.877122:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875409555846016:0@lo:400:kworker.0 00000100:00100000:0.0:1788530295.877135:0:3650:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967314 gen 2 00000004:00080000:0.0:1788530295.877141:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a9f05f45500, transno 4294967312 00000004:00080000:0.0:1788530295.877155:0:3650:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967314 committed transno 4294967314 00000100:00100000:0.0:1788530295.877207:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03cc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555846528:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788530295.877421:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f06270700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555846784:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788530295.877615:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555845760:0@lo:400:kworker.0 00000100:00100000:2.0:1788530295.877625:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555846272:0@lo:400:kworker.0 00000100:00100000:1.0:1788530295.878592:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530295.878662:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555845376:0@lo:400:kworker.0 00000100:00100000:1.0:1788530295.878701:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530295.878736:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555845888:0@lo:400:kworker.0 00000100:00100000:1.0:1788530295.878759:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530295.878801:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e0375f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555846400:0@lo:400:kworker.0 00000100:00100000:1.0:1788530295.878825:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530295.878946:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555845888 00000100:00100000:1.0:1788530295.878968:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555845888 00000100:00100000:1.0:1788530295.879105:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555846400 00000100:00100000:1.0:1788530295.879109:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555846400 00000100:00100000:1.0:1788530295.879133:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788530295.879141:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03cc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555845888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530295.879276:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03cc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555845888:12345-0@lo:400:kworker.0 Request processed in 134us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530295.879285:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788530295.879311:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788530295.879318:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03cc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555846400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530295.879347:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03cc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555846400:12345-0@lo:400:kworker.0 Request processed in 31us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530295.879354:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:1.0:1788530295.879386:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788530295.879425:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e0375f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555846400:0@lo:400:kworker.0 00000100:00100000:1.0:1788530295.879456:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555845888:0@lo:400:kworker.0 00000100:00100000:0.0:1788530295.879613:0:9912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555844864 00000100:00100000:0.0:1788530295.879618:0:9912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555844864 00000100:00100000:0.0:1788530295.879656:0:9912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788530295.879663:0:9912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03cc7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555844864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788530295.879678:0:9912:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788530295.879721:0:9912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03cc7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555844864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (1135us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530295.879727:0:9912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788530295.880267:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555844864:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788530295.880362:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555845376 00000100:00100000:3.0:1788530295.880369:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555845376 00000100:00100000:3.0:1788530295.880419:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1788530295.880428:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03cc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555845376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530295.880492:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03cc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555845376:12345-0@lo:400:kworker.0 Request processed in 66us (1790us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530295.880500:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1788530295.880598:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555845376:0@lo:400:kworker.0 00000001:00080000:0.0:1788530295.881396:0:6502:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:0.0:1788530295.881426:0:6502:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:3.0:1788530295.881489:0:6555:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:3.0:1788530295.881504:0:6555:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000040:00080000:3.0:1788530295.940131:0:13816:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788530296.000875:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788530296.807456:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530296.807510:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530296.807543:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531643392 00000100:00100000:0.0:1788530296.807552:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530296.807554:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531643392 00000100:00100000:0.0:1788530296.807626:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530296.807648:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530296.807653:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 445 00000100:00100000:3.0:1788530296.807664:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f396c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f442bcd-b742-4e76-ad7b-709f731358a0+14:2400:x1875409531643392:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1788530296.807668:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530296.807692:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530296.807716:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531643648 00000100:00100000:0.0:1788530296.807720:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531643648 00000100:00100000:3.0:1788530296.807753:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f396c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f442bcd-b742-4e76-ad7b-709f731358a0+14:2400:x1875409531643392:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 89us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530296.807760:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 445 00000100:00100000:0.0:1788530296.807790:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531644160 00000100:00100000:0.0:1788530296.807793:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531644160 00000100:00100000:0.0:1788530296.807812:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531643520 00000100:00100000:0.0:1788530296.807815:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531643520 00000100:00100000:0.0:1788530296.807827:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531644032 00000100:00100000:0.0:1788530296.807829:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531644032 00000100:00100000:0.0:1788530296.807845:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 379 00000100:00100000:0.0:1788530296.807851:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f06270700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2400:x1875409531643648:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1788530296.807886:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f06270700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2400:x1875409531643648:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 35us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530296.807893:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 379 00000100:00100000:0.0:1788530296.807907:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 380 00000100:00100000:0.0:1788530296.807913:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e035f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2400:x1875409531644160:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1788530296.807938:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e035f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2400:x1875409531644160:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 25us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530296.807944:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 380 00000100:00100000:0.0:1788530296.807955:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 381 00000100:00100000:0.0:1788530296.807961:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03692a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+13:2400:x1875409531643520:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1788530296.808012:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03692a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+13:2400:x1875409531643520:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 51us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530296.808019:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 381 00000100:00100000:0.0:1788530296.808032:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 382 00000100:00100000:0.0:1788530296.808038:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f05f45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+6:2400:x1875409531644032:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1788530296.808060:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f05f45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+6:2400:x1875409531644032:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 22us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530296.808066:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 382 00000100:00100000:2.0:1788530296.808253:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531643904 00000100:00100000:2.0:1788530296.808258:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531643904 00000100:00100000:2.0:1788530296.808308:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531643776 00000100:00100000:2.0:1788530296.808311:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531643776 00000100:00100000:2.0:1788530296.808337:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 110 00000100:00100000:2.0:1788530296.808345:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d3fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:2400:x1875409531643904:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1788530296.808379:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d3fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:2400:x1875409531643904:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 36us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530296.808386:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 110 00000100:00100000:2.0:1788530296.808399:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 111 00000100:00100000:2.0:1788530296.808406:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f05f45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2400:x1875409531643776:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1788530296.808429:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f05f45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2400:x1875409531643776:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 24us (760us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530296.808446:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 111 00000100:00080000:1.0:1788530296.808929:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788530296.808935:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788530296.808938:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788530296.808941:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788530296.897380:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03767100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555846912:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788530296.897494:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530296.903029:0:14186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555846912 00000100:00100000:3.0:1788530296.903064:0:14186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555846912 00000100:00100000:3.0:1788530296.903297:0:14186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1788530296.903312:0:14186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03cc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555846912:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788530296.903376:0:14186:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446453248 avail 1300213760 00000100:00100000:3.0:1788530296.903515:0:14186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03cc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555846912:12345-0@lo:41:osp-pre-1-0.0 Request processed in 207us (6022us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530296.903526:0:14186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1788530296.905986:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03767100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555846912:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788530297.025071:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530298.052142:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530299.076928:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788530299.419508:0:14525:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 09:58:16 (1788530296) 00010000:00010000:1.0:1788530300.101649:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788530300.484428:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788530300.484474:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f05f45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555847040:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788530300.484611:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530300.484837:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555847040 00000100:00100000:0.0:1788530300.484848:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555847040 00000100:00100000:0.0:1788530300.484907:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1788530300.484916:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03efdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555847040:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788530300.484951:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1788530300.485015:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03efdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555847040:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530300.485022:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1788530300.485108:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f05f45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555847040:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788530300.717304:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530300.717401:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531644416 00000100:00100000:0.0:1788530300.717414:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531644416 00000100:00100000:0.0:1788530300.717519:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 150 00000100:00100000:0.0:1788530300.717531:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03767100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+13:12161:x1875409531644416:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788530300.717595:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530300.717635:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100800/0xb28d70e125750f69 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550a39 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530300.717733:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e125750f70 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530300.717778:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e125750f70 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530300.717792:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e125750f70 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530300.717835:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101600/0xb28d70e125750f77 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530300.717843:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101600/0xb28d70e125750f77 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530300.717850:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101600/0xb28d70e125750f77 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530300.717971:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100400/0xb28d70e125750f7e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530300.717982:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100400/0xb28d70e125750f7e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530300.717989:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100400/0xb28d70e125750f7e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788530300.718000:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1788530300.718092:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e125750f70 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530300.718101:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e125750f70 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530300.718117:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e125750f70 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530300.718124:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d101c00 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:0.0:1788530300.718128:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e125750f70 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530300.718137:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e125750f70 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530300.718151:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a9f32abd000) 00010000:00010000:0.0:1788530300.718155:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788530300.718160:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e125750f70 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530300.718167:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e125750f70 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530300.718182:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101600/0xb28d70e125750f77 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530300.718189:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101600/0xb28d70e125750f77 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530300.718196:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101600/0xb28d70e125750f77 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530300.718201:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d101600 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:0.0:1788530300.718204:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101600/0xb28d70e125750f77 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530300.718220:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101600/0xb28d70e125750f77 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530300.718229:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9a9e0241d600) 00010000:00010000:0.0:1788530300.718231:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788530300.718234:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101600/0xb28d70e125750f77 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530300.718240:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101600/0xb28d70e125750f77 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530300.718552:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100800/0xb28d70e125750f69 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a39 expref: 16 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530300.718648:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100400/0xb28d70e125750f7e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a39 expref: 15 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530300.718655:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a9f2b992000) 00010000:00010000:0.0:1788530300.718657:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788530300.718659:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d100400, rc 0) 00000100:00100000:0.0:1788530300.718752:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03767100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+15:12161:x1875409531644416:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 1223us (1459us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1788530300.718763:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 150 00000100:00080000:1.0:1788530300.720702:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788530300.732251:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530300.732357:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530300.732449:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531644544 00000100:00100000:0.0:1788530300.732475:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531644544 00000100:00100000:0.0:1788530300.732621:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 151 00000100:00100000:0.0:1788530300.732633:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03efea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+15:12161:x1875409531644544:12345-192.168.202.41@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788530300.732913:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03efea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+15:12161:x1875409531644544:12345-192.168.202.41@tcp:59:lhsmtool_posix.0 Request processed in 274us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530300.732922:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 151 00000100:00100000:1.0:1788530300.733630:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531644672 00000100:00100000:1.0:1788530300.733637:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531644672 00000100:00100000:1.0:1788530300.733690:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 8 00000100:00100000:1.0:1788530300.733699:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03efd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+15:2399:x1875409531644672:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788530300.733711:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788530300.733762:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100400/0xb28d70e125750f7e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a39 expref: 15 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530300.733788:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a9f2b992000) 00010000:00010000:1.0:1788530300.733795:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788530300.733840:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03efd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+14:2399:x1875409531644672:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 143us (1484us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530300.733846:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 8 00000100:00100000:0.0:1788530300.736689:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530300.739773:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531644800 00000100:00100000:2.0:1788530300.739791:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531644800 00000100:00100000:2.0:1788530300.739901:0:10719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 152 00000100:00100000:2.0:1788530300.739914:0:10719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f05f45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:12161:x1875409531644800:12345-192.168.202.41@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788530300.740038:0:10719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f05f45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:12161:x1875409531644800:12345-192.168.202.41@tcp:59:lhsmtool_posix.0 Request processed in 127us (3362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530300.740047:0:10719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 152 00000100:00080000:1.0:1788530300.740123:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788530300.992878:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555847296:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788530300.992968:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530300.993054:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788530300.993061:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3740ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555847168:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788530300.993087:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530300.993137:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555847296 00000100:00100000:2.0:1788530300.993144:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555847296 00000100:00100000:2.0:1788530300.993191:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555847168 00000100:00100000:2.0:1788530300.993194:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555847168 00000100:00100000:2.0:1788530300.993212:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788530300.993220:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555847296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788530300.993251:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33943232 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1788530300.993293:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555847296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530300.993311:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788530300.993329:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788530300.993335:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555847168:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788530300.993344:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33943232 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1788530300.993370:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555847168:12345-0@lo:13:osp-pre-1-1.0 Request processed in 35us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530300.993376:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00080000:2.0:1788530300.993400:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788530300.993448:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3740ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555847168:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788530300.993484:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555847296:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788530300.993922:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3740ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555847424:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788530300.993955:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530300.993984:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555847936:0@lo:400:kworker.0 00000100:00100000:2.0:1788530300.994021:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530300.994041:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37377100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555848448:0@lo:400:kworker.0 00000100:00100000:2.0:1788530300.994066:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530300.994120:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788530300.994127:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3649:1875409555847552:0@lo:400:kworker.0 00000100:00100000:2.0:1788530300.994154:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530300.994174:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875409555848064:0@lo:400:kworker.0 00000100:00100000:2.0:1788530300.994197:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530300.994215:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37377480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875409555848576:0@lo:400:kworker.0 00000100:00100000:2.0:1788530300.994233:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530300.994281:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555847936 00000100:00100000:2.0:1788530300.994286:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555847936 00000100:00100000:2.0:1788530300.994324:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1788530300.994332:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f08cd0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555847936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530300.994375:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f08cd0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555847936:12345-0@lo:400:kworker.0 Request processed in 43us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530300.994382:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1788530300.994594:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555847424 00000100:00100000:0.0:1788530300.994599:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555847424 00000100:00100000:0.0:1788530300.994635:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788530300.994643:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555847424:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788530300.994664:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788530300.994703:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555847424:12345-0@lo:13:osp-pre-0-1.0 Request processed in 61us (748us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530300.994710:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788530300.995042:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555848448 00000100:00100000:2.0:1788530300.995048:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555848448 00000100:00100000:2.0:1788530300.995095:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788530300.995103:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555848448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530300.995134:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555848448:12345-0@lo:400:kworker.0 Request processed in 33us (1069us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530300.995139:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788530300.995156:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555847552 00000100:00100000:2.0:1788530300.995159:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555847552 00000100:00100000:2.0:1788530300.995178:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 446 00000100:00100000:2.0:1788530300.995182:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f396c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:3649:x1875409555847552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530300.995201:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f396c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:3649:x1875409555847552:12345-0@lo:400:kworker.0 Request processed in 19us (1048us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530300.995205:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 446 00000100:00100000:2.0:1788530300.995224:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555848064 00000100:00100000:2.0:1788530300.995226:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555848064 00000100:00100000:2.0:1788530300.995261:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555848576 00000100:00100000:2.0:1788530300.995263:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555848576 00000100:00100000:2.0:1788530300.995278:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:2.0:1788530300.995282:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875409555848064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530300.995303:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875409555848064:12345-0@lo:400:kworker.0 Request processed in 21us (1106us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530300.995320:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:2.0:1788530300.995332:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:2.0:1788530300.995339:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875409555848576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530300.995367:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875409555848576:12345-0@lo:400:kworker.0 Request processed in 28us (1132us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530300.995373:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00080000:2.0:1788530300.995416:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788530300.995421:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788530300.995437:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875409555847808:0@lo:400:kworker.0 00000100:00100000:2.0:1788530300.996784:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530300.996880:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37377800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555848320:0@lo:400:kworker.0 00000100:00100000:2.0:1788530300.996924:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530300.996953:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788530300.996960:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875409555847680:0@lo:400:kworker.0 00000100:00100000:2.0:1788530300.996983:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530300.998247:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875409555848192:0@lo:400:kworker.0 00000100:00100000:2.0:1788530300.998303:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530300.998322:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555847808 00000100:00100000:0.0:1788530300.998332:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555847808 00000100:00100000:1.0:1788530300.998412:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555847680 00000100:00100000:1.0:1788530300.998418:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555847680 00000100:00100000:1.0:1788530300.998599:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:1.0:1788530300.998610:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875409555847808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530300.998675:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875409555847808:12345-0@lo:400:kworker.0 Request processed in 66us (1898us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530300.998682:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:1.0:1788530300.998702:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:1.0:1788530300.998709:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875409555847680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530300.998772:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875409555847680:12345-0@lo:400:kworker.0 Request processed in 63us (1787us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530300.998779:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:2.0:1788530300.998998:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03e89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875409555848704:0@lo:400:kworker.0 00000100:00100000:2.0:1788530300.999037:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530300.999076:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875409555847808:0@lo:400:kworker.0 00000100:00100000:2.0:1788530300.999100:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875409555847680:0@lo:400:kworker.0 00000100:00100000:2.0:1788530300.999119:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555848320 00000100:00100000:2.0:1788530300.999121:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555848320 00000100:00100000:2.0:1788530300.999148:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788530300.999164:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555848320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530300.999202:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555848320:12345-0@lo:400:kworker.0 Request processed in 41us (2278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530300.999208:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788530300.999267:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788530300.999278:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555848832:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788530300.999310:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530300.999336:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555848192 00000100:00100000:2.0:1788530300.999340:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555848192 00000100:00100000:2.0:1788530300.999381:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555848704 00000100:00100000:2.0:1788530300.999383:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555848704 00000100:00100000:2.0:1788530300.999402:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:2.0:1788530300.999408:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875409555848192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530300.999439:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875409555848192:12345-0@lo:400:kworker.0 Request processed in 31us (1137us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530300.999445:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:2.0:1788530300.999839:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:2.0:1788530300.999849:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875409555848704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530300.999884:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875409555848704:12345-0@lo:400:kworker.0 Request processed in 39us (846us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530300.999891:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:2.0:1788530300.999916:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555848832 00000100:00100000:2.0:1788530300.999920:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555848832 00000100:00100000:2.0:1788530300.999951:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788530300.999958:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555848832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788530300.999977:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788530301.000077:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555848832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (765us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530301.000094:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788530301.000133:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555848832:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788530301.000156:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788530301.000177:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3649:1875409555847552:0@lo:400:kworker.0 00000100:00100000:2.0:1788530301.000192:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875409555848064:0@lo:400:kworker.0 00000100:00100000:2.0:1788530301.000205:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37377480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875409555848576:0@lo:400:kworker.0 00000100:00100000:2.0:1788530301.000224:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3740ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555847424:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788530301.000237:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555847936:0@lo:400:kworker.0 00000100:00100000:2.0:1788530301.000246:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37377100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555848448:0@lo:400:kworker.0 00010000:00080000:2.0:1788530301.000357:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e03d43100 x1875409555848192/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530301.000367:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875409555848192:0@lo:400:kworker.0 00010000:00080000:2.0:1788530301.000378:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e03e89880 x1875409555848704/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530301.000386:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03e89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875409555848704:0@lo:400:kworker.0 00000100:00100000:2.0:1788530301.000396:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37377800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555848320:0@lo:400:kworker.0 00000040:00080000:3.0:1788530301.062623:0:13816:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788530301.121636:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788530301.698540:0:13811:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788530301.698551:0:13811:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788530301.699071:0:13811:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:3.0:1788530301.699080:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788530301.929908:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530301.930028:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530301.930107:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530301.930142:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530301.930195:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531645440 00000100:00100000:1.0:1788530301.930207:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531645440 00000100:00100000:3.0:1788530301.930270:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531644928 00000100:00100000:3.0:1788530301.930278:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531644928 00000100:00100000:1.0:1788530301.930279:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 114 00000100:00100000:1.0:1788530301.930293:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:2402:x1875409531645440:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1788530301.930373:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:2402:x1875409531645440:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 82us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530301.930381:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 114 00000100:00100000:3.0:1788530301.930396:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 447 00000100:00100000:3.0:1788530301.930407:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f396c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f442bcd-b742-4e76-ad7b-709f731358a0+14:2402:x1875409531644928:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1788530301.930446:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f396c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f442bcd-b742-4e76-ad7b-709f731358a0+14:2402:x1875409531644928:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 41us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530301.930453:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 447 00000100:00080000:3.0:1788530301.930507:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788530301.931231:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530301.931302:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531645184 00000100:00100000:0.0:1788530301.931308:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531645184 00000100:00100000:0.0:1788530301.931357:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 389 00000100:00100000:0.0:1788530301.931366:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2402:x1875409531645184:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1788530301.931401:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2402:x1875409531645184:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 38us (1373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530301.931408:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 389 00000100:00100000:0.0:1788530301.931421:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531645696 00000100:00100000:0.0:1788530301.931423:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531645696 00000100:00100000:3.0:1788530301.931473:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 390 00000100:00100000:3.0:1788530301.931484:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2402:x1875409531645696:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1788530301.931523:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2402:x1875409531645696:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 41us (1379us total) trans 0 rc 0/0 00000100:00080000:0.0:1788530301.931688:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788530301.931783:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530301.931931:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531645056 00000100:00100000:0.0:1788530301.931935:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531645056 00000100:00100000:0.0:1788530301.931963:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 391 00000100:00100000:0.0:1788530301.931976:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f2b92ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+14:2402:x1875409531645056:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1788530301.932128:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f2b92ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+14:2402:x1875409531645056:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 143us (890us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530301.932136:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 391 00000100:00100000:2.0:1788530301.932271:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530301.932301:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531645312 00000100:00100000:2.0:1788530301.932305:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531645312 00000100:00100000:2.0:1788530301.932341:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 115 00000100:00100000:2.0:1788530301.932348:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2402:x1875409531645312:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1788530301.932377:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2402:x1875409531645312:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 30us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530301.932383:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 115 00000100:00080000:2.0:1788530301.932400:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788530301.932428:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531645568 00000100:00100000:2.0:1788530301.932431:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531645568 00000100:00100000:2.0:1788530301.932588:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 392 00000100:00100000:2.0:1788530301.932595:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+6:2402:x1875409531645568:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1788530301.932623:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+6:2402:x1875409531645568:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 29us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530301.932629:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 392 00000100:00080000:2.0:1788530301.932643:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788530301.938503:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 390 00000100:00100000:3.0:1788530302.022298:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555848960:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788530302.022459:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530302.022694:0:14186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555848960 00000100:00100000:2.0:1788530302.022704:0:14186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555848960 00000100:00100000:2.0:1788530302.022777:0:14186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1788530302.022787:0:14186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03eff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555848960:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788530302.024288:0:14186:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446453248 avail 1300213760 00000100:00100000:2.0:1788530302.024519:0:14186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03eff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555848960:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1729us (2054us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530302.024697:0:14186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1788530302.025290:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555848960:0@lo:41:osp-pre-1-0.0 00000001:00080000:0.0:1788530302.028138:0:6502:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967417 is committed 00010000:00010000:2.0:1788530302.145442:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530303.168829:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788530303.211085:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530303.211156:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531645824 00000100:00100000:3.0:1788530303.211165:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531645824 00000100:00100000:3.0:1788530303.211238:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 153 00000100:00100000:3.0:1788530303.211249:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+13:12204:x1875409531645824:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:3.0:1788530303.211268:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788530303.211347:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b000/0xb28d70e125750f8c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550a40 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530303.211406:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36be00/0xb28d70e125750f93 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530303.211423:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36be00/0xb28d70e125750f93 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530303.211434:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36be00/0xb28d70e125750f93 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530303.211449:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e125750f9a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530303.211456:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e125750f9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530303.211464:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e125750f9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530303.211537:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36be00/0xb28d70e125750f93 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530303.211546:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36be00/0xb28d70e125750f93 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530303.211552:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36be00/0xb28d70e125750f93 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530303.211580:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d36be00 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:3.0:1788530303.211585:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36be00/0xb28d70e125750f93 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530303.211593:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36be00/0xb28d70e125750f93 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530303.211605:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a9f32abdf00) 00010000:00010000:3.0:1788530303.211608:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788530303.211612:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36be00/0xb28d70e125750f93 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530303.211618:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36be00/0xb28d70e125750f93 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530303.211632:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e125750f9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530303.211638:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e125750f9a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530303.211643:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e125750f9a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530303.211654:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d36b200 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:3.0:1788530303.211657:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e125750f9a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530303.211663:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e125750f9a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530303.211671:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9a9f092c5e00) 00010000:00010000:3.0:1788530303.211673:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788530303.211676:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e125750f9a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530303.211681:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e125750f9a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530303.211712:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b000/0xb28d70e125750f8c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a40 expref: 14 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530303.211733:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a9f32abdf00) 00010000:00010000:3.0:1788530303.211735:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788530303.211739:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b000/0xb28d70e125750f8c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a40 expref: 14 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530303.211748:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d36b000, rc 0) 00000100:00100000:3.0:1788530303.211804:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+13:12204:x1875409531645824:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 557us (727us total) trans 0 rc 301/301 00000100:00100000:3.0:1788530303.211811:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 153 00000100:00080000:2.0:1788530303.211988:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788530303.218218:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530303.218291:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531646080 00000100:00100000:0.0:1788530303.218300:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531646080 00000100:00100000:0.0:1788530303.218380:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 154 00000100:00100000:0.0:1788530303.218391:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03cc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+13:12204:x1875409531646080:12345-192.168.202.41@tcp:36:lfs.0 00010000:00010000:0.0:1788530303.218449:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788530303.218484:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166800/0xb28d70e1257508e0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550864 expref: 13 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530303.218504:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a9f32abdf00) 00010000:00010000:0.0:1788530303.218509:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788530303.218630:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101000/0xb28d70e125750fa1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530303.218644:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea400/0xb28d70e125750f62 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a32 expref: 5 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530303.218654:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101000/0xb28d70e125750fa1 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530303.218686:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea400/0xb28d70e125750f62 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a32 expref: 5 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530303.218701:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea400/0xb28d70e125750f62 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a32 expref: 5 pid: 10720 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530303.218743:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03e88e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6524:1875409555849088:192.168.202.41@tcp:104: 00000100:00100000:0.0:1788530303.218838:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f181430c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788530303.222018:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03e88e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6524:1875409555849088:192.168.202.41@tcp:104: 00010000:00010000:2.0:1788530303.222048:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101000/0xb28d70e125750fa1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530303.226130:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530303.226217:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531646208 00000100:00100000:3.0:1788530303.226250:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531646208 00010000:00010000:3.0:1788530303.226326:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea400/0xb28d70e125750f62 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a32 expref: 6 pid: 10720 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530303.226419:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 87 00000100:00100000:3.0:1788530303.226434:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c59180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+6:2400:x1875409531646208:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788530303.226455:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788530303.226465:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea400/0xb28d70e125750f62 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a32 expref: 6 pid: 10720 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530303.226494:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea400/0xb28d70e125750f62 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a32 expref: 6 pid: 10720 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530303.226523:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea400/0xb28d70e125750f62 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a32 expref: 6 pid: 10720 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530303.226547:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a9f32abdf00) 00010000:00010000:3.0:1788530303.226552:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101000/0xb28d70e125750fa1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530303.226589:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101000/0xb28d70e125750fa1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530303.226598:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101000/0xb28d70e125750fa1 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530303.226624:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788530303.226681:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c59180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2400:x1875409531646208:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 249us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530303.226698:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 87 00010000:00010000:2.0:1788530303.226884:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101000/0xb28d70e125750fa1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530303.226893:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101000/0xb28d70e125750fa1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530303.226918:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d200/0xb28d70e125750fa8 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530303.226927:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d200/0xb28d70e125750fa8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530303.226935:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d200/0xb28d70e125750fa8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530303.227741:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d000/0xb28d70e125750faf lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530303.227754:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d000/0xb28d70e125750faf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530303.227761:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d000/0xb28d70e125750faf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788530303.227792:0:6524:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006fe1e2b3 reply state 0000000022b780fa transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d000/0xb28d70e125750faf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530303.227806:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d000/0xb28d70e125750faf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530303.227815:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a9f2b995b00) 00010000:00010000:2.0:1788530303.227818:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788530303.227821:0:6524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788530303.227828:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1788530303.227835:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101000/0xb28d70e125750fa1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530303.227842:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101000/0xb28d70e125750fa1 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530303.227849:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101000/0xb28d70e125750fa1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530303.227856:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d101000 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:2.0:1788530303.227860:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101000/0xb28d70e125750fa1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530303.227868:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101000/0xb28d70e125750fa1 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530303.227877:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a9f32abdf00) 00010000:00010000:2.0:1788530303.227880:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788530303.227883:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101000/0xb28d70e125750fa1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530303.227899:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101000/0xb28d70e125750fa1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788530303.227920:0:6524:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006fe1e2b3 reply state 0000000022b780fa transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d200/0xb28d70e125750fa8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530303.227929:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d200/0xb28d70e125750fa8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530303.227934:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9a9f2b995600) 00010000:00010000:2.0:1788530303.227936:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788530303.227938:0:6524:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1788530303.228057:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03cc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+14:12204:x1875409531646080:12345-192.168.202.41@tcp:36:lfs.0 Request processed in 9665us (9847us total) trans 4294967418 rc 0/0 00000100:00100000:2.0:1788530303.228066:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 154 00000100:00080000:2.0:1788530303.228113:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788530303.389978:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530303.390257:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531646336 00000100:00100000:1.0:1788530303.390271:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531646336 00000100:00100000:1.0:1788530303.390358:0:10719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 155 00000100:00100000:1.0:1788530303.390372:0:10719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+14:12212:x1875409531646336:12345-192.168.202.41@tcp:101:lctl.0 00010000:00010000:1.0:1788530303.390404:0:10719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530303.390438:0:10719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eba00/0xb28d70e125750fb6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550a47 expref: -99 pid: 10719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530303.390748:0:10719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb600/0xb28d70e125750fbd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530303.390767:0:10719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb600/0xb28d70e125750fbd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530303.391705:0:10719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb600/0xb28d70e125750fbd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788530303.402292:0:10719:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788530303.402303:0:10719:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788530303.402336:0:10719:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb600/0xb28d70e125750fbd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530303.402378:0:10719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eba00/0xb28d70e125750fb6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a47 expref: 16 pid: 10719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530303.402397:0:10719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb600/0xb28d70e125750fbd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a47 expref: 15 pid: 10719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530303.402407:0:10719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a9f32abda00) 00010000:00010000:1.0:1788530303.402410:0:10719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788530303.402413:0:10719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f012eb600, rc 0) 00000100:00100000:1.0:1788530303.404586:0:10719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+15:12212:x1875409531646336:12345-192.168.202.41@tcp:101:lctl.0 Request processed in 14188us (14597us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530303.404604:0:10719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 155 00000100:00100000:3.0:1788530303.503869:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530303.504226:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531646464 00000100:00100000:0.0:1788530303.504239:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531646464 00000100:00100000:0.0:1788530303.504315:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 156 00000100:00100000:0.0:1788530303.504328:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03efd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+15:12218:x1875409531646464:12345-192.168.202.41@tcp:101:bash.0 00010000:00010000:0.0:1788530303.504353:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530303.504374:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e125750fc4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550a4e expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530303.504444:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101a00/0xb28d70e125750fcb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530303.504458:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101a00/0xb28d70e125750fcb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530303.504470:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101a00/0xb28d70e125750fcb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530303.504480:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100000/0xb28d70e125750fd2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530303.504487:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100000/0xb28d70e125750fd2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530303.504493:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100000/0xb28d70e125750fd2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530303.504634:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101400/0xb28d70e125750fd9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530303.504658:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101400/0xb28d70e125750fd9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530303.504666:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101400/0xb28d70e125750fd9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788530303.504706:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1788530303.504718:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788530303.504741:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101400/0xb28d70e125750fd9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530303.504753:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101a00/0xb28d70e125750fcb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530303.504760:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101a00/0xb28d70e125750fcb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530303.504767:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101a00/0xb28d70e125750fcb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530303.504772:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d101a00 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:0.0:1788530303.504777:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101a00/0xb28d70e125750fcb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530303.504784:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101a00/0xb28d70e125750fcb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530303.504796:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a9f32abda00) 00010000:00010000:0.0:1788530303.504800:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788530303.504805:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101a00/0xb28d70e125750fcb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530303.504820:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101a00/0xb28d70e125750fcb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530303.504833:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100000/0xb28d70e125750fd2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530303.504839:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100000/0xb28d70e125750fd2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530303.504845:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100000/0xb28d70e125750fd2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530303.504850:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d100000 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:0.0:1788530303.504853:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100000/0xb28d70e125750fd2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530303.504858:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100000/0xb28d70e125750fd2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530303.504865:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9a9f2b995600) 00010000:00010000:0.0:1788530303.504867:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788530303.504870:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100000/0xb28d70e125750fd2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530303.504875:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100000/0xb28d70e125750fd2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530303.504897:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e125750fc4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a4e expref: 17 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530303.504909:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101400/0xb28d70e125750fd9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a4e expref: 16 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530303.504921:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a9f2b995b00) 00010000:00010000:0.0:1788530303.504923:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788530303.504926:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d101400, rc 0) 00000100:00100000:0.0:1788530303.504985:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03efd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+16:12218:x1875409531646464:12345-192.168.202.41@tcp:101:bash.0 Request processed in 660us (1126us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530303.504991:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 156 00000100:00100000:3.0:1788530303.507226:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530303.507329:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531646720 00000100:00100000:1.0:1788530303.507340:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531646720 00000100:00100000:1.0:1788530303.507421:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 157 00000100:00100000:1.0:1788530303.507440:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03efca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+16:12218:x1875409531646720:12345-192.168.202.41@tcp:101:bash.0 00010000:00010000:1.0:1788530303.507470:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530303.507496:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eba00/0xb28d70e125750fe0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550a55 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530303.507672:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb800/0xb28d70e125750fe7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530303.507724:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb800/0xb28d70e125750fe7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530303.507737:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb800/0xb28d70e125750fe7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530303.507802:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea000/0xb28d70e125750fee lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530303.507810:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea000/0xb28d70e125750fee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530303.507818:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea000/0xb28d70e125750fee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788530303.508218:0:6525:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:1.0:1788530303.509345:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eae00/0xb28d70e125750ff5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530303.509361:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eae00/0xb28d70e125750ff5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530303.509369:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eae00/0xb28d70e125750ff5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530303.509407:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb800/0xb28d70e125750fe7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530303.509414:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb800/0xb28d70e125750fe7 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530303.509421:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb800/0xb28d70e125750fe7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530303.509511:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f012eb800 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:1.0:1788530303.509517:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb800/0xb28d70e125750fe7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530303.509526:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb800/0xb28d70e125750fe7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530303.509542:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a9f2b995b00) 00010000:00010000:1.0:1788530303.509545:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788530303.509553:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb800/0xb28d70e125750fe7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530303.509850:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb800/0xb28d70e125750fe7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788530303.509868:0:6525:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000536238ff reply state 00000000b4090656 transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea000/0xb28d70e125750fee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530303.509879:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea000/0xb28d70e125750fee lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530303.509885:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9a9f32abd600) 00010000:00010000:1.0:1788530303.509888:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788530303.509892:0:6525:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788530303.509936:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eba00/0xb28d70e125750fe0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a55 expref: 19 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530303.509951:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eae00/0xb28d70e125750ff5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a55 expref: 18 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530303.510902:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a9f32abd200) 00010000:00010000:1.0:1788530303.510905:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788530303.510908:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f012eae00, rc 0) 00000100:00100000:1.0:1788530303.511010:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03efca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+19:12218:x1875409531646720:12345-192.168.202.41@tcp:101:bash.0 Request processed in 3576us (3793us total) trans 4294967419 rc 0/0 00000100:00100000:1.0:1788530303.511019:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 157 00000100:00100000:1.0:1788530303.516162:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530303.516347:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531646848 00000100:00100000:3.0:1788530303.516360:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531646848 00000100:00080000:0.0:1788530303.516516:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788530303.516749:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 56 00000100:00100000:3.0:1788530303.516768:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03cc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2399:x1875409531646848:12345-192.168.202.41@tcp:101:bash.0 00010000:00010000:3.0:1788530303.516793:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788530303.516820:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000033f0b190/0xb28d70e125751003 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550a5c expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788530303.516850:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788530303.516873:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=511s v=(0 0) 00010000:00010000:3.0:1788530303.516878:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788530303.516891:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033f0b190/0xb28d70e125751003 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a5c expref: 6 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530303.517069:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000033f0b190/0xb28d70e125751003 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a5c expref: 6 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530303.517089:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d36b000, rc 0) 00000100:00100000:3.0:1788530303.517348:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03cc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:2399:x1875409531646848:12345-192.168.202.41@tcp:101:bash.0 Request processed in 585us (1196us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530303.517357:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 56 00000100:00100000:2.0:1788530303.526948:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530303.527230:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531646976 00000100:00100000:0.0:1788530303.527242:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531646976 00000100:00100000:0.0:1788530303.527316:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 57 00000100:00100000:0.0:1788530303.527329:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:12218:x1875409531646976:12345-192.168.202.41@tcp:101:bash.0 00010000:00010000:0.0:1788530303.527356:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530303.527380:0:8438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d24c096/0xb28d70e12575100a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550a63 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530303.527418:0:8438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000033f0b190/0xb28d70e125751003 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a5c expref: 7 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530303.527428:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788530303.527444:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788530303.527451:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d24c096/0xb28d70e12575100a lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a63 expref: 7 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530303.527497:0:8438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000033f0b190/0xb28d70e125751003 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a5c expref: 7 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530303.527537:0:8438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000033f0b190/0xb28d70e125751003 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a5c expref: 7 pid: 8436 timeout: 611 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530303.527554:0:8438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03e8a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8438:1875409555849216:192.168.202.41@tcp:104: 00000100:00100000:0.0:1788530303.527705:0:8438:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f18143000 going to sleep for 11 seconds 00000100:00100000:0.0:1788530303.530452:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530303.530539:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531647104 00000100:00100000:1.0:1788530303.530548:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531647104 00010000:00010000:1.0:1788530303.530634:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000033f0b190/0xb28d70e125751003 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a5c expref: 8 pid: 8436 timeout: 611 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530303.530670:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 88 00000100:00100000:1.0:1788530303.530681:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f396c2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+8:2400:x1875409531647104:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788530303.530694:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788530303.530725:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000033f0b190/0xb28d70e125751003 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a5c expref: 8 pid: 8436 timeout: 611 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530303.530738:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000033f0b190/0xb28d70e125751003 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a5c expref: 8 pid: 8436 timeout: 611 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530303.530761:0:6510:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788530303.530766:0:6510:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788530303.530775:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008d24c096/0xb28d70e12575100a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a63 expref: 8 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530303.530804:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d24c096/0xb28d70e12575100a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a63 expref: 8 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530303.530845:0:6510:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000008d24c096/0xb28d70e12575100a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a63 expref: 8 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530303.530859:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03cc7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6510:1875409555849344:192.168.202.41@tcp:105: 00000100:00100000:1.0:1788530303.530953:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f32b9f000 going to sleep for 11 seconds 00000100:00100000:0.0:1788530303.533787:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03cc7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6510:1875409555849344:192.168.202.41@tcp:105: 00010000:00010000:0.0:1788530303.533822:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788530303.534035:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f396c2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+8:2400:x1875409531647104:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 3353us (3596us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530303.534049:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 88 00010000:00010000:2.0:1788530303.538542:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033f0b190/0xb28d70e125751003 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a5c expref: 7 pid: 8436 timeout: 611 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530303.538585:0:8438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03e8a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8438:1875409555849216:192.168.202.41@tcp:104: 00010000:00010000:2.0:1788530303.538619:0:8438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d24c096/0xb28d70e12575100a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a63 expref: 6 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530303.538636:0:8438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d100000, rc 0) 00000100:00100000:2.0:1788530303.538699:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:12218:x1875409531646976:12345-192.168.202.41@tcp:101:bash.0 Request processed in 11372us (11764us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530303.538730:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 57 00000100:00100000:3.0:1788530303.543384:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530303.543804:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531647360 00000100:00100000:2.0:1788530303.543816:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531647360 00000100:00100000:2.0:1788530303.543885:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 36 00000100:00100000:2.0:1788530303.544126:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03efe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+19:12218:x1875409531647360:12345-192.168.202.41@tcp:35:bash.0 00000001:00080000:2.0:1788530303.544662:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967420 00000100:00100000:2.0:1788530303.544904:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03efe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+21:12218:x1875409531647360:12345-192.168.202.41@tcp:35:bash.0 Request processed in 998us (1528us total) trans 4294967421 rc 0/0 00000100:00100000:2.0:1788530303.544915:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 36 00000020:00080000:2.0:1788530303.544922:0:6526:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788530303.642077:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530303.642894:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531647616 00000100:00100000:2.0:1788530303.642910:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531647616 00000100:00100000:2.0:1788530303.643079:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 158 00000100:00100000:2.0:1788530303.643093:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03efc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+21:12228:x1875409531647616:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:2.0:1788530303.643120:0:8678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530303.643206:0:8678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d600/0xb28d70e125751011 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550a6a expref: -99 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788530303.643598:0:8678:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1788530303.645105:0:8678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d600/0xb28d70e125751011 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a6a expref: 23 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530303.645127:0:8678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a9f32abda00) 00010000:00010000:2.0:1788530303.645340:0:8678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788530303.645528:0:8678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d600/0xb28d70e125751011 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a6a expref: 23 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530303.645613:0:8678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d20d600, rc 0) 00000100:00100000:2.0:1788530303.646294:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03efc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+22:12228:x1875409531647616:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 3197us (4220us total) trans 4294967422 rc 301/301 00000100:00100000:2.0:1788530303.646307:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 158 00000100:00100000:3.0:1788530303.658287:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530303.659599:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531647872 00000100:00100000:2.0:1788530303.659783:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531647872 00000100:00100000:2.0:1788530303.659852:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 37 00000100:00100000:2.0:1788530303.659863:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03efce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+22:12228:x1875409531647872:12345-192.168.202.41@tcp:35:lfs.0 00000100:00100000:2.0:1788530303.660324:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03efce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+23:12228:x1875409531647872:12345-192.168.202.41@tcp:35:lfs.0 Request processed in 461us (2045us total) trans 4294967423 rc 0/0 00000100:00100000:2.0:1788530303.660334:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 37 00000100:00100000:1.0:1788530303.799630:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530303.799779:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531648000 00000100:00100000:3.0:1788530303.799794:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531648000 00000100:00100000:3.0:1788530303.799900:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 159 00000100:00100000:3.0:1788530303.799915:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03cc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+23:12234:x1875409531648000:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:3.0:1788530303.799955:0:10720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788530303.800003:0:10720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e12575101f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550a71 expref: -99 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530303.800116:0:10720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36be00/0xb28d70e125751026 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530303.800134:0:10720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36be00/0xb28d70e125751026 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530303.800147:0:10720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36be00/0xb28d70e125751026 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788530303.800203:0:10720:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1788530303.800208:0:10720:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788530303.800233:0:10720:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36be00/0xb28d70e125751026 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530303.800280:0:10720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e12575101f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a71 expref: 25 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530303.800306:0:10720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36be00/0xb28d70e125751026 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a71 expref: 24 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530303.800343:0:10720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a9f2b995b00) 00010000:00010000:3.0:1788530303.800346:0:10720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788530303.800351:0:10720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d36be00, rc 0) 00000100:00100000:3.0:1788530303.800791:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03cc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+24:12234:x1875409531648000:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 878us (1169us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530303.800800:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 159 00000100:00100000:3.0:1788530303.818853:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530303.826633:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531648256 00000100:00100000:2.0:1788530303.826652:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531648256 00000100:00100000:2.0:1788530303.826783:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 160 00000100:00100000:2.0:1788530303.826797:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03eff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+24:12234:x1875409531648256:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:2.0:1788530303.827523:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530303.827550:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d600/0xb28d70e12575102d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550a78 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530303.827705:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ce00/0xb28d70e125751034 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530303.827731:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ce00/0xb28d70e125751034 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530303.827744:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ce00/0xb28d70e125751034 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788530303.827777:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788530303.827929:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d600/0xb28d70e12575102d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a78 expref: 27 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530303.827954:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ce00/0xb28d70e125751034 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a78 expref: 26 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530303.827968:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a9f32abd200) 00010000:00010000:2.0:1788530303.827971:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788530303.830192:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d20ce00, rc 0) 00000100:00100000:2.0:1788530303.830306:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03eff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+26:12234:x1875409531648256:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 3508us (11460us total) trans 4294967424 rc 0/0 00000100:00100000:2.0:1788530303.830316:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 160 00000100:00100000:1.0:1788530303.847883:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530303.848074:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530303.849812:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531648640 00000100:00100000:0.0:1788530303.849827:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531648640 00000100:00100000:0.0:1788530303.849914:0:10719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 161 00000100:00100000:0.0:1788530303.849925:0:10719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03cc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+26:12234:x1875409531648640:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:0.0:1788530303.849949:0:10719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530303.849969:0:10719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101a00/0xb28d70e125751042 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550a7f expref: -99 pid: 10719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530303.850078:0:10719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e125751049 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530303.850096:0:10719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e125751049 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530303.850130:0:10719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e125751049 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788530303.850146:0:10719:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788530303.850298:0:10719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101a00/0xb28d70e125751042 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a7f expref: 29 pid: 10719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530303.850323:0:10719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e125751049 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a7f expref: 28 pid: 10719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530303.850334:0:10719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a9f32abd200) 00010000:00010000:0.0:1788530303.850338:0:10719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788530303.850343:0:10719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d101c00, rc 0) 00000100:00100000:0.0:1788530303.850457:0:10719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03cc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+28:12234:x1875409531648640:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 534us (2382us total) trans 4294967425 rc 0/0 00000100:00100000:0.0:1788530303.850465:0:10719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 161 00000100:00100000:3.0:1788530303.859107:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531648384 00000100:00100000:3.0:1788530303.859129:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531648384 00000100:00100000:3.0:1788530303.859290:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 9 00000100:00100000:3.0:1788530303.859303:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03cc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+28:2402:x1875409531648384:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788530303.859321:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788530303.859354:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ce00/0xb28d70e125751034 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a78 expref: 28 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530303.859378:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a9f32abd200) 00010000:00010000:3.0:1788530303.859384:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788530303.859476:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03cc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+27:2402:x1875409531648384:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 175us (11608us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530303.859484:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 9 00000100:00100000:1.0:1788530303.873210:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530303.873594:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531648768 00000100:00100000:0.0:1788530303.873607:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531648768 00000100:00100000:0.0:1788530303.873677:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 58 00000100:00100000:0.0:1788530303.873689:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03cc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:2401:x1875409531648768:12345-192.168.202.41@tcp:1:lfs.0 00010000:00010000:0.0:1788530303.873750:0:8439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc8b2d1a/0xb28d70e125751057 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530303.873773:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008d24c096/0xb28d70e12575100a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a63 expref: 6 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530303.873782:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788530303.873803:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788530303.873809:0:8439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc8b2d1a/0xb28d70e125751057 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530303.873852:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008d24c096/0xb28d70e12575100a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a63 expref: 6 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530303.873868:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008d24c096/0xb28d70e12575100a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a63 expref: 6 pid: 8438 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530303.873884:0:8439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03e8a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8439:1875409555849472:192.168.202.41@tcp:104: 00000100:00100000:0.0:1788530303.874013:0:8439:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f18143180 going to sleep for 11 seconds 00000100:00100000:1.0:1788530303.882697:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530303.883009:0:8439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03e8a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8439:1875409555849472:192.168.202.41@tcp:104: 00010000:00010000:0.0:1788530303.883046:0:8439:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000dc8b2d1a/0xb28d70e125751057 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530303.883305:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531648896 00000100:00100000:3.0:1788530303.883313:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531648896 00002000:00100000:3.0:1788530303.883363:0:8444:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff9a9e03cc5880 x1875409531648896/t0(0) o4->aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41@192.168.202.41@tcp:244/0 lens 504/0 e 0 to 0 dl 1788530314 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788530303.883373:0:8444:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a9e03cc5880 with x1875409531648896 ext(0->12) 00010000:00010000:3.0:1788530303.883395:0:8444:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000008d24c096/0xb28d70e12575100a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a63 expref: 7 pid: 8438 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530303.883409:0:8444:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000008d24c096/0xb28d70e12575100a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a63 expref: 7 pid: 8438 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788530303.883417:0:8444:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9a9e03cc5880 00000100:00100000:3.0:1788530303.883455:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 2 00000100:00100000:3.0:1788530303.883465:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03cc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+7:2399:x1875409531648896:12345-192.168.202.41@tcp:4:lfs.0 00000100:00100000:3.0:1788530303.885004:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03cc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+9:2399:x1875409531648896:12345-192.168.202.41@tcp:4:lfs.0 Request processed in 1533us (2317us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1788530303.885015:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 2 00002000:00100000:3.0:1788530303.885024:0:8444:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff9a9e03cc5880 x1875409531648896/t4294967306(0) o4->aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41@192.168.202.41@tcp:244/0 lens 504/448 e 0 to 0 dl 1788530314 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788530303.885034:0:8444:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a9e03cc5880 with x1875409531648896 ext(0->12) 00010000:00010000:3.0:1788530303.885042:0:8444:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000008d24c096/0xb28d70e12575100a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a63 expref: 9 pid: 8438 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530303.885367:0:8444:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000008d24c096/0xb28d70e12575100a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a63 expref: 9 pid: 8438 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788530303.885377:0:8444:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9a9e03cc5880 00000100:00100000:2.0:1788530303.894220:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530303.894314:0:10347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531649024 00000100:00100000:0.0:1788530303.894326:0:10347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531649024 00010000:00010000:0.0:1788530303.894373:0:10347:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008d24c096/0xb28d70e12575100a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a63 expref: 9 pid: 8438 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530303.894421:0:10347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 89 00000100:00100000:0.0:1788530303.894434:0:10347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c5a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+9:2400:x1875409531649024:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788530303.894453:0:10347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788530303.894476:0:10347:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788530303.894490:0:10347:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1788530303 00002000:00010000:0.0:1788530303.894511:0:10347:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1788530303 00002000:00010000:0.0:1788530303.894513:0:10347:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1788530303 00002000:00010000:0.0:1788530303.894516:0:10347:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1788530303.894527:0:10347:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008d24c096/0xb28d70e12575100a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a63 expref: 9 pid: 8438 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530303.894542:0:10347:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008d24c096/0xb28d70e12575100a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a63 expref: 9 pid: 8438 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530303.894617:0:10347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d24c096/0xb28d70e12575100a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a63 expref: 9 pid: 8438 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530303.894639:0:10347:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788530303.894643:0:10347:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788530303.894650:0:10347:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000dc8b2d1a/0xb28d70e125751057 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530303.894660:0:10347:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc8b2d1a/0xb28d70e125751057 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530303.894689:0:10347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788530303.894777:0:10347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c5a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+8:2400:x1875409531649024:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 346us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530303.894786:0:10347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 89 00010000:00010000:2.0:1788530303.895295:0:8439:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000dc8b2d1a/0xb28d70e125751057 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530303.895307:0:8439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dc8b2d1a/0xb28d70e125751057 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530303.895333:0:8439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc8b2d1a/0xb28d70e125751057 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530303.895343:0:8439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dc8b2d1a/0xb28d70e125751057 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530303.895368:0:8439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dc8b2d1a/0xb28d70e125751057 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530303.895376:0:8439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d101a00 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:2.0:1788530303.895381:0:8439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc8b2d1a/0xb28d70e125751057 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530303.895391:0:8439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc8b2d1a/0xb28d70e125751057 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530303.895405:0:8439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dc8b2d1a/0xb28d70e125751057 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530303.895411:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc8b2d1a/0xb28d70e125751057 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530303.895479:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03cc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+7:2401:x1875409531648768:12345-192.168.202.41@tcp:1:lfs.0 Request processed in 21792us (22286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530303.895489:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 58 00000100:00100000:1.0:1788530303.899957:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530303.900019:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531649280 00000100:00100000:2.0:1788530303.900028:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531649280 00000100:00100000:2.0:1788530303.900095:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 38 00000100:00100000:2.0:1788530303.900106:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3959e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+27:12234:x1875409531649280:12345-192.168.202.41@tcp:35:lfs.0 00000004:00010000:2.0:1788530303.900176:0:6526:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e125751049 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a7f expref: 27 pid: 10719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788530303.900457:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:2.0:1788530303.900495:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000001:00080000:2.0:1788530303.901683:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00010000:00010000:2.0:1788530303.902086:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c200/0xb28d70e12575105e lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530303.902109:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eae00/0xb28d70e125750ff5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a55 expref: 31 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530303.902119:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c200/0xb28d70e12575105e lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530303.902173:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eae00/0xb28d70e125750ff5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a55 expref: 31 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530303.902192:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eae00/0xb28d70e125750ff5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a55 expref: 31 pid: 6525 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530303.902210:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03c59c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6526:1875409555849600:192.168.202.41@tcp:104: 00000100:00100000:2.0:1788530303.902346:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e02768000 going to sleep for 11 seconds 00000100:00100000:2.0:1788530303.906726:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03c59c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6526:1875409555849600:192.168.202.41@tcp:104: 00010000:00010000:2.0:1788530303.906760:0:6526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c200/0xb28d70e12575105e lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530303.908373:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530303.908481:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531649408 00000100:00100000:2.0:1788530303.908491:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531649408 00010000:00010000:2.0:1788530303.908533:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eae00/0xb28d70e125750ff5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a55 expref: 32 pid: 6525 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530303.908636:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 90 00000100:00100000:2.0:1788530303.908646:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03cc4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+32:2399:x1875409531649408:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788530303.908664:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788530303.908672:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eae00/0xb28d70e125750ff5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a55 expref: 32 pid: 6525 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530303.908685:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eae00/0xb28d70e125750ff5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a55 expref: 32 pid: 6525 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530303.908715:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eae00/0xb28d70e125750ff5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a55 expref: 32 pid: 6525 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530303.909128:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a9f32abd200) 00010000:00010000:2.0:1788530303.909134:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c200/0xb28d70e12575105e lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530303.909144:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c200/0xb28d70e12575105e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530303.909153:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c200/0xb28d70e12575105e lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530303.909191:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788530303.909327:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03cc4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+31:2399:x1875409531649408:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 680us (962us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530303.909335:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 90 00010000:00010000:1.0:1788530303.909503:0:6526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c200/0xb28d70e12575105e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530303.909512:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c200/0xb28d70e12575105e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788530303.909670:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000001:00080000:1.0:1788530303.909817:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:1.0:1788530303.909936:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03cc6a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6526:1875409555849728:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788530303.910013:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530303.910044:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f32b9f000 going to sleep for 11 seconds 00000100:00100000:2.0:1788530303.911169:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555849728 00000100:00100000:2.0:1788530303.911191:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555849728 00000100:00100000:2.0:1788530303.911265:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1788530303.911274:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03cc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6526:x1875409555849728:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788530303.911382:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03cc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6526:x1875409555849728:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 109us (1369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530303.911389:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00080000:1.0:1788530303.911643:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788530303.911685:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03cc6a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6526:1875409555849728:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788530303.911849:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00000100:00100000:1.0:1788530303.911953:0:6526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03cc6a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6526:1875409555849856:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788530303.912202:0:6526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530303.912250:0:6526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f32b9f600 going to sleep for 11 seconds 00000100:00100000:2.0:1788530303.912408:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555849856 00000100:00100000:2.0:1788530303.912415:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555849856 00000100:00100000:2.0:1788530303.912482:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1788530303.912492:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03cc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6526:x1875409555849856:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788530303.912673:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03cc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6526:x1875409555849856:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 181us (470us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788530303.912680:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1788530303.913214:0:6526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03cc6a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6526:1875409555849856:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788530303.913297:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:1.0:1788530303.913346:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c200/0xb28d70e12575105e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530303.913357:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c200/0xb28d70e12575105e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530303.913365:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c200/0xb28d70e12575105e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530303.913371:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d20c200 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:1.0:1788530303.913375:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c200/0xb28d70e12575105e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530303.913383:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c200/0xb28d70e12575105e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530303.913399:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a9f32abd200) 00010000:00010000:1.0:1788530303.913402:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788530303.913407:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c200/0xb28d70e12575105e lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530303.913413:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c200/0xb28d70e12575105e lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788530303.913719:0:6526:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788530303.913783:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:1.0:1788530303.913796:0:6526:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 511816234495ns, next at 512816232329ns, rc = 0 00000001:00080000:1.0:1788530303.913802:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967433 00010000:00010000:1.0:1788530303.913825:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a9f32abd200) 00010000:00010000:1.0:1788530303.913829:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788530303.913836:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e125751049 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a7f expref: 35 pid: 10719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530303.914189:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3959e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+34:12234:x1875409531649280:12345-192.168.202.41@tcp:35:lfs.0 Request processed in 14083us (14243us total) trans 4294967434 rc 0/0 00000100:00100000:1.0:1788530303.914199:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 38 00000020:00080000:1.0:1788530303.914206:0:6526:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788530303.920496:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530303.920740:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531649536 00000100:00100000:2.0:1788530303.920755:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531649536 00000100:00100000:2.0:1788530303.920872:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 162 00000100:00100000:2.0:1788530303.920885:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03efc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+34:12234:x1875409531649536:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:2.0:1788530303.920924:0:10720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530303.920949:0:10720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20dc00/0xb28d70e125751065 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550a86 expref: -99 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530303.921015:0:10720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20dc00/0xb28d70e125751065 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a86 expref: 35 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530303.921029:0:10720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20dc00/0xb28d70e125751065 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a86 expref: 35 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530303.921065:0:10720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a9f2b995500) 00010000:00010000:2.0:1788530303.921068:0:10720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788530303.921072:0:10720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d20dc00, rc 0) 00000100:00100000:2.0:1788530303.921128:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03efc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+35:12234:x1875409531649536:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 246us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530303.921135:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 162 00000100:00100000:0.0:1788530303.925022:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530303.925303:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531649792 00000100:00100000:3.0:1788530303.925318:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531649792 00000100:00100000:3.0:1788530303.925393:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 39 00000100:00100000:3.0:1788530303.925425:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03e8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+35:12234:x1875409531649792:12345-192.168.202.41@tcp:35:lfs.0 00000100:00100000:3.0:1788530303.925873:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03e8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+36:12234:x1875409531649792:12345-192.168.202.41@tcp:35:lfs.0 Request processed in 449us (867us total) trans 4294967435 rc 0/0 00000100:00100000:3.0:1788530303.925881:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 39 00000100:00100000:1.0:1788530304.044268:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530304.044464:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531650048 00000100:00100000:0.0:1788530304.044479:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531650048 00000100:00100000:0.0:1788530304.044636:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 163 00000100:00100000:0.0:1788530304.044668:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03cc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+36:12244:x1875409531650048:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:0.0:1788530304.044714:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530304.044740:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100400/0xb28d70e12575106c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550a8d expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788530304.044879:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1788530304.045032:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100400/0xb28d70e12575106c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a8d expref: 38 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530304.045049:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a9f32abda00) 00010000:00010000:0.0:1788530304.045053:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788530304.045060:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100400/0xb28d70e12575106c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a8d expref: 38 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530304.045079:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d100400, rc 0) 00000100:00100000:0.0:1788530304.045158:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03cc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+37:12244:x1875409531650048:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 494us (913us total) trans 4294967436 rc 301/301 00000100:00100000:0.0:1788530304.045168:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 163 00000100:00100000:3.0:1788530304.049010:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530304.049182:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531650176 00000100:00100000:1.0:1788530304.049194:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531650176 00000100:00100000:1.0:1788530304.049272:0:10719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 164 00000100:00100000:1.0:1788530304.049285:0:10719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03efe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+37:12244:x1875409531650176:12345-192.168.202.41@tcp:34:lfs.0 00010000:00010000:1.0:1788530304.049397:0:10719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb000/0xb28d70e12575107a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530304.049420:0:10719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb000/0xb28d70e12575107a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530304.049437:0:10719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb000/0xb28d70e12575107a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530304.049449:0:10719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e125751081 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530304.049475:0:10719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e125751081 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530304.049482:0:10719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e125751081 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530304.049642:0:10719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ebe00/0xb28d70e125751088 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530304.049652:0:10719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ebe00/0xb28d70e125751088 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530304.049658:0:10719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ebe00/0xb28d70e125751088 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788530304.049724:0:10719:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ebe00/0xb28d70e125751088 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530304.049738:0:10719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb000/0xb28d70e12575107a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530304.049744:0:10719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb000/0xb28d70e12575107a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530304.049751:0:10719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb000/0xb28d70e12575107a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530304.049758:0:10719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f012eb000 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:1.0:1788530304.049762:0:10719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb000/0xb28d70e12575107a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530304.049771:0:10719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb000/0xb28d70e12575107a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530304.049791:0:10719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a9f2b995b00) 00010000:00010000:1.0:1788530304.049795:0:10719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788530304.049801:0:10719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb000/0xb28d70e12575107a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530304.049807:0:10719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb000/0xb28d70e12575107a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530304.049822:0:10719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e125751081 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530304.049828:0:10719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e125751081 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530304.049834:0:10719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e125751081 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530304.049839:0:10719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f012eac00 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:1.0:1788530304.049843:0:10719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e125751081 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530304.049848:0:10719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e125751081 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530304.049856:0:10719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9a9f32abd600) 00010000:00010000:1.0:1788530304.049858:0:10719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788530304.049860:0:10719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e125751081 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530304.049865:0:10719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e125751081 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530304.049886:0:10719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ebe00/0xb28d70e125751088 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530304.049892:0:10719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ebe00/0xb28d70e125751088 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530304.049898:0:10719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ebe00/0xb28d70e125751088 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530304.049902:0:10719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f012ebe00 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:1.0:1788530304.049905:0:10719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ebe00/0xb28d70e125751088 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530304.049912:0:10719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ebe00/0xb28d70e125751088 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530304.049919:0:10719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a9f2b995500) 00010000:00010000:1.0:1788530304.049922:0:10719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788530304.049925:0:10719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ebe00/0xb28d70e125751088 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530304.049930:0:10719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ebe00/0xb28d70e125751088 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530304.050157:0:10719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03efe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+37:12244:x1875409531650176:12345-192.168.202.41@tcp:34:lfs.0 Request processed in 873us (1155us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530304.050166:0:10719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 164 00000100:00100000:1.0:1788530304.053813:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530304.053906:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531650432 00000100:00100000:3.0:1788530304.053919:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531650432 00000100:00100000:3.0:1788530304.053999:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 40 00000100:00100000:3.0:1788530304.054012:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03cc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+37:12244:x1875409531650432:12345-192.168.202.41@tcp:35:lfs.0 00000100:00100000:3.0:1788530304.054267:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03cc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+38:12244:x1875409531650432:12345-192.168.202.41@tcp:35:lfs.0 Request processed in 257us (468us total) trans 4294967437 rc 0/0 00000100:00100000:3.0:1788530304.054277:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 40 00000100:00100000:3.0:1788530304.092206:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530304.092323:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531650688 00000100:00100000:0.0:1788530304.092334:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531650688 00000100:00100000:0.0:1788530304.092413:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 165 00000100:00100000:0.0:1788530304.092424:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03efce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+38:12247:x1875409531650688:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:0.0:1788530304.092461:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530304.092483:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100400/0xb28d70e12575108f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550a94 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530304.092611:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100800/0xb28d70e125751096 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530304.092638:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100800/0xb28d70e125751096 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530304.092649:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100800/0xb28d70e125751096 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530304.092661:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e12575109d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530304.092668:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e12575109d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530304.092674:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e12575109d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530304.092793:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101600/0xb28d70e1257510a4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530304.092802:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101600/0xb28d70e1257510a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530304.092809:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101600/0xb28d70e1257510a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788530304.092818:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788530304.092895:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100800/0xb28d70e125751096 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530304.092905:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100800/0xb28d70e125751096 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530304.092911:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100800/0xb28d70e125751096 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530304.092924:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d100800 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:0.0:1788530304.092929:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100800/0xb28d70e125751096 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530304.092936:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100800/0xb28d70e125751096 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530304.092947:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a9f2b995b00) 00010000:00010000:0.0:1788530304.092949:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788530304.092954:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100800/0xb28d70e125751096 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530304.092960:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100800/0xb28d70e125751096 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530304.092974:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e12575109d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530304.092979:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e12575109d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530304.092985:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e12575109d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530304.092990:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d101c00 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:0.0:1788530304.092993:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e12575109d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530304.092999:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e12575109d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530304.093016:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9a9f32abd600) 00010000:00010000:0.0:1788530304.093018:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788530304.093021:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e12575109d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530304.093027:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e12575109d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530304.093066:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100400/0xb28d70e12575108f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a94 expref: 41 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530304.093080:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101600/0xb28d70e1257510a4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a94 expref: 40 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530304.093086:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a9f2b995500) 00010000:00010000:0.0:1788530304.093089:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788530304.093091:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d101600, rc 0) 00000100:00100000:0.0:1788530304.093140:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03efce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+40:12247:x1875409531650688:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 718us (945us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1788530304.093147:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 165 00000100:00100000:0.0:1788530304.097084:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530304.097173:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531650816 00000100:00100000:1.0:1788530304.097182:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531650816 00000100:00100000:1.0:1788530304.097284:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 166 00000100:00100000:1.0:1788530304.097299:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03e88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+40:12247:x1875409531650816:12345-192.168.202.41@tcp:54:lfs.0 00010000:00010000:1.0:1788530304.097406:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e1257510b2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530304.097432:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e1257510b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530304.097445:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e1257510b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530304.097484:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e1257510b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530304.097491:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e1257510b2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530304.097498:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e1257510b2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530304.097504:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f012eac00 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:1.0:1788530304.097508:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e1257510b2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530304.097515:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e1257510b2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530304.097528:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a9f2b995500) 00010000:00010000:1.0:1788530304.097531:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788530304.097536:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e1257510b2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530304.097553:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eac00/0xb28d70e1257510b2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530304.097830:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03e88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+40:12247:x1875409531650816:12345-192.168.202.41@tcp:54:lfs.0 Request processed in 534us (756us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530304.097839:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 166 00000100:00100000:1.0:1788530304.100534:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530304.100649:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531651072 00000100:00100000:3.0:1788530304.100658:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531651072 00000100:00100000:3.0:1788530304.100724:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 41 00000100:00100000:3.0:1788530304.100734:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0375f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+40:12247:x1875409531651072:12345-192.168.202.41@tcp:35:lfs.0 00000100:00100000:3.0:1788530304.101000:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0375f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+41:12247:x1875409531651072:12345-192.168.202.41@tcp:35:lfs.0 Request processed in 266us (476us total) trans 4294967439 rc 0/0 00000100:00100000:3.0:1788530304.101008:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 41 00010000:00010000:1.0:1788530304.192871:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788530304.399269:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530304.399650:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531651328 00000100:00100000:2.0:1788530304.399666:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531651328 00000100:00100000:2.0:1788530304.399807:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 167 00000100:00100000:2.0:1788530304.399821:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0375d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+41:12278:x1875409531651328:12345-192.168.202.41@tcp:101:cat.0 00010000:00010000:2.0:1788530304.399858:0:8678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530304.399890:0:8678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c200/0xb28d70e1257510b9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550a9b expref: -99 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530304.400067:0:8678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d600/0xb28d70e1257510c0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530304.400089:0:8678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d600/0xb28d70e1257510c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530304.400107:0:8678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d600/0xb28d70e1257510c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788530304.400122:0:8678:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788530304.401710:0:8678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c200/0xb28d70e1257510b9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a9b expref: 44 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530304.401764:0:8678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d600/0xb28d70e1257510c0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a9b expref: 43 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530304.401774:0:8678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a9f2b995500) 00010000:00010000:2.0:1788530304.401778:0:8678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788530304.401782:0:8678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d20d600, rc 0) 00000100:00100000:2.0:1788530304.401908:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0375d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+43:12278:x1875409531651328:12345-192.168.202.41@tcp:101:cat.0 Request processed in 2088us (2654us total) trans 4294967440 rc 0/0 00000100:00100000:2.0:1788530304.401917:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 167 00000100:00100000:3.0:1788530304.408673:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530304.408764:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531651456 00000100:00100000:0.0:1788530304.408776:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531651456 00000100:00100000:0.0:1788530304.408850:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 10 00000100:00100000:0.0:1788530304.408861:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03efd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+43:2400:x1875409531651456:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788530304.408883:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788530304.408921:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d600/0xb28d70e1257510c0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a9b expref: 43 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530304.408963:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a9f2b995500) 00010000:00010000:0.0:1788530304.408969:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788530304.409904:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03efd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+42:2400:x1875409531651456:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 1039us (1239us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530304.409916:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 10 00000100:00100000:3.0:1788530304.412293:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530304.412758:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531651712 00000100:00100000:2.0:1788530304.412770:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531651712 00000100:00100000:2.0:1788530304.412839:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 42 00000100:00100000:2.0:1788530304.412851:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03efd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+42:12278:x1875409531651712:12345-192.168.202.41@tcp:35:cat.0 00000100:00100000:2.0:1788530304.413436:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03efd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+43:12278:x1875409531651712:12345-192.168.202.41@tcp:35:cat.0 Request processed in 320us (889us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1788530304.413446:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 42 00000100:00100000:2.0:1788530304.502371:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530304.502612:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531651968 00000100:00100000:0.0:1788530304.502624:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531651968 00000100:00100000:0.0:1788530304.502709:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 168 00000100:00100000:0.0:1788530304.502721:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+43:12284:x1875409531651968:12345-192.168.202.41@tcp:101:dd.0 00010000:00010000:0.0:1788530304.502747:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530304.502750:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788530304.502780:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36be00/0xb28d70e125751026 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a71 expref: 43 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530304.502801:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a9f2b995b00) 00010000:00010000:0.0:1788530304.502807:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788530304.502821:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100400/0xb28d70e1257510ce lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550aa2 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530304.502933:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e1257510d5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530304.502946:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101600/0xb28d70e1257510a4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a94 expref: 43 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530304.502955:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e1257510d5 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530304.503131:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101600/0xb28d70e1257510a4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a94 expref: 43 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530304.503144:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101600/0xb28d70e1257510a4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a94 expref: 43 pid: 6523 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530304.503158:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03e89880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6523:1875409555849984:192.168.202.41@tcp:104: 00000100:00100000:0.0:1788530304.503469:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f181439c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788530304.509042:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530304.509155:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531652096 00000100:00100000:0.0:1788530304.509349:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03e89880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6523:1875409555849984:192.168.202.41@tcp:104: 00010000:00010000:0.0:1788530304.509391:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e1257510d5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530304.509611:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531652096 00010000:00010000:2.0:1788530304.509655:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101600/0xb28d70e1257510a4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a94 expref: 44 pid: 6523 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530304.509699:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 91 00000100:00100000:2.0:1788530304.509719:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03efdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+44:2400:x1875409531652096:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788530304.509737:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788530304.509759:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101600/0xb28d70e1257510a4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a94 expref: 44 pid: 6523 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530304.509773:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101600/0xb28d70e1257510a4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a94 expref: 44 pid: 6523 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530304.509795:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101600/0xb28d70e1257510a4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a94 expref: 44 pid: 6523 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530304.509811:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a9f2b995500) 00010000:00010000:2.0:1788530304.509815:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e1257510d5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530304.509825:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e1257510d5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530304.509832:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e1257510d5 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530304.509853:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788530304.509937:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e1257510d5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530304.509945:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e1257510d5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788530304.509962:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788530304.510550:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100400/0xb28d70e1257510ce lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550aa2 expref: 45 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530304.510591:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e1257510d5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550aa2 expref: 44 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530304.510600:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a9f2b995500) 00010000:00010000:0.0:1788530304.510610:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788530304.510622:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d101c00, rc 0) 00000100:00100000:2.0:1788530304.511029:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03efdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+44:2400:x1875409531652096:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 1310us (2058us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530304.511038:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 91 00000100:00100000:0.0:1788530304.511139:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+43:12284:x1875409531651968:12345-192.168.202.41@tcp:101:dd.0 Request processed in 8421us (8782us total) trans 4294967442 rc 0/0 00000100:00100000:0.0:1788530304.511146:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 168 00000100:00100000:3.0:1788530304.514615:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530304.514828:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531652224 00000100:00100000:1.0:1788530304.514838:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531652224 00000100:00100000:1.0:1788530304.514909:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 169 00000100:00100000:1.0:1788530304.514920:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+43:12284:x1875409531652224:12345-192.168.202.41@tcp:101:dd.0 00010000:00010000:1.0:1788530304.514945:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530304.514975:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eaa00/0xb28d70e1257510e3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550aa9 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530304.515013:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb800/0xb28d70e1257510ea lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530304.515028:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb800/0xb28d70e1257510ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530304.515039:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb800/0xb28d70e1257510ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530304.515147:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eaa00/0xb28d70e1257510e3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550aa9 expref: 45 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530304.515188:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb800/0xb28d70e1257510ea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550aa9 expref: 44 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530304.515197:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a9f2b995500) 00010000:00010000:1.0:1788530304.515200:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788530304.515204:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f012eb800, rc 0) 00000100:00100000:1.0:1788530304.515249:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+44:12284:x1875409531652224:12345-192.168.202.41@tcp:101:dd.0 Request processed in 332us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530304.515256:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 169 00000100:00100000:1.0:1788530304.522933:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530304.523150:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531652480 00000100:00100000:0.0:1788530304.523160:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531652480 00000100:00100000:0.0:1788530304.523249:0:10719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 170 00000100:00100000:0.0:1788530304.523261:0:10719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0375ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+44:12284:x1875409531652480:12345-192.168.202.41@tcp:36:dd.0 00010000:00010000:0.0:1788530304.523496:0:10719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100800/0xb28d70e1257510f1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530304.523514:0:10719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100800/0xb28d70e1257510f1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530304.523525:0:10719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100800/0xb28d70e1257510f1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788530304.523598:0:10719:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:0.0:1788530304.523623:0:10719:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003703c42e reply state 00000000032951f5 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100800/0xb28d70e1257510f1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530304.523635:0:10719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100800/0xb28d70e1257510f1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530304.523643:0:10719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a9f2b995500) 00010000:00010000:0.0:1788530304.523646:0:10719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788530304.523650:0:10719:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788530304.523740:0:10719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0375ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+47:12284:x1875409531652480:12345-192.168.202.41@tcp:36:dd.0 Request processed in 480us (816us total) trans 4294967444 rc 0/0 00000100:00100000:0.0:1788530304.523748:0:10719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 170 00000020:00080000:0.0:1788530304.523768:0:10719:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788530304.870710:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530304.870889:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531652608 00000100:00100000:3.0:1788530304.870912:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531652608 00000100:00100000:3.0:1788530304.870992:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 171 00000100:00100000:3.0:1788530304.871004:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03e89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+47:12298:x1875409531652608:12345-192.168.202.41@tcp:101:stat.0 00010000:00010000:3.0:1788530304.871028:0:10720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788530304.871049:0:10720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b400/0xb28d70e1257510f8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550ab0 expref: -99 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530304.871113:0:10720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e1257510ff lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530304.871129:0:10720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e1257510ff lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530304.871141:0:10720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e1257510ff lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530304.871153:0:10720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e125751106 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530304.871160:0:10720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e125751106 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530304.871168:0:10720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e125751106 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530304.871250:0:10720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36be00/0xb28d70e12575110d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530304.871261:0:10720:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e1257510d5 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550aa2 expref: 48 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530304.871279:0:10720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36be00/0xb28d70e12575110d lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530304.871313:0:10720:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e1257510d5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550aa2 expref: 48 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530304.871327:0:10720:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e1257510d5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550aa2 expref: 48 pid: 6523 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530304.871341:0:10720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037fd180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:10720:1875409555850112:192.168.202.41@tcp:104: 00000100:00100000:3.0:1788530304.871426:0:10720:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f33e24c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788530304.876507:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530304.876760:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531652864 00000100:00100000:0.0:1788530304.876769:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531652864 00000100:00100000:0.0:1788530304.876832:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 43 00000100:00100000:0.0:1788530304.876843:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+49:6175:x1875409531652864:12345-192.168.202.41@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788530304.877387:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+50:6175:x1875409531652864:12345-192.168.202.41@tcp:35:ldlm_bl.0 Request processed in 543us (886us total) trans 4294967445 rc 0/0 00000100:00100000:0.0:1788530304.877396:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 43 00000100:00100000:2.0:1788530304.877509:0:10720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037fd180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:10720:1875409555850112:192.168.202.41@tcp:104: 00010000:00010000:2.0:1788530304.877540:0:10720:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36be00/0xb28d70e12575110d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530304.883986:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530304.884182:0:10347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531652992 00000100:00100000:0.0:1788530304.884196:0:10347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531652992 00010000:00010000:0.0:1788530304.884253:0:10347:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e1257510d5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550aa2 expref: 50 pid: 6523 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530304.884309:0:10347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 92 00000100:00100000:0.0:1788530304.884320:0:10347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0375c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+50:2399:x1875409531652992:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788530304.884337:0:10347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788530304.884344:0:10347:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e1257510d5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550aa2 expref: 50 pid: 6523 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530304.884358:0:10347:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e1257510d5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550aa2 expref: 50 pid: 6523 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530304.884389:0:10347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e1257510d5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550aa2 expref: 50 pid: 6523 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530304.884408:0:10347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a9f2b995500) 00010000:00010000:0.0:1788530304.884442:0:10347:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36be00/0xb28d70e12575110d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530304.884454:0:10347:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36be00/0xb28d70e12575110d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530304.884463:0:10347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36be00/0xb28d70e12575110d lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530304.884499:0:10347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788530304.884808:0:10720:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36be00/0xb28d70e12575110d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530304.884816:0:10720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36be00/0xb28d70e12575110d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788530304.884871:0:10720:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788530304.884876:0:10720:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788530304.884900:0:10720:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36be00/0xb28d70e12575110d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530304.884913:0:10720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36be00/0xb28d70e12575110d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530304.884923:0:10720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e1257510ff lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530304.884940:0:10720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e1257510ff lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530304.884947:0:10720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e1257510ff lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530304.884953:0:10720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d36b200 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:3.0:1788530304.884957:0:10720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e1257510ff lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530304.884975:0:10720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e1257510ff lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530304.884986:0:10720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a9f2b995b00) 00010000:00010000:3.0:1788530304.884989:0:10720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788530304.884992:0:10720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e1257510ff lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530304.884997:0:10720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e1257510ff lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530304.885009:0:10720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e125751106 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530304.885015:0:10720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e125751106 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530304.885022:0:10720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e125751106 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530304.885026:0:10720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d36b800 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:3.0:1788530304.885036:0:10720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e125751106 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530304.885043:0:10720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e125751106 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530304.885051:0:10720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9a9f32abd600) 00010000:00010000:3.0:1788530304.885054:0:10720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788530304.885057:0:10720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e125751106 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530304.885063:0:10720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e125751106 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530304.885098:0:10720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b400/0xb28d70e1257510f8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550ab0 expref: 50 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530304.885112:0:10720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36be00/0xb28d70e12575110d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550ab0 expref: 49 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530304.885120:0:10720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a9f2b995500) 00010000:00010000:3.0:1788530304.885122:0:10720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788530304.885124:0:10720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d36be00, rc 0) 00000100:00100000:3.0:1788530304.885156:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03e89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+49:12298:x1875409531652608:12345-192.168.202.41@tcp:101:stat.0 Request processed in 14155us (14465us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530304.885163:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 171 00000100:00100000:0.0:1788530304.885857:0:10347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0375c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+48:2399:x1875409531652992:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 1534us (1887us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530304.885868:0:10347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 92 00000100:00100000:1.0:1788530304.981206:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530304.981353:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531653248 00000100:00100000:2.0:1788530304.981367:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531653248 00000100:00100000:2.0:1788530304.981921:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 172 00000100:00100000:2.0:1788530304.981951:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0375f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+48:12304:x1875409531653248:12345-192.168.202.41@tcp:36:truncate.0 00010000:00010000:2.0:1788530304.982102:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788530304.982149:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36be00/0xb28d70e12575110d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550ab0 expref: 48 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530304.982180:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a9f2b995500) 00010000:00010000:2.0:1788530304.982187:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788530304.982947:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20da00/0xb28d70e125751114 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530304.983046:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20da00/0xb28d70e125751114 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530304.983059:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20da00/0xb28d70e125751114 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788530304.983109:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967446 00000004:00010000:2.0:1788530304.983137:0:6524:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000071055d46 reply state 00000000bf0972f8 transno 4294967447 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20da00/0xb28d70e125751114 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530304.983150:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20da00/0xb28d70e125751114 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530304.983157:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a9f2b995500) 00010000:00010000:2.0:1788530304.983159:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788530304.983162:0:6524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788530304.983297:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0375f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+50:12304:x1875409531653248:12345-192.168.202.41@tcp:36:truncate.0 Request processed in 1345us (2105us total) trans 4294967447 rc 0/0 00000100:00100000:2.0:1788530304.983306:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 172 00000020:00080000:2.0:1788530304.983313:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:3.0:1788530305.157419:0:13816:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788530305.219006:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530305.219129:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531653376 00000100:00100000:0.0:1788530305.219144:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531653376 00000100:00100000:0.0:1788530305.219261:0:10719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 173 00000100:00100000:0.0:1788530305.219275:0:10719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0375f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+50:12318:x1875409531653376:12345-192.168.202.41@tcp:101:stat.0 00010000:00010000:0.0:1788530305.219367:0:10719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530305.219397:0:10719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e12575111b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550ab7 expref: -99 pid: 10719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.219621:0:10719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100400/0xb28d70e125751122 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.219637:0:10719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100400/0xb28d70e125751122 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.219650:0:10719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100400/0xb28d70e125751122 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.219663:0:10719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100000/0xb28d70e125751129 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.219679:0:10719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100000/0xb28d70e125751129 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.219687:0:10719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100000/0xb28d70e125751129 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.219804:0:10719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101a00/0xb28d70e125751130 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.219815:0:10719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101a00/0xb28d70e125751130 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.219823:0:10719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101a00/0xb28d70e125751130 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788530305.219867:0:10719:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1788530305.219877:0:10719:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788530305.219901:0:10719:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101a00/0xb28d70e125751130 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.219915:0:10719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101a00/0xb28d70e125751130 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.219926:0:10719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100400/0xb28d70e125751122 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.219933:0:10719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100400/0xb28d70e125751122 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.219941:0:10719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100400/0xb28d70e125751122 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.219957:0:10719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d100400 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:0.0:1788530305.219963:0:10719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100400/0xb28d70e125751122 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.219971:0:10719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100400/0xb28d70e125751122 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.219986:0:10719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a9f2b995b00) 00010000:00010000:0.0:1788530305.219989:0:10719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788530305.219995:0:10719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100400/0xb28d70e125751122 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.220002:0:10719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100400/0xb28d70e125751122 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.220018:0:10719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100000/0xb28d70e125751129 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.220025:0:10719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100000/0xb28d70e125751129 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.220031:0:10719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100000/0xb28d70e125751129 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.220038:0:10719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d100000 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:0.0:1788530305.220040:0:10719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100000/0xb28d70e125751129 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.220047:0:10719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100000/0xb28d70e125751129 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.220072:0:10719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9a9f32abd600) 00010000:00010000:0.0:1788530305.220075:0:10719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788530305.220080:0:10719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100000/0xb28d70e125751129 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.220086:0:10719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100000/0xb28d70e125751129 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788530305.220095:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788530305.220122:0:10719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e12575111b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550ab7 expref: 52 pid: 10719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.220143:0:10719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101a00/0xb28d70e125751130 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550ab7 expref: 51 pid: 10719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.220151:0:10719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a9f2b995500) 00010000:00010000:0.0:1788530305.220154:0:10719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788530305.220157:0:10719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d101a00, rc 0) 00010000:00010000:2.0:1788530305.220216:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788530305.220531:0:10719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0375f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+51:12318:x1875409531653376:12345-192.168.202.41@tcp:101:stat.0 Request processed in 1259us (1536us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530305.220542:0:10719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 173 00000100:00100000:3.0:1788530305.328592:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530305.330022:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531653632 00000100:00100000:0.0:1788530305.330036:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531653632 00000100:00100000:0.0:1788530305.330171:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 174 00000100:00100000:0.0:1788530305.330185:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+51:12328:x1875409531653632:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:0.0:1788530305.330211:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530305.330236:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e125751137 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550abe expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788530305.330373:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1788530305.330527:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e125751137 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550abe expref: 53 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.330546:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a9f32abda00) 00010000:00010000:0.0:1788530305.330581:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788530305.330590:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e125751137 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550abe expref: 53 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.330615:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d101c00, rc 0) 00000100:00100000:0.0:1788530305.330713:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+52:12328:x1875409531653632:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 531us (2167us total) trans 4294967448 rc 301/301 00000100:00100000:0.0:1788530305.330722:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 174 00000100:00100000:1.0:1788530305.335383:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530305.335770:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531653888 00000100:00100000:3.0:1788530305.335781:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531653888 00000100:00100000:3.0:1788530305.335864:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 44 00000100:00100000:3.0:1788530305.335876:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3959fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+52:12328:x1875409531653888:12345-192.168.202.41@tcp:35:lfs.0 00000100:00100000:3.0:1788530305.336150:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3959fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+53:12328:x1875409531653888:12345-192.168.202.41@tcp:35:lfs.0 Request processed in 276us (784us total) trans 4294967449 rc 0/0 00000100:00100000:3.0:1788530305.336158:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 44 00000100:00100000:1.0:1788530305.440364:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530305.442730:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531654144 00000100:00100000:0.0:1788530305.442751:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531654144 00000100:00100000:0.0:1788530305.442910:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 175 00000100:00100000:0.0:1788530305.442922:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0375f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+53:12334:x1875409531654144:12345-192.168.202.41@tcp:101:bash.0 00010000:00010000:0.0:1788530305.442947:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530305.442977:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e125751145 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550ac5 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.443216:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100000/0xb28d70e12575114c lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.443235:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101a00/0xb28d70e125751130 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550ab7 expref: 54 pid: 10719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.443282:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100000/0xb28d70e12575114c lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.443323:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101a00/0xb28d70e125751130 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550ab7 expref: 54 pid: 10719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.443338:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101a00/0xb28d70e125751130 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550ab7 expref: 54 pid: 10719 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530305.443354:0:6525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03e8ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6525:1875409555850240:192.168.202.41@tcp:104: 00000100:00100000:0.0:1788530305.443464:0:6525:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f18143f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788530305.446911:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530305.447045:0:6525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03e8ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6525:1875409555850240:192.168.202.41@tcp:104: 00010000:00010000:0.0:1788530305.447074:0:6525:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100000/0xb28d70e12575114c lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530305.447305:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531654272 00000100:00100000:1.0:1788530305.447314:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531654272 00010000:00010000:1.0:1788530305.447354:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101a00/0xb28d70e125751130 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550ab7 expref: 55 pid: 10719 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530305.447396:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 93 00000100:00100000:1.0:1788530305.447406:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f396c3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+55:2400:x1875409531654272:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788530305.447430:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788530305.447438:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101a00/0xb28d70e125751130 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550ab7 expref: 55 pid: 10719 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530305.447465:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101a00/0xb28d70e125751130 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550ab7 expref: 55 pid: 10719 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530305.447488:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101a00/0xb28d70e125751130 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550ab7 expref: 55 pid: 10719 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530305.447504:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a9f2b995500) 00010000:00010000:1.0:1788530305.447509:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100000/0xb28d70e12575114c lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530305.447519:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100000/0xb28d70e12575114c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530305.447528:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100000/0xb28d70e12575114c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530305.447557:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788530305.447786:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f396c3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+54:2400:x1875409531654272:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 379us (884us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530305.447795:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 93 00010000:00010000:0.0:1788530305.448100:0:6525:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100000/0xb28d70e12575114c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.448110:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100000/0xb28d70e12575114c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788530305.448129:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:0.0:1788530305.448259:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e125751145 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550ac5 expref: 55 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.448275:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100000/0xb28d70e12575114c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550ac5 expref: 54 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.448297:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a9f2b995500) 00010000:00010000:0.0:1788530305.448300:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788530305.448303:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d100000, rc 0) 00000100:00100000:0.0:1788530305.448329:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0375f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+54:12334:x1875409531654144:12345-192.168.202.41@tcp:101:bash.0 Request processed in 5411us (7979us total) trans 4294967450 rc 0/0 00000100:00100000:0.0:1788530305.448336:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 175 00000100:00100000:3.0:1788530305.452596:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530305.452676:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531654528 00000100:00100000:2.0:1788530305.452686:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531654528 00000100:00100000:2.0:1788530305.452768:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 176 00000100:00100000:2.0:1788530305.452779:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+54:12334:x1875409531654528:12345-192.168.202.41@tcp:36:bash.0 00010000:00010000:2.0:1788530305.452995:0:8678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20cc00/0xb28d70e12575115a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530305.453013:0:8678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20cc00/0xb28d70e12575115a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530305.453024:0:8678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20cc00/0xb28d70e12575115a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788530305.453059:0:8678:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967451 00000004:00010000:2.0:1788530305.453076:0:8678:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000447b991f reply state 00000000f4197a6e transno 4294967452 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20cc00/0xb28d70e12575115a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530305.453295:0:8678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20cc00/0xb28d70e12575115a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530305.453303:0:8678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a9f2b995500) 00010000:00010000:2.0:1788530305.453306:0:8678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788530305.453309:0:8678:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788530305.453586:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+57:12334:x1875409531654528:12345-192.168.202.41@tcp:36:bash.0 Request processed in 807us (997us total) trans 4294967452 rc 0/0 00000100:00100000:2.0:1788530305.453594:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 176 00000020:00080000:2.0:1788530305.453599:0:8678:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788530305.463078:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530305.463611:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531654656 00000100:00100000:2.0:1788530305.463621:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531654656 00000100:00100000:2.0:1788530305.463712:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 177 00000100:00100000:2.0:1788530305.463724:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+57:12334:x1875409531654656:12345-192.168.202.41@tcp:101:bash.0 00010000:00010000:2.0:1788530305.463769:0:10720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530305.463791:0:10720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d800/0xb28d70e125751161 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550acc expref: -99 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530305.463904:0:10720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ca00/0xb28d70e125751168 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530305.463919:0:10720:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100000/0xb28d70e12575114c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550ac5 expref: 58 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530305.463928:0:10720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ca00/0xb28d70e125751168 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530305.463975:0:10720:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100000/0xb28d70e12575114c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550ac5 expref: 58 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530305.463989:0:10720:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100000/0xb28d70e12575114c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550ac5 expref: 58 pid: 6525 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530305.464003:0:10720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03c5aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:10720:1875409555850368:192.168.202.41@tcp:104: 00000100:00100000:2.0:1788530305.464369:0:10720:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e02768000 going to sleep for 11 seconds 00000100:00100000:1.0:1788530305.471731:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530305.471867:0:10347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531654784 00000100:00100000:0.0:1788530305.471879:0:10347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531654784 00010000:00010000:0.0:1788530305.471935:0:10347:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100000/0xb28d70e12575114c lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550ac5 expref: 59 pid: 6525 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530305.471995:0:10347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 94 00000100:00100000:0.0:1788530305.472005:0:10347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e0375c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+59:2399:x1875409531654784:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788530305.472021:0:10347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788530305.472028:0:10347:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100000/0xb28d70e12575114c lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550ac5 expref: 59 pid: 6525 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.472044:0:10347:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100000/0xb28d70e12575114c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550ac5 expref: 59 pid: 6525 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.472075:0:10347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a9f2b995500) 00010000:00010000:0.0:1788530305.472092:0:10347:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ca00/0xb28d70e125751168 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.472105:0:10347:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ca00/0xb28d70e125751168 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.472139:0:10347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ca00/0xb28d70e125751168 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.472167:0:10347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788530305.472250:0:10347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e0375c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+59:2399:x1875409531654784:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 244us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530305.472258:0:10347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 94 00010000:00010000:2.0:1788530305.472524:0:10720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100000/0xb28d70e12575114c lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550ac5 expref: 58 pid: 6525 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530305.472543:0:10720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03c5aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:10720:1875409555850368:192.168.202.41@tcp:104: 00010000:00010000:2.0:1788530305.472630:0:10720:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ca00/0xb28d70e125751168 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530305.472666:0:10720:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ca00/0xb28d70e125751168 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530305.472673:0:10720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ca00/0xb28d70e125751168 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788530305.472741:0:10720:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788530305.472746:0:10720:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788530305.472768:0:10720:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ca00/0xb28d70e125751168 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530305.472798:0:10720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d800/0xb28d70e125751161 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550acc expref: 58 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530305.472814:0:10720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ca00/0xb28d70e125751168 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550acc expref: 57 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530305.472822:0:10720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a9f2b995500) 00010000:00010000:2.0:1788530305.472825:0:10720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788530305.472828:0:10720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d20ca00, rc 0) 00000100:00100000:2.0:1788530305.472856:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+57:12334:x1875409531654656:12345-192.168.202.41@tcp:101:bash.0 Request processed in 9135us (9790us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530305.472863:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 177 00000100:00100000:3.0:1788530305.479739:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530305.479864:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531655040 00000100:00100000:2.0:1788530305.479876:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531655040 00000100:00100000:2.0:1788530305.479946:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 45 00000100:00100000:2.0:1788530305.479958:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+57:12334:x1875409531655040:12345-192.168.202.41@tcp:35:bash.0 00000100:00100000:2.0:1788530305.480389:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+58:12334:x1875409531655040:12345-192.168.202.41@tcp:35:bash.0 Request processed in 431us (658us total) trans 4294967453 rc 0/0 00000100:00100000:2.0:1788530305.480416:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 45 00000100:00100000:2.0:1788530305.600976:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03e8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555850496:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788530305.601085:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530305.601339:0:14186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555850496 00000100:00100000:0.0:1788530305.601348:0:14186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555850496 00000100:00100000:0.0:1788530305.601404:0:14186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1788530305.601415:0:14186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555850496:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788530305.601454:0:14186:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1788530305.601528:0:14186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555850496:12345-0@lo:41:osp-pre-0-1.0 Request processed in 115us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530305.601536:0:14186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1788530305.601648:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03e8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555850496:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788530305.623878:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530305.623986:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531655296 00000100:00100000:2.0:1788530305.624002:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531655296 00000100:00100000:2.0:1788530305.624127:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 178 00000100:00100000:2.0:1788530305.624142:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+58:12344:x1875409531655296:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:2.0:1788530305.624205:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530305.624253:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d800/0xb28d70e12575116f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550ad3 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788530305.624389:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1788530305.624524:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d800/0xb28d70e12575116f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550ad3 expref: 60 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530305.624541:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a9f32abda00) 00010000:00010000:2.0:1788530305.624545:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788530305.624550:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d800/0xb28d70e12575116f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550ad3 expref: 60 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530305.624606:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d20d800, rc 0) 00000100:00100000:2.0:1788530305.624680:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+59:12344:x1875409531655296:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 542us (819us total) trans 4294967454 rc 301/301 00000100:00100000:2.0:1788530305.624687:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 178 00000100:00100000:1.0:1788530305.630727:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530305.630848:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531655424 00000100:00100000:0.0:1788530305.630864:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531655424 00000100:00100000:0.0:1788530305.630963:0:10719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 179 00000100:00100000:0.0:1788530305.630975:0:10719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03ee2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+59:12344:x1875409531655424:12345-192.168.202.41@tcp:34:lfs.0 00010000:00010000:0.0:1788530305.631078:0:10719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e12575117d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.631104:0:10719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e12575117d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.631121:0:10719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e12575117d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.631176:0:10719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e125751184 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.631185:0:10719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e125751184 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.631192:0:10719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e125751184 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.631304:0:10719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101000/0xb28d70e12575118b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.631314:0:10719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101000/0xb28d70e12575118b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.631320:0:10719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101000/0xb28d70e12575118b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788530305.631384:0:10719:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101000/0xb28d70e12575118b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.631402:0:10719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e12575117d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.631410:0:10719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e12575117d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.631419:0:10719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e12575117d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.631427:0:10719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d101c00 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:0.0:1788530305.631431:0:10719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e12575117d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.631448:0:10719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e12575117d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.631474:0:10719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a9f2b995b00) 00010000:00010000:0.0:1788530305.631478:0:10719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788530305.631484:0:10719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e12575117d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.631492:0:10719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e12575117d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.631510:0:10719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e125751184 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.631516:0:10719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e125751184 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.631521:0:10719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e125751184 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.631526:0:10719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d100c00 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:0.0:1788530305.631529:0:10719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e125751184 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.631534:0:10719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e125751184 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.631542:0:10719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9a9f32abd600) 00010000:00010000:0.0:1788530305.631545:0:10719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788530305.631547:0:10719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e125751184 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.631634:0:10719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e125751184 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.631646:0:10719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101000/0xb28d70e12575118b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.631652:0:10719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101000/0xb28d70e12575118b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.631658:0:10719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101000/0xb28d70e12575118b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.631663:0:10719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d101000 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:0.0:1788530305.631666:0:10719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101000/0xb28d70e12575118b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.631671:0:10719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101000/0xb28d70e12575118b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.631679:0:10719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a9f2b995500) 00010000:00010000:0.0:1788530305.631682:0:10719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788530305.631685:0:10719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101000/0xb28d70e12575118b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.631698:0:10719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101000/0xb28d70e12575118b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530305.631808:0:10719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03ee2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+59:12344:x1875409531655424:12345-192.168.202.41@tcp:34:lfs.0 Request processed in 831us (1089us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530305.631818:0:10719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 179 00000100:00100000:3.0:1788530305.635259:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530305.635385:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531655680 00000100:00100000:2.0:1788530305.635404:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531655680 00000100:00100000:2.0:1788530305.635908:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 46 00000100:00100000:2.0:1788530305.635924:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+59:12344:x1875409531655680:12345-192.168.202.41@tcp:35:lfs.0 00000100:00100000:2.0:1788530305.636409:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+60:12344:x1875409531655680:12345-192.168.202.41@tcp:35:lfs.0 Request processed in 487us (1171us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1788530305.636419:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 46 00000100:00100000:3.0:1788530305.696446:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530305.697209:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531655936 00000100:00100000:0.0:1788530305.697223:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531655936 00000100:00100000:0.0:1788530305.697324:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 180 00000100:00100000:0.0:1788530305.697335:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03cc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+60:12347:x1875409531655936:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:0.0:1788530305.697375:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530305.697400:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101000/0xb28d70e125751192 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550ada expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.697675:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e125751199 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.697701:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e125751199 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.697713:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e125751199 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.697724:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e1257511a0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.697732:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e1257511a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.697739:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e1257511a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.697884:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e1257511a7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.697892:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e1257511a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.697919:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e1257511a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788530305.697928:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788530305.698145:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e125751199 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.698152:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e125751199 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.698219:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e125751199 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.698224:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d100c00 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:0.0:1788530305.698230:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e125751199 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.698237:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e125751199 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.698248:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a9f2b995b00) 00010000:00010000:0.0:1788530305.698250:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788530305.698254:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e125751199 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.698259:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e125751199 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.698275:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e1257511a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.698278:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e1257511a0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.698289:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e1257511a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.698292:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d101c00 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:0.0:1788530305.698294:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e1257511a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.698297:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e1257511a0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.698302:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9a9f32abd600) 00010000:00010000:0.0:1788530305.698303:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788530305.698305:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e1257511a0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.698308:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e1257511a0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.698339:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101000/0xb28d70e125751192 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550ada expref: 63 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.698348:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e1257511a7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550ada expref: 62 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.698353:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a9f2b995500) 00010000:00010000:0.0:1788530305.698355:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788530305.698357:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d101800, rc 0) 00000100:00100000:0.0:1788530305.698418:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03cc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+62:12347:x1875409531655936:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 1085us (1986us total) trans 4294967456 rc 0/0 00000100:00100000:0.0:1788530305.698431:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 180 00000100:00100000:1.0:1788530305.701715:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530305.701891:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531656064 00000100:00100000:2.0:1788530305.701906:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531656064 00000100:00100000:2.0:1788530305.702017:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 181 00000100:00100000:2.0:1788530305.702032:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03ee0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+62:12347:x1875409531656064:12345-192.168.202.41@tcp:54:lfs.0 00010000:00010000:2.0:1788530305.702147:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d800/0xb28d70e1257511b5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530305.702181:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d800/0xb28d70e1257511b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530305.702197:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d800/0xb28d70e1257511b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530305.702244:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d800/0xb28d70e1257511b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530305.702253:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d800/0xb28d70e1257511b5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530305.702261:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d800/0xb28d70e1257511b5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530305.702268:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d20d800 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:2.0:1788530305.702273:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d800/0xb28d70e1257511b5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530305.702315:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d800/0xb28d70e1257511b5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530305.702330:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a9f2b995500) 00010000:00010000:2.0:1788530305.702332:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788530305.702338:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d800/0xb28d70e1257511b5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530305.702345:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d800/0xb28d70e1257511b5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530305.702438:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03ee0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+62:12347:x1875409531656064:12345-192.168.202.41@tcp:54:lfs.0 Request processed in 408us (746us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530305.702446:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 181 00000100:00100000:3.0:1788530305.707187:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530305.707260:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531656192 00000100:00100000:2.0:1788530305.707275:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531656192 00000100:00100000:2.0:1788530305.707378:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 11 00000100:00100000:2.0:1788530305.707391:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03cc4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+62:2401:x1875409531656192:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788530305.707412:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788530305.707442:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e1257511a7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550ada expref: 62 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530305.707848:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a9f2b995500) 00010000:00010000:2.0:1788530305.707858:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788530305.707952:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03cc4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+61:2401:x1875409531656192:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 561us (777us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530305.707963:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 11 00000100:00100000:3.0:1788530305.708261:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530305.708299:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531656448 00000100:00100000:2.0:1788530305.708305:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531656448 00000100:00100000:2.0:1788530305.708348:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 47 00000100:00100000:2.0:1788530305.708357:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03cc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+61:12347:x1875409531656448:12345-192.168.202.41@tcp:35:lfs.0 00000100:00100000:2.0:1788530305.708832:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03cc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+62:12347:x1875409531656448:12345-192.168.202.41@tcp:35:lfs.0 Request processed in 476us (571us total) trans 4294967457 rc 0/0 00000100:00100000:2.0:1788530305.708841:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 47 00000040:00080000:3.0:1788530305.792841:0:13811:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788530305.792853:0:13811:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788530305.792983:0:13811:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:3.0:1788530305.792991:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788530305.893860:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530305.895054:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531656704 00000100:00100000:0.0:1788530305.895070:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531656704 00000100:00100000:0.0:1788530305.895277:0:10719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 182 00000100:00100000:0.0:1788530305.895293:0:10719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03ee3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+62:12365:x1875409531656704:12345-192.168.202.41@tcp:101:cat.0 00010000:00010000:0.0:1788530305.895339:0:10719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530305.895375:0:10719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101000/0xb28d70e1257511bc lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550ae1 expref: -99 pid: 10719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.895846:0:10719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e1257511c3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.895865:0:10719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e1257511c3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.895877:0:10719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e1257511c3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788530305.895888:0:10719:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788530305.896031:0:10719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101000/0xb28d70e1257511bc lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550ae1 expref: 65 pid: 10719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.896053:0:10719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e1257511c3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550ae1 expref: 64 pid: 10719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.896064:0:10719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a9f2b995500) 00010000:00010000:0.0:1788530305.896067:0:10719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788530305.896073:0:10719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d101c00, rc 0) 00000100:00100000:0.0:1788530305.896348:0:10719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03ee3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+64:12365:x1875409531656704:12345-192.168.202.41@tcp:101:cat.0 Request processed in 1057us (2505us total) trans 4294967458 rc 0/0 00000100:00100000:0.0:1788530305.896358:0:10719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 182 00000100:00100000:3.0:1788530305.931410:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530305.931652:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531656832 00000100:00100000:2.0:1788530305.931663:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531656832 00000100:00100000:2.0:1788530305.931771:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 183 00000100:00100000:2.0:1788530305.931784:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03efd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+64:12366:x1875409531656832:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:2.0:1788530305.931818:0:10720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530305.931851:0:10720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d800/0xb28d70e1257511d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550ae8 expref: -99 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530305.931945:0:10720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c800/0xb28d70e1257511d8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530305.931972:0:10720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c800/0xb28d70e1257511d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530305.931986:0:10720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c800/0xb28d70e1257511d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788530305.932028:0:10720:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1788530305.932032:0:10720:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788530305.932053:0:10720:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c800/0xb28d70e1257511d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530305.932086:0:10720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d800/0xb28d70e1257511d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550ae8 expref: 66 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530305.932132:0:10720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c800/0xb28d70e1257511d8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550ae8 expref: 65 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530305.932144:0:10720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a9f2b995b00) 00010000:00010000:2.0:1788530305.932148:0:10720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788530305.932152:0:10720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d20c800, rc 0) 00000100:00100000:2.0:1788530305.932271:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03efd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+65:12366:x1875409531656832:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 489us (878us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530305.932281:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 183 00000100:00100000:3.0:1788530305.940442:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530305.940633:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531657216 00000100:00100000:0.0:1788530305.940644:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531657216 00000100:00100000:0.0:1788530305.940720:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 48 00000100:00100000:0.0:1788530305.940735:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03efdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+65:12366:x1875409531657216:12345-192.168.202.41@tcp:35:lfs.0 00000100:00100000:0.0:1788530305.941231:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03efdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+66:12366:x1875409531657216:12345-192.168.202.41@tcp:35:lfs.0 Request processed in 498us (807us total) trans 4294967459 rc 0/0 00000100:00100000:0.0:1788530305.941240:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 48 00000100:00100000:1.0:1788530305.945284:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530305.945475:0:10347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531657344 00000100:00100000:0.0:1788530305.945486:0:10347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531657344 00000100:00100000:0.0:1788530305.945555:0:10347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 12 00000100:00100000:0.0:1788530305.945615:0:10347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03ee2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+66:12366:x1875409531657344:12345-192.168.202.41@tcp:103:lfs.0 00010000:00010000:0.0:1788530305.945634:0:10347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788530305.945661:0:10347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ca00/0xb28d70e125751168 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550acc expref: 66 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.945697:0:10347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e1257511c3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550ae1 expref: 65 pid: 10719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.945715:0:10347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20dc00/0xb28d70e125751065 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a86 expref: 64 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530305.945727:0:10347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a9f2b995500) 00010000:00010000:0.0:1788530305.945733:0:10347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788530305.945817:0:10347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03ee2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+63:12366:x1875409531657344:12345-192.168.202.41@tcp:103:lfs.0 Request processed in 216us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530305.945826:0:10347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 12 00000100:00100000:3.0:1788530305.948824:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530305.948982:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531657472 00000100:00100000:2.0:1788530305.948991:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531657472 00000100:00100000:2.0:1788530305.949063:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 184 00000100:00100000:2.0:1788530305.949073:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03efd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+63:12366:x1875409531657472:12345-192.168.202.41@tcp:58:lfs.0 00010000:00010000:2.0:1788530305.949232:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d800/0xb28d70e1257511df lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530305.949254:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d800/0xb28d70e1257511df lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530305.949271:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d800/0xb28d70e1257511df lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788530305.949406:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1788530305.949529:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03efd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+63:12366:x1875409531657472:12345-192.168.202.41@tcp:58:lfs.0 Request processed in 456us (713us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530305.949539:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 184 00000100:00100000:3.0:1788530305.975429:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530305.975828:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531657600 00000100:00100000:2.0:1788530305.975857:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531657600 00000100:00100000:2.0:1788530305.975927:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 185 00000100:00100000:2.0:1788530305.975938:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+63:12368:x1875409531657600:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:2.0:1788530305.976031:0:8678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530305.976058:0:8678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d400/0xb28d70e1257511e6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550aef expref: -99 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530305.976146:0:8678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e1257511ed lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530305.976224:0:8678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e1257511ed lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530305.976238:0:8678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e1257511ed lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530305.976251:0:8678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20dc00/0xb28d70e1257511f4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530305.976258:0:8678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20dc00/0xb28d70e1257511f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530305.976265:0:8678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20dc00/0xb28d70e1257511f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530305.976357:0:8678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ca00/0xb28d70e1257511fb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530305.976368:0:8678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ca00/0xb28d70e1257511fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530305.976375:0:8678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ca00/0xb28d70e1257511fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788530305.978790:0:8678:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788530305.978804:0:8678:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788530305.978839:0:8678:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ca00/0xb28d70e1257511fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530305.978861:0:8678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ca00/0xb28d70e1257511fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530305.978875:0:8678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e1257511ed lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530305.978882:0:8678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e1257511ed lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530305.978890:0:8678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e1257511ed lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530305.978897:0:8678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d20c000 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:2.0:1788530305.978901:0:8678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e1257511ed lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530305.978909:0:8678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e1257511ed lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530305.978925:0:8678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a9f2b995b00) 00010000:00010000:2.0:1788530305.978928:0:8678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788530305.978933:0:8678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e1257511ed lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530305.978940:0:8678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e1257511ed lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530305.981906:0:8678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20dc00/0xb28d70e1257511f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530305.981915:0:8678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20dc00/0xb28d70e1257511f4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530305.981923:0:8678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20dc00/0xb28d70e1257511f4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530305.981931:0:8678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d20dc00 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:2.0:1788530305.981936:0:8678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20dc00/0xb28d70e1257511f4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530305.981945:0:8678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20dc00/0xb28d70e1257511f4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530305.981962:0:8678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9a9f32abd600) 00010000:00010000:2.0:1788530305.981966:0:8678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788530305.981971:0:8678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20dc00/0xb28d70e1257511f4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530305.981978:0:8678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20dc00/0xb28d70e1257511f4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530305.982031:0:8678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d400/0xb28d70e1257511e6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550aef expref: 65 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530305.982049:0:8678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ca00/0xb28d70e1257511fb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550aef expref: 64 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530305.982076:0:8678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a9f2b995500) 00010000:00010000:2.0:1788530305.982079:0:8678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788530305.982082:0:8678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d20ca00, rc 0) 00000100:00100000:2.0:1788530305.982207:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+64:12368:x1875409531657600:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 6267us (6797us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530305.982218:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 185 00000004:00080000:2.0:1788530306.112816:0:8751:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 514015249891ns, next at 515015244946ns, rc = 0 00000100:00100000:2.0:1788530306.112875:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03c5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555850624:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788530306.112991:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530306.113099:0:9912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555850624 00000100:00100000:2.0:1788530306.113110:0:9912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555850624 00000100:00100000:2.0:1788530306.113417:0:9912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788530306.113435:0:9912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1875409555850624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788530306.113557:0:9912:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923509248 avail 3691986944 00000100:00100000:2.0:1788530306.113704:0:9912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1875409555850624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 275us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530306.113713:0:9912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788530306.114121:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03ee1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555850752:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788530306.114182:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788530306.114261:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788530306.114300:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555850752 00000100:00100000:1.0:1788530306.114305:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555850752 00000100:00100000:1.0:1788530306.114343:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788530306.114352:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03ee3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555850752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788530306.114375:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33943232 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1788530306.114412:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03ee3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555850752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530306.114420:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00080000:1.0:1788530306.114435:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788530306.114475:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03ee1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555850752:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788530306.115290:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03c5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555850624:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788530306.115639:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03e8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555850880:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788530306.115706:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530306.115750:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03ee1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875409555851392:0@lo:400:kworker.0 00000100:00100000:3.0:1788530306.115799:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530306.115820:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788530306.115826:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03ee1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3649:1875409555851008:0@lo:400:kworker.0 00000100:00100000:3.0:1788530306.115856:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530306.115875:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3960f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555851520:0@lo:400:kworker.0 00000100:00100000:3.0:1788530306.115895:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530306.115921:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555851008 00000100:00100000:3.0:1788530306.115926:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555851008 00000100:00100000:3.0:1788530306.115979:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 448 00000100:00100000:3.0:1788530306.115987:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:3649:x1875409555851008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530306.116029:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:3649:x1875409555851008:12345-0@lo:400:kworker.0 Request processed in 43us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530306.116036:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 448 00000100:00100000:3.0:1788530306.116072:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555850880 00000100:00100000:3.0:1788530306.116075:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555850880 00000100:00100000:3.0:1788530306.116109:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788530306.116114:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555850880:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788530306.116129:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923509248 avail 3691986944 00000100:00100000:1.0:1788530306.116789:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555851520 00000100:00100000:1.0:1788530306.116794:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555851520 00000100:00100000:1.0:1788530306.116830:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1788530306.116839:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555851520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530306.116888:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555851520:12345-0@lo:400:kworker.0 Request processed in 50us (991us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530306.116894:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1788530306.116915:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3960c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875409555851904:0@lo:400:kworker.0 00000100:00100000:1.0:1788530306.116941:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530306.117216:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03ee1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3649:1875409555851008:0@lo:400:kworker.0 00000100:00100000:1.0:1788530306.117238:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3960f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555851520:0@lo:400:kworker.0 00000100:00100000:1.0:1788530306.117273:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788530306.117279:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3960ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875409555852032:0@lo:400:kworker.0 00000100:00100000:1.0:1788530306.117307:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788530306.117363:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788530306.117614:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555850880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1486us (1894us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530306.117623:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788530306.117835:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03e8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555850880:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788530306.117901:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03ee3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555851264:0@lo:400:kworker.0 00000100:00100000:0.0:1788530306.117931:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530306.117966:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3960dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875409555851776:0@lo:400:kworker.0 00000100:00100000:0.0:1788530306.118025:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530306.118046:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d3f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555852288:0@lo:400:kworker.0 00000100:00100000:0.0:1788530306.118065:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530306.118084:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788530306.118090:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03ee0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875409555851136:0@lo:400:kworker.0 00000100:00100000:0.0:1788530306.118108:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530306.118121:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03c52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555851648:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788530306.118136:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530306.118149:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d3fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875409555852160:0@lo:400:kworker.0 00000100:00100000:0.0:1788530306.118177:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530306.118201:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555852288 00000100:00100000:0.0:1788530306.118205:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555852288 00000100:00100000:0.0:1788530306.118247:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788530306.118253:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03edc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555852288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530306.118290:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03edc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555852288:12345-0@lo:400:kworker.0 Request processed in 37us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530306.118296:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00080000:0.0:1788530306.118312:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788530306.118322:0:14186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555851264 00000100:00100000:0.0:1788530306.118325:0:14186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555851264 00000100:00100000:0.0:1788530306.118355:0:14186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1788530306.118360:0:14186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03e8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555851264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530306.118391:0:14186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03e8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555851264:12345-0@lo:400:kworker.0 Request processed in 31us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530306.118397:0:14186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1788530306.118413:0:9912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555851648 00000100:00100000:0.0:1788530306.118416:0:9912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555851648 00000100:00100000:0.0:1788530306.118433:0:9912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788530306.118439:0:9912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03edca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555851648:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788530306.118452:0:9912:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33943232 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1788530306.118488:0:9912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03edca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555851648:12345-0@lo:13:osp-pre-1-1.0 Request processed in 49us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530306.118494:0:9912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788530306.118521:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03c52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555851648:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788530306.118529:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03ee3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555851264:0@lo:400:kworker.0 00000100:00100000:0.0:1788530306.118536:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d3f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555852288:0@lo:400:kworker.0 00000100:00100000:0.0:1788530306.118557:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555851392 00000100:00100000:0.0:1788530306.118586:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555851392 00000100:00100000:0.0:1788530306.118876:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555851904 00000100:00100000:0.0:1788530306.118880:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555851904 00000100:00100000:0.0:1788530306.118903:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555852032 00000100:00100000:0.0:1788530306.118906:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555852032 00000100:00100000:0.0:1788530306.118918:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555851776 00000100:00100000:0.0:1788530306.118920:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555851776 00000100:00100000:0.0:1788530306.118933:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555851136 00000100:00100000:0.0:1788530306.118935:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555851136 00000100:00100000:0.0:1788530306.118945:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555852160 00000100:00100000:2.0:1788530306.119048:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:2.0:1788530306.119058:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875409555851392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530306.119100:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875409555851392:12345-0@lo:400:kworker.0 Request processed in 45us (3301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530306.119106:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:2.0:1788530306.119143:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03ee1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875409555851392:0@lo:400:kworker.0 00000100:00100000:2.0:1788530306.119174:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:2.0:1788530306.119180:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d3f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875409555851904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530306.119213:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d3f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875409555851904:12345-0@lo:400:kworker.0 Request processed in 33us (2271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530306.119219:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00010000:00080000:2.0:1788530306.119243:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f3960c380 x1875409555851904/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530322 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530306.119256:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3960c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875409555851904:0@lo:400:kworker.0 00000100:00100000:2.0:1788530306.119271:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:2.0:1788530306.119276:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3960f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875409555852032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530306.119304:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3960f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875409555852032:12345-0@lo:400:kworker.0 Request processed in 28us (1997us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530306.119309:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00100000:2.0:1788530306.119330:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3960ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875409555852032:0@lo:400:kworker.0 00000100:00100000:2.0:1788530306.119347:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:2.0:1788530306.119353:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03e8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875409555851776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530306.119383:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03e8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875409555851776:12345-0@lo:400:kworker.0 Request processed in 30us (1357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530306.119389:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:2.0:1788530306.119409:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3960dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875409555851776:0@lo:400:kworker.0 00000100:00100000:2.0:1788530306.119426:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:2.0:1788530306.119431:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03ede680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875409555851136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530306.119487:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03ede680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875409555851136:12345-0@lo:400:kworker.0 Request processed in 55us (1377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530306.119493:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:2.0:1788530306.119517:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03ee0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875409555851136:0@lo:400:kworker.0 00000100:00080000:2.0:1788530306.119597:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788530306.119601:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788530306.119875:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555852160 00000100:00100000:0.0:1788530306.119935:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:0.0:1788530306.119942:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03edf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875409555852160:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788530306.120326:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788530306.120418:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03edf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875409555852160:12345-0@lo:400:kworker.0 Request processed in 476us (2238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530306.120424:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00010000:00080000:2.0:1788530306.122931:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f3d3fa300 x1875409555852160/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530322 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530306.122968:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d3fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875409555852160:0@lo:400:kworker.0 00010000:00010000:1.0:1788530306.240739:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788530306.816726:0:13811:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788530306.816736:0:13811:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788530306.816759:0:13811:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1788530306.816766:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788530306.816901:0:13811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03c51c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13811:1875409555852416:192.168.202.41@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788530306.817130:0:13811:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f2c1b3d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788530306.824528:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530306.824592:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531657728 00000100:00100000:3.0:1788530306.824601:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531657728 00000100:00100000:3.0:1788530306.824675:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 186 00000100:00100000:3.0:1788530306.824699:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+65:12379:x1875409531657728:12345-192.168.202.41@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788530306.824737:0:8678:0:(mdt_handler.c:7977:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788530306.824868:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+65:12379:x1875409531657728:12345-192.168.202.41@tcp:53:lhsmtool_posix.0 Request processed in 171us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530306.824876:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 186 00000100:00100000:1.0:1788530306.825416:0:13811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03c51c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13811:1875409555852416:192.168.202.41@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788530306.841270:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530306.844070:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531657856 00000100:00100000:3.0:1788530306.844091:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531657856 00000100:00100000:3.0:1788530306.844165:0:10719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 187 00000100:00100000:3.0:1788530306.844179:0:10719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03eded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+64:12379:x1875409531657856:12345-192.168.202.41@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788530306.844273:0:10719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b400/0xb28d70e125751202 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530306.844293:0:10719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b400/0xb28d70e125751202 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530306.844306:0:10719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b400/0xb28d70e125751202 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530306.844385:0:10719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e125751209 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530306.844395:0:10719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e125751209 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530306.844695:0:10719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e125751209 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530306.844732:0:10719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e125751210 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530306.844742:0:10719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e125751210 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530306.844749:0:10719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e125751210 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788530306.844812:0:10719:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788530306.844818:0:10719:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788530306.844835:0:10719:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e125751210 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530306.844851:0:10719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b400/0xb28d70e125751202 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530306.844859:0:10719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b400/0xb28d70e125751202 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530306.844867:0:10719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b400/0xb28d70e125751202 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530306.844874:0:10719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d36b400 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:3.0:1788530306.844879:0:10719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b400/0xb28d70e125751202 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530306.844889:0:10719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b400/0xb28d70e125751202 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530306.844913:0:10719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a9f2b992000) 00010000:00010000:3.0:1788530306.844916:0:10719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788530306.844923:0:10719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b400/0xb28d70e125751202 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530306.844931:0:10719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b400/0xb28d70e125751202 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530306.845085:0:10719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e125751209 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530306.845092:0:10719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e125751209 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530306.845098:0:10719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e125751209 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530306.845104:0:10719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d36b800 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:3.0:1788530306.845107:0:10719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e125751209 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530306.845113:0:10719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e125751209 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530306.845121:0:10719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff9a9f092c5b00) 00010000:00010000:3.0:1788530306.845123:0:10719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788530306.845126:0:10719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e125751209 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530306.845132:0:10719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e125751209 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530306.845159:0:10719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e125751210 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530306.845165:0:10719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e125751210 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530306.845171:0:10719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e125751210 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530306.845176:0:10719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d36b200 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:3.0:1788530306.845179:0:10719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e125751210 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530306.845185:0:10719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e125751210 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530306.845192:0:10719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a9f2b995500) 00010000:00010000:3.0:1788530306.845195:0:10719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788530306.845197:0:10719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e125751210 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530306.845203:0:10719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e125751210 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530306.845344:0:10719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03eded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+64:12379:x1875409531657856:12345-192.168.202.41@tcp:34:lhsmtool_posix.0 Request processed in 1165us (4083us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530306.845354:0:10719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 187 00000100:00100000:2.0:1788530306.859192:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530306.859347:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531658112 00000100:00100000:0.0:1788530306.859356:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531658112 00000100:00100000:0.0:1788530306.859445:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 188 00000100:00100000:0.0:1788530306.859456:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+64:12379:x1875409531658112:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788530306.859477:0:10720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530306.859496:0:10720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101000/0xb28d70e125751217 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550af6 expref: -99 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530306.859647:0:10720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e12575121e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530306.859663:0:10720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e12575121e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530306.859675:0:10720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e12575121e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788530306.859695:0:10720:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788530306.859777:0:10720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e12575121e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530306.859785:0:10720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e12575121e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530306.859807:0:10720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e12575121e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530306.859813:0:10720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d100c00 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:0.0:1788530306.859817:0:10720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e12575121e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530306.859826:0:10720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e12575121e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530306.859839:0:10720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a9f2b995500) 00010000:00010000:0.0:1788530306.859842:0:10720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788530306.859847:0:10720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e12575121e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530306.859853:0:10720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e12575121e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530306.859891:0:10720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101000/0xb28d70e125751217 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550af6 expref: 66 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530306.859900:0:10720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a9f2b992000) 00010000:00010000:0.0:1788530306.859902:0:10720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788530306.859906:0:10720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101000/0xb28d70e125751217 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550af6 expref: 66 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530306.859915:0:10720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d101000, rc 0) 00000100:00100000:0.0:1788530306.860135:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+65:12379:x1875409531658112:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 680us (953us total) trans 4294967460 rc 301/301 00000100:00100000:0.0:1788530306.860153:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 188 00000100:00100000:1.0:1788530306.865931:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530306.866061:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531658240 00000100:00100000:3.0:1788530306.866074:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531658240 00000100:00100000:3.0:1788530306.866156:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 189 00000100:00100000:3.0:1788530306.866181:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3960dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+65:12379:x1875409531658240:12345-192.168.202.41@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788530306.866230:0:8678:0:(mdt_handler.c:7977:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788530306.866372:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3960dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+65:12379:x1875409531658240:12345-192.168.202.41@tcp:53:lhsmtool_posix.0 Request processed in 194us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530306.866380:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 189 00000100:00100000:0.0:1788530306.887058:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530306.891846:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531658496 00000100:00100000:1.0:1788530306.891871:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531658496 00000100:00100000:1.0:1788530306.892148:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 190 00000100:00100000:1.0:1788530306.892163:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03edce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+65:12379:x1875409531658496:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788530306.892197:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530306.892202:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788530306.892241:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c800/0xb28d70e1257511d8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550ae8 expref: 65 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530306.892268:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a9f2b995b00) 00010000:00010000:1.0:1788530306.892275:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788530306.892296:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eae00/0xb28d70e12575122c lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550afd expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788530306.893852:0:6525:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:1.0:1788530306.894848:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb400/0xb28d70e125751233 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530306.894869:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb400/0xb28d70e125751233 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530306.894881:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb400/0xb28d70e125751233 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530306.895611:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eae00/0xb28d70e12575122c lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550afd expref: 67 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530306.895635:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb400/0xb28d70e125751233 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550afd expref: 66 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530306.895644:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9a9f32abdc00) 00010000:00010000:1.0:1788530306.895647:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788530306.895650:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f012eb400, rc 0) 00000100:00100000:1.0:1788530306.895731:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03edce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+66:12379:x1875409531658496:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 3571us (8683us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1788530306.895741:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 190 00000100:00100000:3.0:1788530306.911344:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530306.911395:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531658752 00000100:00100000:3.0:1788530306.913772:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531658752 00000100:00100000:3.0:1788530306.913875:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 191 00000100:00100000:3.0:1788530306.913886:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+66:12379:x1875409531658752:12345-192.168.202.41@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788530306.913942:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788530306.916131:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb400/0xb28d70e125751233 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550afd expref: 66 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530306.916163:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9a9f32abdc00) 00010000:00010000:3.0:1788530306.916180:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788530306.916220:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e125751241 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530306.916237:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e125751241 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530306.916250:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e125751241 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530306.916297:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e125751248 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x76560fd4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530306.916306:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e125751248 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x76560fd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530306.916329:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e125751248 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x76560fd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530306.916394:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e125751241 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530306.916413:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e125751241 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530306.918031:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e125751241 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530306.918051:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d36b200 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:3.0:1788530306.918057:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e125751241 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530306.918068:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e125751241 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530306.918090:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a9f2b995b00) 00010000:00010000:3.0:1788530306.918093:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788530306.918098:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e125751241 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530306.918106:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e125751241 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530306.918124:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e125751248 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x76560fd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530306.918131:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e125751248 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x76560fd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530306.918153:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e125751248 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x76560fd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530306.918159:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d36b800 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:3.0:1788530306.918162:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e125751248 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x76560fd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530306.918169:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e125751248 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x76560fd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530306.918177:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x76560fd4 (ffff9a9f092c5b00) 00010000:00010000:3.0:1788530306.918179:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788530306.918183:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e125751248 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x76560fd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530306.918189:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e125751248 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x76560fd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530306.918353:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+65:12379:x1875409531658752:12345-192.168.202.41@tcp:36:lhsmtool_posix.0 Request processed in 4462us (7012us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788530306.918363:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 191 00000100:00100000:2.0:1788530306.930635:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530306.930738:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531658880 00000100:00100000:3.0:1788530306.930751:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531658880 00000100:00100000:3.0:1788530306.930846:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 192 00000100:00100000:3.0:1788530306.930858:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+65:12379:x1875409531658880:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788530306.930879:0:8678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788530306.930905:0:8678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b400/0xb28d70e12575124f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550b04 expref: -99 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530306.930972:0:8678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b000/0xb28d70e125751256 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530306.930989:0:8678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b000/0xb28d70e125751256 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530306.931000:0:8678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b000/0xb28d70e125751256 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530306.931122:0:8678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b400/0xb28d70e12575124f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b04 expref: 67 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530306.931141:0:8678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b000/0xb28d70e125751256 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b04 expref: 66 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530306.931151:0:8678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9a9f092c5200) 00010000:00010000:3.0:1788530306.931154:0:8678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788530306.931158:0:8678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d36b000, rc 0) 00000100:00100000:3.0:1788530306.931216:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+66:12379:x1875409531658880:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 361us (857us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530306.931224:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 192 00000100:00100000:2.0:1788530306.935147:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530306.935195:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531659136 00000100:00100000:3.0:1788530306.935206:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531659136 00000100:00100000:3.0:1788530306.935280:0:10719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 193 00000100:00100000:3.0:1788530306.935290:0:10719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+66:12379:x1875409531659136:12345-192.168.202.41@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788530306.935371:0:10719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36be00/0xb28d70e12575125d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530306.935409:0:10719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36be00/0xb28d70e12575125d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530306.935934:0:10719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36be00/0xb28d70e12575125d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788530306.936259:0:10719:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:3.0:1788530306.936272:0:10719:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 514838710573ns, next at 515838707504ns, rc = 0 00000004:00010000:3.0:1788530306.936350:0:10719:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000241f5db6 reply state 00000000dda16d22 transno 4294967462 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36be00/0xb28d70e12575125d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530306.936373:0:10719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36be00/0xb28d70e12575125d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530306.936383:0:10719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9a9f092c5200) 00010000:00010000:3.0:1788530306.936386:0:10719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788530306.936391:0:10719:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788530306.936894:0:10719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+68:12379:x1875409531659136:12345-192.168.202.41@tcp:36:lhsmtool_posix.0 Request processed in 1601us (1753us total) trans 4294967462 rc 0/0 00000100:00100000:3.0:1788530306.936903:0:10719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 193 00000100:00100000:3.0:1788530306.941185:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530306.941283:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531659264 00000100:00100000:0.0:1788530306.941295:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531659264 00000100:00100000:0.0:1788530306.941371:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 194 00000100:00100000:0.0:1788530306.941383:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3740ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+68:12379:x1875409531659264:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788530306.941418:0:10720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530306.941449:0:10720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101000/0xb28d70e125751264 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550b0b expref: -99 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530306.941510:0:10720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101000/0xb28d70e125751264 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b0b expref: 69 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530306.941525:0:10720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101000/0xb28d70e125751264 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b0b expref: 69 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530306.941543:0:10720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9a9f092c5200) 00010000:00010000:0.0:1788530306.941547:0:10720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788530306.941551:0:10720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d101000, rc 0) 00000100:00100000:0.0:1788530306.941639:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3740ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+69:12379:x1875409531659264:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 258us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530306.941646:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 194 00000100:00100000:1.0:1788530306.947043:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530306.948153:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531659392 00000100:00100000:3.0:1788530306.948173:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531659392 00000100:00100000:3.0:1788530306.948271:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 59 00000100:00100000:3.0:1788530306.948282:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3960ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:2399:x1875409531659392:12345-192.168.202.41@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788530306.948602:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3960ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+7:2399:x1875409531659392:12345-192.168.202.41@tcp:2:lhsmtool_posix.0 Request processed in 321us (1568us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1788530306.948612:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 59 00000100:00080000:2.0:1788530306.950102:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788530306.954928:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530306.960067:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531659648 00000100:00100000:3.0:1788530306.960081:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531659648 00000100:00100000:3.0:1788530306.960139:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 49 00000100:00100000:3.0:1788530306.960150:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37377800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+69:12379:x1875409531659648:12345-192.168.202.41@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788530306.960382:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37377800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+70:12379:x1875409531659648:12345-192.168.202.41@tcp:35:lhsmtool_posix.0 Request processed in 233us (5463us total) trans 4294967463 rc 0/0 00000100:00100000:3.0:1788530306.960390:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 49 00000100:00100000:3.0:1788530306.963480:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530306.963783:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531659904 00000100:00100000:1.0:1788530306.963797:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531659904 00000100:00100000:1.0:1788530306.963882:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 195 00000100:00100000:1.0:1788530306.963894:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37409880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+70:12379:x1875409531659904:12345-192.168.202.41@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788530306.964464:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37409880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+70:12379:x1875409531659904:12345-192.168.202.41@tcp:57:lhsmtool_posix.0 Request processed in 505us (931us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530306.964475:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 195 00000100:00100000:3.0:1788530306.968886:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530306.968930:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531660032 00000100:00100000:3.0:1788530306.968939:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531660032 00000100:00100000:3.0:1788530306.969015:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 196 00000100:00100000:3.0:1788530306.969024:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37408700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+70:12379:x1875409531660032:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788530306.969042:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788530306.969061:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b400/0xb28d70e12575126b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550b12 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530306.969125:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e125751272 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530306.969139:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e125751272 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530306.969150:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e125751272 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788530306.969192:0:6525:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788530306.969210:0:6525:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e125751272 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530306.969254:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b400/0xb28d70e12575126b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b12 expref: 72 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530306.969271:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e125751272 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b12 expref: 71 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530306.969280:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9a9f092c5200) 00010000:00010000:3.0:1788530306.969283:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788530306.969287:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d36b800, rc 0) 00000100:00100000:3.0:1788530306.969337:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37408700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+71:12379:x1875409531660032:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 314us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530306.969344:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 196 00000100:00100000:3.0:1788530306.976927:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530306.976987:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531660160 00000100:00100000:3.0:1788530306.977000:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531660160 00000100:00100000:3.0:1788530306.977065:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 60 00000100:00100000:3.0:1788530306.977076:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3740a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+7:2400:x1875409531660160:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788530306.977100:0:8752:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788530306.977124:0:8752:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d357767d/0xb28d70e125751279 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550b19 expref: -99 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788530306.977161:0:8752:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9ace82, blocks: 0x0 00010000:00010000:3.0:1788530306.977183:0:8752:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=514s v=(0 0) 00010000:00010000:3.0:1788530306.977188:0:8752:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788530306.977197:0:8752:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d357767d/0xb28d70e125751279 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b19 expref: 8 pid: 8752 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530306.977234:0:8752:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d357767d/0xb28d70e125751279 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b19 expref: 8 pid: 8752 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530306.977247:0:8752:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d36b200, rc 0) 00000100:00100000:3.0:1788530306.977313:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3740a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+8:2400:x1875409531660160:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 239us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530306.977320:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 60 00000100:00100000:3.0:1788530306.982408:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530306.983155:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531660416 00000100:00100000:2.0:1788530306.983169:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531660416 00000100:00100000:2.0:1788530306.983373:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 197 00000100:00100000:2.0:1788530306.983386:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37408380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+71:12379:x1875409531660416:12345-192.168.202.41@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788530306.983546:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37408380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+71:12379:x1875409531660416:12345-192.168.202.41@tcp:57:lhsmtool_posix.0 Request processed in 162us (1157us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530306.983555:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 197 00000100:00100000:3.0:1788530306.988093:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530306.988166:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531660544 00000100:00100000:1.0:1788530306.988175:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531660544 00000100:00100000:1.0:1788530306.988235:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 61 00000100:00100000:1.0:1788530306.988245:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+8:12379:x1875409531660544:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788530306.988264:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530306.988291:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f37fe473/0xb28d70e125751280 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550b20 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530306.988321:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d357767d/0xb28d70e125751279 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b19 expref: 9 pid: 8752 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530306.988331:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788530306.988336:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788530306.988341:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f37fe473/0xb28d70e125751280 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b20 expref: 9 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530306.988376:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d357767d/0xb28d70e125751279 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b19 expref: 9 pid: 8752 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530306.988390:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d357767d/0xb28d70e125751279 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b19 expref: 9 pid: 8752 timeout: 614 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530306.988413:0:8436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3960c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1875409555852544:192.168.202.41@tcp:104: 00000100:00100000:1.0:1788530306.988496:0:8436:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f0a96b180 going to sleep for 11 seconds 00000100:00100000:0.0:1788530307.004401:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530307.004651:0:8436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3960c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1875409555852544:192.168.202.41@tcp:104: 00010000:00010000:0.0:1788530307.004701:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f37fe473/0xb28d70e125751280 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b20 expref: 9 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530307.004743:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f012eaa00, rc 0) 00000100:00100000:0.0:1788530307.004810:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+9:12379:x1875409531660544:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 16565us (16727us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530307.004820:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 61 00000100:00100000:1.0:1788530307.005036:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531660672 00000100:00100000:1.0:1788530307.005043:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531660672 00010000:00010000:1.0:1788530307.005074:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d357767d/0xb28d70e125751279 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b19 expref: 9 pid: 8752 timeout: 614 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530307.005102:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 95 00000100:00100000:1.0:1788530307.005112:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03edd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+9:2400:x1875409531660672:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788530307.005136:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788530307.005158:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d357767d/0xb28d70e125751279 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b19 expref: 9 pid: 8752 timeout: 614 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530307.005171:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d357767d/0xb28d70e125751279 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b19 expref: 9 pid: 8752 timeout: 614 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530307.005191:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d357767d/0xb28d70e125751279 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b19 expref: 9 pid: 8752 timeout: 614 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530307.005205:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788530307.005210:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788530307.005217:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f37fe473/0xb28d70e125751280 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b20 expref: 8 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530307.005227:0:6509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f37fe473/0xb28d70e125751280 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b20 expref: 8 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530307.007463:0:6509:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f37fe473/0xb28d70e125751280 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b20 expref: 8 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530307.007507:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3960c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6509:1875409555852672:192.168.202.41@tcp:105: 00000100:00100000:1.0:1788530307.007642:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f0a96b480 going to sleep for 11 seconds 00000100:00100000:3.0:1788530307.011368:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3960c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6509:1875409555852672:192.168.202.41@tcp:105: 00010000:00010000:3.0:1788530307.011398:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788530307.011452:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03edd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+8:2400:x1875409531660672:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 6339us (7061us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530307.011463:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 95 00000040:00080000:1.0:1788530307.014302:0:14672:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788530307.014312:0:14672:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788530307.014333:0:14672:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1788530307.014343:0:14672:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788530307.018976:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530307.019159:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531660800 00000100:00100000:0.0:1788530307.019169:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531660800 00002000:00100000:0.0:1788530307.019219:0:8443:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff9a9f3960c380 x1875409531660800/t0(0) o4->aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41@192.168.202.41@tcp:248/0 lens 504/0 e 0 to 0 dl 1788530318 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788530307.019231:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a9f3960c380 with x1875409531660800 ext(0->8) 00002000:00010000:0.0:1788530307.019237:0:8443:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a9f3960c380 00000100:00100000:0.0:1788530307.019266:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 5 00000100:00100000:0.0:1788530307.019276:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3960c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+8:2399:x1875409531660800:12345-192.168.202.41@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788530307.020347:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3960c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+10:2399:x1875409531660800:12345-192.168.202.41@tcp:4:lhsmtool_posix.0 Request processed in 1066us (1375us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1788530307.020359:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 5 00002000:00100000:0.0:1788530307.020369:0:8443:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff9a9f3960c380 x1875409531660800/t4294967316(0) o4->aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41@192.168.202.41@tcp:248/0 lens 504/448 e 0 to 0 dl 1788530318 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788530307.020379:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a9f3960c380 with x1875409531660800 ext(0->8) 00002000:00010000:0.0:1788530307.020384:0:8443:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a9f3960c380 00000100:00100000:1.0:1788530307.022827:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530307.022861:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531660928 00000100:00100000:1.0:1788530307.022869:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531660928 00000100:00100000:1.0:1788530307.022937:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 198 00000100:00100000:1.0:1788530307.022961:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03ee0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+71:12379:x1875409531660928:12345-192.168.202.41@tcp:44:lhsmtool_posix.0 00000100:00080000:1.0:1788530307.023037:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:1.0:1788530307.025242:0:6502:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967463 is committed 00000004:00080000:1.0:1788530307.025262:0:6502:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000004:00080000:1.0:1788530307.025288:0:6502:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000004:00080000:1.0:1788530307.025351:0:6502:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:1.0:1788530307.025364:0:6502:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a9f07d236c0 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:1.0:1788530307.025370:0:6502:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a9e02577600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a9f07d23600 00000020:00080000:1.0:1788530307.025375:0:6502:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a9e02577300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a9e020e1200 00000100:00100000:1.0:1788530307.025616:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03ee1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555852800:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788530307.025715:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530307.025772:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788530307.025778:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03ee3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555852928:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788530307.025803:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530307.025844:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555852800 00000100:00100000:1.0:1788530307.025853:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555852800 00000100:00100000:1.0:1788530307.025904:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555852928 00000100:00100000:1.0:1788530307.025907:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555852928 00000100:00100000:1.0:1788530307.025930:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788530307.025939:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03ee1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555852800:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1788530307.026103:0:8752:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788530307.026122:0:8752:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1788530306 00002000:00010000:1.0:1788530307.026124:0:8752:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788530307.026126:0:8752:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1788530306 -> 1788530306 00002000:00010000:1.0:1788530307.026129:0:8752:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1788530307.026182:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03ee1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3649:x1875409555852800:12345-0@lo:2:osp-syn-1-0.0 Request processed in 242us (466us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1788530307.026191:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788530307.026215:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788530307.026222:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3649:x1875409555852928:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788530307.026243:0:8752:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:4 count 1 00002000:00010000:1.0:1788530307.026279:0:8752:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a9ace7f, atime: 0x6a9ace7f, ctime: 0x6a9ace7f, blocks: 0x8 00010000:00010000:1.0:1788530307.026289:0:8752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003763b231/0xb28d70e125751287 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530307.026310:0:8752:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=514s v=(0 0) 00010000:00010000:1.0:1788530307.026315:0:8752:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788530307.026322:0:8752:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003763b231/0xb28d70e125751287 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530307.026341:0:8752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003763b231/0xb28d70e125751287 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530307.026354:0:8752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003763b231/0xb28d70e125751287 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530307.026362:0:8752:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003763b231/0xb28d70e125751287 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530307.026396:0:8752:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788530307.026520:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3649:x1875409555852928:12345-0@lo:6:osp-syn-0-0.0 Request processed in 298us (714us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1788530307.026527:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00010000:1.0:1788530307.026553:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788530307.026587:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003763b231/0xb28d70e125751287 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530307.026595:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f012ea600 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:1.0:1788530307.026599:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003763b231/0xb28d70e125751287 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530307.026609:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003763b231/0xb28d70e125751287 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530307.026631:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003763b231/0xb28d70e125751287 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530307.026639:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003763b231/0xb28d70e125751287 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530307.026664:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530307.026665:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530307.026667:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788530307.026797:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03ee0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+25:12379:x1875409531660928:12345-192.168.202.41@tcp:44:lhsmtool_posix.0 Request processed in 3848us (3975us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530307.026815:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 198 00000004:00080000:1.0:1788530307.026976:0:3649:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a9e03ee3b80/2, rc 0, transno 4294967308 00000100:00100000:1.0:1788530307.026983:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03ee3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555852928:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1788530307.026994:0:3649:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a9e03ee1f80/2, rc 0, transno 4294967317 00000100:00100000:1.0:1788530307.026997:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03ee1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555852800:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1788530307.027488:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d200/0xb28d70e125750fa8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530307.027498:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d200/0xb28d70e125750fa8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530307.027516:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d200/0xb28d70e125750fa8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530307.027521:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d20d200 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:2.0:1788530307.027525:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d200/0xb28d70e125750fa8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530307.027530:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d200/0xb28d70e125750fa8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530307.027543:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9a9f2b995600) 00010000:00010000:2.0:1788530307.027546:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788530307.027550:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d200/0xb28d70e125750fa8 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530307.027555:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d200/0xb28d70e125750fa8 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530307.027613:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d000/0xb28d70e125750faf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530307.027619:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d000/0xb28d70e125750faf lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530307.027625:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d000/0xb28d70e125750faf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530307.027630:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d20d000 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:2.0:1788530307.027632:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d000/0xb28d70e125750faf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530307.027647:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d000/0xb28d70e125750faf lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530307.027657:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a9f2b995b00) 00010000:00010000:2.0:1788530307.027659:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788530307.027662:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d000/0xb28d70e125750faf lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530307.027668:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d000/0xb28d70e125750faf lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530307.027692:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea000/0xb28d70e125750fee lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530307.027698:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea000/0xb28d70e125750fee lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530307.027704:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea000/0xb28d70e125750fee lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530307.027710:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f012ea000 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:2.0:1788530307.027713:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea000/0xb28d70e125750fee lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530307.027719:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea000/0xb28d70e125750fee lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530307.027727:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9a9f32abd600) 00010000:00010000:2.0:1788530307.027729:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788530307.027732:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea000/0xb28d70e125750fee lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530307.027745:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea000/0xb28d70e125750fee lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530307.027767:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100800/0xb28d70e1257510f1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530307.027773:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100800/0xb28d70e1257510f1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530307.027779:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100800/0xb28d70e1257510f1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530307.027784:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d100800 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:2.0:1788530307.027788:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100800/0xb28d70e1257510f1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530307.027794:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100800/0xb28d70e1257510f1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530307.027802:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a9f2b995500) 00010000:00010000:2.0:1788530307.027805:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788530307.027808:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100800/0xb28d70e1257510f1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530307.027815:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100800/0xb28d70e1257510f1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530307.027827:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20da00/0xb28d70e125751114 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530307.027833:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20da00/0xb28d70e125751114 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530307.027846:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20da00/0xb28d70e125751114 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530307.027850:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d20da00 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:2.0:1788530307.027853:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20da00/0xb28d70e125751114 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530307.027860:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20da00/0xb28d70e125751114 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530307.027868:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a9f2b995500) 00010000:00010000:2.0:1788530307.027870:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788530307.027872:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20da00/0xb28d70e125751114 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530307.027878:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20da00/0xb28d70e125751114 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530307.027888:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20cc00/0xb28d70e12575115a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530307.027894:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20cc00/0xb28d70e12575115a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530307.027900:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20cc00/0xb28d70e12575115a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530307.027905:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d20cc00 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:2.0:1788530307.027907:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20cc00/0xb28d70e12575115a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530307.027923:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20cc00/0xb28d70e12575115a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530307.027931:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a9f2b995500) 00010000:00010000:2.0:1788530307.027933:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788530307.027935:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20cc00/0xb28d70e12575115a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530307.027942:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20cc00/0xb28d70e12575115a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530307.027966:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36be00/0xb28d70e12575125d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530307.027972:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36be00/0xb28d70e12575125d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530307.027978:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36be00/0xb28d70e12575125d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530307.027984:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d36be00 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:2.0:1788530307.027987:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36be00/0xb28d70e12575125d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530307.027993:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36be00/0xb28d70e12575125d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530307.028000:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9a9f092c5200) 00010000:00010000:2.0:1788530307.028003:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788530307.028005:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36be00/0xb28d70e12575125d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530307.028021:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36be00/0xb28d70e12575125d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788530307.029427:0:6555:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:2.0:1788530307.029496:0:6555:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:1.0:1788530307.034840:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530307.036095:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531661056 00000100:00100000:3.0:1788530307.036107:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531661056 00000100:00100000:3.0:1788530307.036169:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 64 00000100:00100000:3.0:1788530307.036180:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+10:2402:x1875409531661056:12345-192.168.202.41@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1788530307.045694:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967317 is committed 00000001:00080000:3.0:1788530307.045714:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967316 is committed 00000100:00100000:0.0:1788530307.045902:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+7:2402:x1875409531661056:12345-192.168.202.41@tcp:16:lhsmtool_posix.0 Request processed in 9717us (11063us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530307.045914:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 64 00000100:00100000:0.0:1788530307.048135:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530307.048185:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530307.048221:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530307.048244:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530307.048277:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530307.048332:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531661184 00000100:00100000:3.0:1788530307.048341:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531661184 00000100:00100000:3.0:1788530307.048394:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 449 00000100:00100000:3.0:1788530307.048413:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f442bcd-b742-4e76-ad7b-709f731358a0+14:2401:x1875409531661184:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1788530307.048491:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f442bcd-b742-4e76-ad7b-709f731358a0+14:2401:x1875409531661184:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 87us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530307.048499:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 449 00000100:00100000:3.0:1788530307.048532:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531661696 00000100:00100000:3.0:1788530307.048536:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531661696 00000100:00100000:3.0:1788530307.048615:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531661312 00000100:00100000:3.0:1788530307.048619:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531661312 00000100:00100000:3.0:1788530307.048639:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531661568 00000100:00100000:3.0:1788530307.048643:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531661568 00000100:00100000:3.0:1788530307.048664:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 399 00000100:00100000:3.0:1788530307.048671:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d3f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2401:x1875409531661696:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1788530307.048710:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d3f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2401:x1875409531661696:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 39us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530307.048717:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 399 00000100:00100000:3.0:1788530307.048729:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 400 00000100:00100000:3.0:1788530307.048735:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3735c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2401:x1875409531661312:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1788530307.048759:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3735c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2401:x1875409531661312:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 24us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530307.048765:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 400 00000100:00100000:3.0:1788530307.048776:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 401 00000100:00100000:3.0:1788530307.048782:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2401:x1875409531661568:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1788530307.048803:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2401:x1875409531661568:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 22us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530307.048809:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 401 00000100:00080000:3.0:1788530307.048833:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788530307.048843:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788530307.049628:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530307.049748:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531661440 00000100:00100000:1.0:1788530307.049754:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531661440 00000100:00100000:1.0:1788530307.049802:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 117 00000100:00100000:1.0:1788530307.049810:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d3fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+7:2401:x1875409531661440:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1788530307.049849:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d3fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+7:2401:x1875409531661440:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 40us (1663us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530307.049856:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 117 00000100:00080000:1.0:1788530307.049873:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788530307.049885:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531661952 00000100:00100000:1.0:1788530307.049888:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531661952 00000100:00100000:1.0:1788530307.049921:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 199 00000100:00100000:1.0:1788530307.049927:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0d6d6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+19:12379:x1875409531661952:12345-192.168.202.41@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788530307.049991:0:8678:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788530307.050023:0:8678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e125751272 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b12 expref: 19 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530307.050042:0:8678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9a9f092c5200) 00010000:00010000:1.0:1788530307.050048:0:8678:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788530307.050092:0:8678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea200/0xb28d70e12575128e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530307.050109:0:8678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea200/0xb28d70e12575128e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530307.050120:0:8678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea200/0xb28d70e12575128e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788530307.050261:0:8678:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000be891e3c reply state 00000000eb5739a1 transno 4294967464 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea200/0xb28d70e12575128e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530307.050274:0:8678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea200/0xb28d70e12575128e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530307.050281:0:8678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9a9f092c5200) 00010000:00010000:1.0:1788530307.050284:0:8678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788530307.050287:0:8678:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788530307.050353:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0d6d6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+20:12379:x1875409531661952:12345-192.168.202.41@tcp:36:lhsmtool_posix.0 Request processed in 425us (728us total) trans 4294967464 rc 0/0 00000100:00100000:1.0:1788530307.050359:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 199 00000100:00100000:0.0:1788530307.064296:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530307.064371:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531662080 00000100:00100000:2.0:1788530307.064382:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531662080 00000100:00100000:2.0:1788530307.064440:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 65 00000100:00100000:2.0:1788530307.064451:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+7:2399:x1875409531662080:12345-192.168.202.41@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788530307.064670:0:8438:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1788530307.064674:0:8438:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1788530306 -> 1788530304 00002000:00010000:2.0:1788530307.064686:0:8438:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1788530303 00002000:00010000:2.0:1788530307.064689:0:8438:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1788530306 -> 1788530304 00002000:00010000:2.0:1788530307.064691:0:8438:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1788530307.064749:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+8:2399:x1875409531662080:12345-192.168.202.41@tcp:2:lhsmtool_posix.0 Request processed in 299us (461us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1788530307.064757:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 65 00000100:00100000:2.0:1788530307.070388:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530307.072086:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531662336 00000100:00100000:3.0:1788530307.072103:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531662336 00000100:00100000:3.0:1788530307.072187:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 200 00000100:00100000:3.0:1788530307.072200:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37377100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+20:12379:x1875409531662336:12345-192.168.202.41@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788530307.072281:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031400/0xb28d70e125751295 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530307.072301:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b000/0xb28d70e125751256 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b04 expref: 20 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530307.072311:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031400/0xb28d70e125751295 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530307.072348:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b000/0xb28d70e125751256 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b04 expref: 20 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530307.072364:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b000/0xb28d70e125751256 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b04 expref: 20 pid: 8678 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530307.072378:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d43480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6523:1875409555853056:192.168.202.41@tcp:104: 00000100:00100000:3.0:1788530307.072484:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f221323c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788530307.078752:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d43480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6523:1875409555853056:192.168.202.41@tcp:104: 00010000:00010000:3.0:1788530307.078794:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031400/0xb28d70e125751295 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530307.078934:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530307.079184:0:10347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531662464 00000100:00100000:3.0:1788530307.079195:0:10347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531662464 00010000:00010000:3.0:1788530307.079248:0:10347:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b000/0xb28d70e125751256 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b04 expref: 21 pid: 8678 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530307.079317:0:10347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 96 00000100:00100000:3.0:1788530307.079329:0:10347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37377480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+21:2399:x1875409531662464:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788530307.079347:0:10347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788530307.079353:0:10347:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b000/0xb28d70e125751256 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b04 expref: 21 pid: 8678 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530307.079365:0:10347:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b000/0xb28d70e125751256 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b04 expref: 21 pid: 8678 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530307.079391:0:10347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b000/0xb28d70e125751256 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b04 expref: 21 pid: 8678 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530307.079407:0:10347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9a9f092c5200) 00010000:00010000:3.0:1788530307.079412:0:10347:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031400/0xb28d70e125751295 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530307.079423:0:10347:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031400/0xb28d70e125751295 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530307.079431:0:10347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031400/0xb28d70e125751295 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530307.079455:0:10347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788530307.079516:0:10347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37377480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+20:2399:x1875409531662464:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 189us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530307.079524:0:10347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 96 00010000:00010000:3.0:1788530307.079550:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031400/0xb28d70e125751295 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530307.079592:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031400/0xb28d70e125751295 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530307.079628:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031400/0xb28d70e125751295 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530307.079635:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031400/0xb28d70e125751295 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530307.079642:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031400/0xb28d70e125751295 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530307.079648:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f00031400 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:3.0:1788530307.079652:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031400/0xb28d70e125751295 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530307.079660:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031400/0xb28d70e125751295 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530307.079669:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9a9f092c5200) 00010000:00010000:3.0:1788530307.079671:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788530307.079675:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031400/0xb28d70e125751295 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530307.079692:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031400/0xb28d70e125751295 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530307.079737:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37377100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+19:12379:x1875409531662336:12345-192.168.202.41@tcp:55:lhsmtool_posix.0 Request processed in 7539us (9361us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788530307.079744:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 200 00000100:00100000:2.0:1788530307.084346:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530307.084471:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531662592 00000100:00100000:1.0:1788530307.084482:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531662592 00000100:00100000:1.0:1788530307.084545:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 66 00000100:00100000:1.0:1788530307.084578:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37375500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+8:2399:x1875409531662592:12345-192.168.202.41@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788530307.084812:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000003763b231/0xb28d70e12575129c lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530307.084834:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f37fe473/0xb28d70e125751280 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b20 expref: 8 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530307.084859:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788530307.084864:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788530307.084869:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003763b231/0xb28d70e12575129c lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530307.084908:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f37fe473/0xb28d70e125751280 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b20 expref: 8 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530307.084922:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f37fe473/0xb28d70e125751280 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b20 expref: 8 pid: 8436 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530307.084938:0:8436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2a2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1875409555853184:192.168.202.41@tcp:104: 00000100:00100000:2.0:1788530307.086868:0:8436:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f0a96b900 going to sleep for 11 seconds 00000100:00100000:3.0:1788530307.091834:0:8436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2a2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1875409555853184:192.168.202.41@tcp:104: 00010000:00010000:3.0:1788530307.091871:0:8436:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003763b231/0xb28d70e12575129c lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530307.097773:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530307.097819:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531662720 00000100:00100000:2.0:1788530307.097831:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531662720 00010000:00010000:2.0:1788530307.097876:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f37fe473/0xb28d70e125751280 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b20 expref: 9 pid: 8436 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530307.097960:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 97 00000100:00100000:2.0:1788530307.097972:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37376680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+9:2399:x1875409531662720:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788530307.097990:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788530307.098013:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f37fe473/0xb28d70e125751280 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b20 expref: 9 pid: 8436 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530307.098028:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f37fe473/0xb28d70e125751280 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b20 expref: 9 pid: 8436 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530307.098054:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f37fe473/0xb28d70e125751280 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b20 expref: 9 pid: 8436 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530307.098073:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788530307.098078:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788530307.098085:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003763b231/0xb28d70e12575129c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530307.098095:0:6508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003763b231/0xb28d70e12575129c lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530307.098126:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788530307.098186:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37376680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+8:2399:x1875409531662720:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 214us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530307.098195:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 97 00010000:00010000:2.0:1788530307.098238:0:8436:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003763b231/0xb28d70e12575129c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530307.098248:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003763b231/0xb28d70e12575129c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530307.098271:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000003763b231/0xb28d70e12575129c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530307.098281:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003763b231/0xb28d70e12575129c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530307.098289:0:8436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003763b231/0xb28d70e12575129c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530307.098297:0:8436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f012ea600 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:2.0:1788530307.098302:0:8436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003763b231/0xb28d70e12575129c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530307.098311:0:8436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003763b231/0xb28d70e12575129c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530307.098324:0:8436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003763b231/0xb28d70e12575129c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530307.098332:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003763b231/0xb28d70e12575129c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530307.098399:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37375500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+7:2399:x1875409531662592:12345-192.168.202.41@tcp:1:lhsmtool_posix.0 Request processed in 13843us (14068us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530307.098408:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 66 00000100:00100000:2.0:1788530307.101611:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530307.101700:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531662976 00000100:00100000:3.0:1788530307.101712:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531662976 00000100:00100000:3.0:1788530307.101821:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 201 00000100:00100000:3.0:1788530307.101834:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37376300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+19:12379:x1875409531662976:12345-192.168.202.41@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788530307.101923:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031400/0xb28d70e1257512a3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530307.101942:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb800/0xb28d70e1257510ea lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550aa9 expref: 19 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530307.101953:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031400/0xb28d70e1257512a3 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530307.101995:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb800/0xb28d70e1257510ea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550aa9 expref: 19 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530307.102011:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb800/0xb28d70e1257510ea lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550aa9 expref: 19 pid: 6524 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530307.102027:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d43480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6524:1875409555853312:192.168.202.41@tcp:104: 00000100:00100000:3.0:1788530307.102117:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f221323c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788530307.109218:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530307.109262:0:10347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531663104 00000100:00100000:0.0:1788530307.109273:0:10347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531663104 00010000:00010000:0.0:1788530307.109318:0:10347:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb800/0xb28d70e1257510ea lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550aa9 expref: 20 pid: 6524 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530307.109356:0:10347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 98 00000100:00100000:0.0:1788530307.109367:0:10347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f396c3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+20:2400:x1875409531663104:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788530307.109383:0:10347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788530307.109390:0:10347:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb800/0xb28d70e1257510ea lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550aa9 expref: 20 pid: 6524 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530307.109404:0:10347:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb800/0xb28d70e1257510ea lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550aa9 expref: 20 pid: 6524 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530307.109429:0:10347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a9f2b995500) 00010000:00010000:0.0:1788530307.109436:0:10347:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031400/0xb28d70e1257512a3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530307.109446:0:10347:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031400/0xb28d70e1257512a3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530307.109454:0:10347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031400/0xb28d70e1257512a3 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530307.109481:0:10347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788530307.109536:0:10347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f396c3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+20:2400:x1875409531663104:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 170us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530307.109544:0:10347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 98 00010000:00010000:3.0:1788530307.110515:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb800/0xb28d70e1257510ea lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550aa9 expref: 19 pid: 6524 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530307.110548:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d43480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6524:1875409555853312:192.168.202.41@tcp:104: 00010000:00010000:3.0:1788530307.111865:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031400/0xb28d70e1257512a3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530307.111882:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031400/0xb28d70e1257512a3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530307.111893:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031400/0xb28d70e1257512a3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530307.112115:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e1257512aa lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530307.112132:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101000/0xb28d70e125751264 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b0b expref: 19 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530307.112140:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e1257512aa lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530307.112178:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101000/0xb28d70e125751264 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b0b expref: 19 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530307.112196:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101000/0xb28d70e125751264 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b0b expref: 19 pid: 10720 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530307.112211:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d43480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6524:1875409555853440:192.168.202.41@tcp:104: 00000100:00100000:3.0:1788530307.113759:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f221329c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788530307.134125:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530307.134252:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531663232 00000100:00100000:1.0:1788530307.134262:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531663232 00010000:00010000:1.0:1788530307.134303:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101000/0xb28d70e125751264 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b0b expref: 20 pid: 10720 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530307.134348:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 99 00000100:00100000:1.0:1788530307.134359:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+20:2399:x1875409531663232:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788530307.134376:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788530307.134383:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101000/0xb28d70e125751264 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b0b expref: 20 pid: 10720 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530307.134397:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101000/0xb28d70e125751264 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b0b expref: 20 pid: 10720 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530307.134433:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9a9f092c5200) 00010000:00010000:1.0:1788530307.134440:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e1257512aa lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530307.134450:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e1257512aa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530307.134457:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e1257512aa lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530307.134478:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788530307.134532:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+20:2399:x1875409531663232:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 174us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530307.134539:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 99 00000100:00100000:1.0:1788530307.142124:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555853568:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788530307.142212:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788530307.142475:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101000/0xb28d70e125751264 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b0b expref: 19 pid: 10720 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530307.142498:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d43480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6524:1875409555853440:192.168.202.41@tcp:104: 00010000:00010000:3.0:1788530307.142522:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e1257512aa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530307.142533:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e1257512aa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530307.142539:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e1257512aa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788530307.142670:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:3.0:1788530307.142801:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000001:00080000:3.0:1788530307.142838:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:3.0:1788530307.142919:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d43480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6524:1875409555853696:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788530307.143146:0:14186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555853568 00000100:00100000:1.0:1788530307.143155:0:14186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555853568 00000100:00100000:1.0:1788530307.143211:0:14186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1788530307.143224:0:14186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555853568:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788530307.143264:0:14186:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446453248 avail 1300213760 00000100:00100000:1.0:1788530307.143345:0:14186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555853568:12345-0@lo:41:osp-pre-1-0.0 Request processed in 122us (1133us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530307.143352:0:14186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1788530307.143393:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555853568:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788530307.144074:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530307.144111:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f22132780 going to sleep for 11 seconds 00000100:00100000:1.0:1788530307.145087:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555853696 00000100:00100000:1.0:1788530307.145104:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555853696 00000100:00100000:1.0:1788530307.145152:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1788530307.145161:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6524:x1875409555853696:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788530307.145268:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6524:x1875409555853696:12345-0@lo:1000:mdt00_001.0 Request processed in 108us (1194us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530307.145275:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1788530307.145397:0:6524:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967317 gen 2 00000004:00080000:3.0:1788530307.145413:0:6524:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a9e03ee1f80, transno 4294967317 00000100:00100000:3.0:1788530307.145425:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d43480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6524:1875409555853696:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1788530307.145588:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967468 00000100:00100000:3.0:1788530307.145655:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d43480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6524:1875409555853824:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788530307.145704:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530307.145731:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f22132c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788530307.145742:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555853824 00000100:00100000:3.0:1788530307.145746:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555853824 00000100:00100000:3.0:1788530307.145770:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1788530307.145784:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6524:x1875409555853824:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788530307.145880:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6524:x1875409555853824:12345-0@lo:1000:mdt00_001.0 Request processed in 97us (175us total) trans 4294967319 rc 0/0 00000100:00100000:3.0:1788530307.145887:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1788530307.145919:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d43480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6524:1875409555853824:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1788530307.146221:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e1257512aa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530307.146233:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e1257512aa lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530307.146240:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e1257512aa lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530307.146247:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f00031800 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:3.0:1788530307.146252:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e1257512aa lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530307.146260:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e1257512aa lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530307.146280:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9a9f092c5200) 00010000:00010000:3.0:1788530307.146283:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788530307.146287:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e1257512aa lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530307.146292:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e1257512aa lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530307.146317:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d800/0xb28d70e1257511df lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530307.146329:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d800/0xb28d70e1257511df lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530307.146334:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d800/0xb28d70e1257511df lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530307.146339:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d20d800 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:3.0:1788530307.146343:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d800/0xb28d70e1257511df lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530307.146349:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d800/0xb28d70e1257511df lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530307.146357:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a9f2b995500) 00010000:00010000:3.0:1788530307.146360:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788530307.146363:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d800/0xb28d70e1257511df lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530307.146368:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d800/0xb28d70e1257511df lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530307.146392:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e1257512b1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530307.146459:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ca00/0xb28d70e1257511fb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550aef expref: 22 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530307.146470:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e1257512b1 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530307.146496:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ca00/0xb28d70e1257511fb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550aef expref: 22 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530307.146516:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ca00/0xb28d70e1257511fb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550aef expref: 22 pid: 8678 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530307.146527:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d41c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6524:1875409555853952:192.168.202.41@tcp:104: 00000100:00100000:3.0:1788530307.147599:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e0273b000 going to sleep for 11 seconds 00000100:00100000:3.0:1788530307.155857:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530307.156014:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d41c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6524:1875409555853952:192.168.202.41@tcp:104: 00010000:00010000:1.0:1788530307.156057:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e1257512b1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530307.156213:0:10347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531663360 00000100:00100000:2.0:1788530307.156223:0:10347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531663360 00010000:00010000:2.0:1788530307.156271:0:10347:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ca00/0xb28d70e1257511fb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550aef expref: 23 pid: 8678 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530307.156307:0:10347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 100 00000100:00100000:2.0:1788530307.156318:0:10347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d40380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+23:2399:x1875409531663360:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788530307.156334:0:10347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788530307.156342:0:10347:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ca00/0xb28d70e1257511fb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550aef expref: 23 pid: 8678 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530307.156356:0:10347:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ca00/0xb28d70e1257511fb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550aef expref: 23 pid: 8678 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530307.156385:0:10347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ca00/0xb28d70e1257511fb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550aef expref: 23 pid: 8678 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530307.156416:0:10347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a9f2b995500) 00010000:00010000:2.0:1788530307.156422:0:10347:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e1257512b1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530307.156433:0:10347:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e1257512b1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530307.156456:0:10347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e1257512b1 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530307.156487:0:10347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788530307.156546:0:10347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d40380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+22:2399:x1875409531663360:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 229us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530307.156554:0:10347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 100 00010000:00010000:3.0:1788530307.157374:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e1257512b1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530307.157387:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e1257512b1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530307.157411:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e1257512b1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530307.157419:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e1257512b1 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530307.157425:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e1257512b1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530307.157431:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f00031e00 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:3.0:1788530307.157436:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e1257512b1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530307.157442:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e1257512b1 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530307.157454:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a9f2b995500) 00010000:00010000:3.0:1788530307.157466:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788530307.157471:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e1257512b1 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530307.157476:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e1257512b1 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530307.157490:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031400/0xb28d70e1257512a3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530307.157496:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031400/0xb28d70e1257512a3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530307.157501:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031400/0xb28d70e1257512a3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530307.157506:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f00031400 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:3.0:1788530307.157510:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031400/0xb28d70e1257512a3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530307.157515:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031400/0xb28d70e1257512a3 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530307.157524:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a9f2b995500) 00010000:00010000:3.0:1788530307.157526:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788530307.157529:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031400/0xb28d70e1257512a3 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530307.157534:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031400/0xb28d70e1257512a3 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530307.157814:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37376300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+21:12379:x1875409531662976:12345-192.168.202.41@tcp:57:lhsmtool_posix.0 Request processed in 55981us (56250us total) trans 4294967469 rc 0/0 00000100:00100000:3.0:1788530307.157833:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 201 00000020:00080000:3.0:1788530307.157838:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788530307.158353:0:13811:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788530307.158358:0:13811:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788530307.162224:0:13811:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:2.0:1788530307.162265:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788530307.165483:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530307.165611:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531663616 00000100:00100000:2.0:1788530307.165622:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531663616 00000100:00100000:2.0:1788530307.165692:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 50 00000100:00100000:2.0:1788530307.165705:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3959d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+21:12379:x1875409531663616:12345-192.168.202.41@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788530307.166156:0:6527:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788530307.166187:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967470 00010000:00010000:2.0:1788530307.166224:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d200/0xb28d70e1257512b8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530307.166247:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d200/0xb28d70e1257512b8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530307.166259:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d200/0xb28d70e1257512b8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530307.166267:0:6527:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d200/0xb28d70e1257512b8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530307.166294:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d200/0xb28d70e1257512b8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530307.166301:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d200/0xb28d70e1257512b8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530307.166321:0:6527:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788530307.166403:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3959d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+23:12379:x1875409531663616:12345-192.168.202.41@tcp:35:lhsmtool_posix.0 Request processed in 700us (936us total) trans 4294967471 rc 0/0 00000100:00100000:2.0:1788530307.166411:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 50 00000020:00080000:2.0:1788530307.166416:0:6527:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788530307.166467:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788530307.166474:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d200/0xb28d70e1257512b8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530307.166481:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d20d200 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:2.0:1788530307.166486:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d200/0xb28d70e1257512b8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530307.166494:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d200/0xb28d70e1257512b8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530307.166508:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9a9f092c5200) 00010000:00010000:2.0:1788530307.166511:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788530307.166516:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d200/0xb28d70e1257512b8 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530307.166522:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d200/0xb28d70e1257512b8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530307.166544:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530307.166546:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530307.166548:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530307.275515:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530308.294386:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788530308.894829:0:14723:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788530308.894844:0:14723:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788530308.894878:0:14723:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1788530308.894887:0:14723:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788530309.084928:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530309.085059:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531663872 00000100:00100000:1.0:1788530309.085072:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531663872 00000100:00100000:1.0:1788530309.085190:0:10719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 202 00000100:00100000:1.0:1788530309.085204:0:10719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+23:12398:x1875409531663872:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:1.0:1788530309.085240:0:10719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530309.085267:0:10719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb200/0xb28d70e1257512bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550b27 expref: -99 pid: 10719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788530309.085402:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788530309.085419:0:10719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb800/0xb28d70e1257512c6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530309.085439:0:10719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb800/0xb28d70e1257512c6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530309.085454:0:10719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb800/0xb28d70e1257512c6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788530309.085468:0:10719:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1788530309.086164:0:10719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb200/0xb28d70e1257512bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b27 expref: 26 pid: 10719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530309.086191:0:10719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb800/0xb28d70e1257512c6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b27 expref: 25 pid: 10719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530309.086199:0:10719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a9f2b995b00) 00010000:00010000:1.0:1788530309.086202:0:10719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788530309.086206:0:10719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f012eb800, rc 0) 00000100:00100000:1.0:1788530309.086276:0:10719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+25:12398:x1875409531663872:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 1076us (1360us total) trans 4294967472 rc 0/0 00000100:00100000:1.0:1788530309.086284:0:10719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 202 00000100:00100000:2.0:1788530309.090740:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530309.090938:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531664000 00000100:00100000:3.0:1788530309.090950:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531664000 00000100:00100000:3.0:1788530309.091034:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 203 00000100:00100000:3.0:1788530309.091046:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37377800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+25:12398:x1875409531664000:12345-192.168.202.41@tcp:34:lfs.0 00010000:00010000:3.0:1788530309.091127:0:10720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e1257512d4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530309.091144:0:10720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e1257512d4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530309.091157:0:10720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e1257512d4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530309.091172:0:10720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031400/0xb28d70e1257512db lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530309.091180:0:10720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031400/0xb28d70e1257512db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530309.091186:0:10720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031400/0xb28d70e1257512db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530309.091285:0:10720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e1257512e2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530309.091308:0:10720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e1257512e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530309.091315:0:10720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e1257512e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788530309.091362:0:10720:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e1257512e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530309.091375:0:10720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e1257512d4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530309.091392:0:10720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e1257512d4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530309.091399:0:10720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e1257512d4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530309.091405:0:10720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f00031e00 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:3.0:1788530309.091410:0:10720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e1257512d4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530309.091417:0:10720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e1257512d4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530309.091429:0:10720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a9f2b995b00) 00010000:00010000:3.0:1788530309.091432:0:10720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788530309.091437:0:10720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e1257512d4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530309.091442:0:10720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e1257512d4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530309.091464:0:10720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031400/0xb28d70e1257512db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530309.091469:0:10720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031400/0xb28d70e1257512db lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530309.091474:0:10720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031400/0xb28d70e1257512db lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530309.091478:0:10720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f00031400 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:3.0:1788530309.091480:0:10720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031400/0xb28d70e1257512db lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530309.091485:0:10720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031400/0xb28d70e1257512db lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530309.091492:0:10720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9a9f0cf59500) 00010000:00010000:3.0:1788530309.091494:0:10720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788530309.091497:0:10720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031400/0xb28d70e1257512db lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530309.091503:0:10720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031400/0xb28d70e1257512db lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530309.091516:0:10720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e1257512e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530309.091521:0:10720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e1257512e2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530309.091526:0:10720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e1257512e2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530309.091536:0:10720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f00031800 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:3.0:1788530309.091538:0:10720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e1257512e2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530309.091543:0:10720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e1257512e2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530309.091551:0:10720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a9f0cf59900) 00010000:00010000:3.0:1788530309.091553:0:10720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788530309.091555:0:10720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e1257512e2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530309.091586:0:10720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e1257512e2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530309.093071:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37377800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+25:12398:x1875409531664000:12345-192.168.202.41@tcp:34:lfs.0 Request processed in 2014us (2329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530309.093089:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 203 00000100:00100000:3.0:1788530309.170249:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530309.170378:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531664256 00000100:00100000:3.0:1788530309.170391:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531664256 00000100:00100000:3.0:1788530309.170478:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 204 00000100:00100000:3.0:1788530309.170493:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+25:12401:x1875409531664256:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:3.0:1788530309.170520:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788530309.170551:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e1257512e9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550b2e expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530309.170957:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031400/0xb28d70e1257512f0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530309.170989:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031400/0xb28d70e1257512f0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530309.171004:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031400/0xb28d70e1257512f0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530309.171022:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e1257512f7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530309.171030:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e1257512f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530309.171037:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e1257512f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530309.171149:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030000/0xb28d70e1257512fe lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530309.171158:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030000/0xb28d70e1257512fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530309.171167:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030000/0xb28d70e1257512fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788530309.171178:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:3.0:1788530309.172358:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031400/0xb28d70e1257512f0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530309.172379:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031400/0xb28d70e1257512f0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530309.172387:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031400/0xb28d70e1257512f0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530309.172413:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f00031400 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:3.0:1788530309.172418:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031400/0xb28d70e1257512f0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530309.172429:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031400/0xb28d70e1257512f0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530309.172448:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a9f2b995b00) 00010000:00010000:3.0:1788530309.172452:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788530309.172459:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031400/0xb28d70e1257512f0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530309.172465:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031400/0xb28d70e1257512f0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530309.172485:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e1257512f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530309.172492:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e1257512f7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530309.172498:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e1257512f7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530309.172504:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f00031e00 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:3.0:1788530309.172508:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e1257512f7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530309.172515:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e1257512f7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530309.172535:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9a9f0cf59900) 00010000:00010000:3.0:1788530309.172537:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788530309.172541:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e1257512f7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530309.172547:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031e00/0xb28d70e1257512f7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530309.173247:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031800/0xb28d70e1257512e9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b2e expref: 28 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530309.173339:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030000/0xb28d70e1257512fe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b2e expref: 27 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530309.173348:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a9f0cf59500) 00010000:00010000:3.0:1788530309.173351:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788530309.173354:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f00030000, rc 0) 00000100:00100000:3.0:1788530309.173436:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+27:12401:x1875409531664256:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 2946us (3805us total) trans 4294967473 rc 0/0 00000100:00100000:3.0:1788530309.173446:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 204 00000100:00100000:2.0:1788530309.182134:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530309.182177:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531664384 00000100:00100000:2.0:1788530309.182188:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531664384 00000100:00100000:2.0:1788530309.182258:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 205 00000100:00100000:2.0:1788530309.182270:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37377480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+27:12401:x1875409531664384:12345-192.168.202.41@tcp:54:lfs.0 00010000:00010000:2.0:1788530309.182342:0:8678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d600/0xb28d70e12575130c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530309.182360:0:8678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d600/0xb28d70e12575130c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530309.182371:0:8678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d600/0xb28d70e12575130c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530309.182411:0:8678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d600/0xb28d70e12575130c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530309.182419:0:8678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d600/0xb28d70e12575130c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530309.182426:0:8678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d600/0xb28d70e12575130c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530309.182432:0:8678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d20d600 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:2.0:1788530309.182437:0:8678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d600/0xb28d70e12575130c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530309.182460:0:8678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d600/0xb28d70e12575130c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530309.182473:0:8678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a9f0cf59500) 00010000:00010000:2.0:1788530309.182476:0:8678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788530309.182481:0:8678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d600/0xb28d70e12575130c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530309.182488:0:8678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d600/0xb28d70e12575130c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530309.182583:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37377480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+27:12401:x1875409531664384:12345-192.168.202.41@tcp:54:lfs.0 Request processed in 314us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530309.182590:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 205 00000100:00100000:2.0:1788530309.185617:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530309.185675:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531664640 00000100:00100000:2.0:1788530309.185685:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531664640 00000100:00100000:2.0:1788530309.185744:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 51 00000100:00100000:2.0:1788530309.185759:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37376680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+27:12401:x1875409531664640:12345-192.168.202.41@tcp:35:lfs.0 00000100:00100000:2.0:1788530309.186120:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37376680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+28:12401:x1875409531664640:12345-192.168.202.41@tcp:35:lfs.0 Request processed in 365us (513us total) trans 4294967474 rc 0/0 00000100:00100000:2.0:1788530309.186128:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 51 00000100:00100000:2.0:1788530309.244199:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530309.244305:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531664896 00000100:00100000:1.0:1788530309.244321:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531664896 00000100:00100000:1.0:1788530309.244434:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 206 00000100:00100000:1.0:1788530309.244447:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37375f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+28:11925:x1875409531664896:12345-192.168.202.41@tcp:101:bash.0 00010000:00010000:1.0:1788530309.244485:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530309.244513:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb200/0xb28d70e125751313 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550b35 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530309.251515:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d600/0xb28d70e12575131a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530309.251547:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030000/0xb28d70e1257512fe lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b2e expref: 29 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530309.251602:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d600/0xb28d70e12575131a lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530309.251646:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030000/0xb28d70e1257512fe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b2e expref: 29 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530309.251673:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030000/0xb28d70e1257512fe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b2e expref: 29 pid: 6525 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530309.251689:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37374700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6523:1875409555854080:192.168.202.41@tcp:104: 00000100:00100000:2.0:1788530309.251795:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f33e24cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788530309.254746:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37374700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6523:1875409555854080:192.168.202.41@tcp:104: 00010000:00010000:3.0:1788530309.254784:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d600/0xb28d70e12575131a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530309.256208:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530309.256330:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531665024 00000100:00100000:1.0:1788530309.256342:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531665024 00010000:00010000:1.0:1788530309.256397:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030000/0xb28d70e1257512fe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b2e expref: 30 pid: 6525 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530309.256440:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 101 00000100:00100000:1.0:1788530309.256453:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37374000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+30:2400:x1875409531665024:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788530309.256471:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788530309.256492:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030000/0xb28d70e1257512fe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b2e expref: 30 pid: 6525 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530309.256507:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030000/0xb28d70e1257512fe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b2e expref: 30 pid: 6525 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530309.256532:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030000/0xb28d70e1257512fe lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b2e expref: 30 pid: 6525 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530309.256551:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a9f0cf59500) 00010000:00010000:1.0:1788530309.256556:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d600/0xb28d70e12575131a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530309.256596:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d600/0xb28d70e12575131a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530309.256605:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d600/0xb28d70e12575131a lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530309.256635:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788530309.256759:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37374000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+29:2400:x1875409531665024:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 309us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530309.256767:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 101 00010000:00010000:2.0:1788530309.256849:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d600/0xb28d70e12575131a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530309.256860:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d600/0xb28d70e12575131a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788530309.256880:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:2.0:1788530309.257024:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb200/0xb28d70e125751313 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b35 expref: 30 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530309.257042:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d600/0xb28d70e12575131a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b35 expref: 29 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530309.257048:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a9f0cf59500) 00010000:00010000:2.0:1788530309.257051:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788530309.257060:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d20d600, rc 0) 00000100:00100000:2.0:1788530309.257087:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37375f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+29:11925:x1875409531664896:12345-192.168.202.41@tcp:101:bash.0 Request processed in 12643us (12901us total) trans 4294967475 rc 0/0 00000100:00100000:2.0:1788530309.257095:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 206 00000100:00100000:2.0:1788530309.262857:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530309.263368:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531665152 00000100:00100000:3.0:1788530309.263381:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531665152 00000100:00100000:3.0:1788530309.263516:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 207 00000100:00100000:3.0:1788530309.263526:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37375880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+29:11925:x1875409531665152:12345-192.168.202.41@tcp:101:bash.0 00010000:00010000:3.0:1788530309.263608:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788530309.263631:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b000/0xb28d70e125751328 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550b3c expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530309.263679:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e12575132f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530309.263696:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e12575132f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530309.263709:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e12575132f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530309.263819:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b000/0xb28d70e125751328 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b3c expref: 31 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530309.263840:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e12575132f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b3c expref: 30 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530309.263850:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a9f0cf59500) 00010000:00010000:3.0:1788530309.263863:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788530309.263867:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d36b800, rc 0) 00000100:00100000:3.0:1788530309.263939:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37375880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+30:11925:x1875409531665152:12345-192.168.202.41@tcp:101:bash.0 Request processed in 414us (1093us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530309.263946:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 207 00000100:00100000:2.0:1788530309.271668:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530309.271768:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531665408 00000100:00100000:0.0:1788530309.271782:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531665408 00000100:00100000:0.0:1788530309.271887:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 208 00000100:00100000:0.0:1788530309.271902:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37375c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+30:11925:x1875409531665408:12345-192.168.202.41@tcp:36:bash.0 00010000:00010000:0.0:1788530309.272253:0:8678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e125751336 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.272277:0:8678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e125751336 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.272293:0:8678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e125751336 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788530309.272372:0:8678:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000004:00010000:0.0:1788530309.272399:0:8678:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000029b988b reply state 000000004b6f105d transno 4294967477 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e125751336 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.272414:0:8678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e125751336 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.272449:0:8678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a9f0cf59500) 00010000:00010000:0.0:1788530309.272452:0:8678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788530309.272458:0:8678:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1788530309.272501:0:8678:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967477 00000100:00100000:0.0:1788530309.272646:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37375c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+34:11925:x1875409531665408:12345-192.168.202.41@tcp:36:bash.0 Request processed in 745us (997us total) trans 4294967478 rc 0/0 00000100:00100000:0.0:1788530309.272654:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 208 00000020:00080000:0.0:1788530309.272670:0:8678:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1788530309.275014:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530309.275148:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531665536 00000100:00100000:3.0:1788530309.275158:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531665536 00000100:00100000:3.0:1788530309.275238:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 209 00000100:00100000:3.0:1788530309.275248:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37374e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+34:11925:x1875409531665536:12345-192.168.202.41@tcp:101:bash.0 00010000:00010000:3.0:1788530309.275299:0:10720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788530309.275320:0:10720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36be00/0xb28d70e12575133d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550b43 expref: -99 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530309.275379:0:10720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36be00/0xb28d70e12575133d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b43 expref: 35 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530309.275394:0:10720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36be00/0xb28d70e12575133d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b43 expref: 35 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530309.275414:0:10720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a9f0cf59500) 00010000:00010000:3.0:1788530309.275417:0:10720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788530309.275420:0:10720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d36be00, rc 0) 00000100:00100000:3.0:1788530309.275485:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37374e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+35:11925:x1875409531665536:12345-192.168.202.41@tcp:101:bash.0 Request processed in 238us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530309.275493:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 209 00000100:00100000:3.0:1788530309.281473:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530309.281650:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531665664 00000100:00100000:2.0:1788530309.281670:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531665664 00000100:00100000:2.0:1788530309.281757:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 67 00000100:00100000:2.0:1788530309.281769:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+7:11925:x1875409531665664:12345-192.168.202.41@tcp:101:bash.0 00010000:00010000:2.0:1788530309.281789:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530309.281814:0:8438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea29484e/0xb28d70e125751344 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550b4a expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788530309.281843:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a9ace80, atime: 0x6a9ace7f, ctime: 0x6a9ace80, blocks: 0x8 00010000:00010000:2.0:1788530309.281882:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=517s v=(0 0) 00010000:00010000:2.0:1788530309.281887:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788530309.281897:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea29484e/0xb28d70e125751344 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b4a expref: 8 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530309.281919:0:8438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ea29484e/0xb28d70e125751344 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b4a expref: 8 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530309.281942:0:8438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d20d800, rc 0) 00000100:00100000:2.0:1788530309.282042:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+8:11925:x1875409531665664:12345-192.168.202.41@tcp:101:bash.0 Request processed in 274us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530309.282074:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 67 00000100:00080000:3.0:1788530309.282608:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788530309.286872:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530309.287026:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531665792 00000100:00100000:3.0:1788530309.287040:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531665792 00002000:00010000:3.0:1788530309.287099:0:8444:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:3.0:1788530309.287105:0:8444:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a9e03d3c700 with x1875409531665792 ext(0->18446744073709551615) 00002000:00010000:3.0:1788530309.287122:0:8444:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a9e03d3c700. 00000100:00100000:3.0:1788530309.287165:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 6 00000100:00100000:3.0:1788530309.287179:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+8:2402:x1875409531665792:12345-192.168.202.41@tcp:10:bash.0 00002000:00010000:3.0:1788530309.287548:0:8444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1788530309.287552:0:8444:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1788530304 -> 1788530308 00002000:00010000:3.0:1788530309.287616:0:8444:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 1788530303 -> 1788530303 00002000:00010000:3.0:1788530309.287619:0:8444:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1788530304 -> 1788530308 00002000:00010000:3.0:1788530309.287622:0:8444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:3.0:1788530309.287717:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+9:2402:x1875409531665792:12345-192.168.202.41@tcp:10:bash.0 Request processed in 537us (852us total) trans 4294967320 rc 0/0 00000100:00100000:3.0:1788530309.287728:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 6 00002000:00010000:3.0:1788530309.287733:0:8444:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:3.0:1788530309.287736:0:8444:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a9e03d3c700 with x1875409531665792 ext(0->18446744073709551615) 00002000:00010000:3.0:1788530309.287741:0:8444:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a9e03d3c700. 00010000:00010000:2.0:1788530309.316143:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788530309.364850:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530309.364969:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531665920 00000100:00100000:0.0:1788530309.364981:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531665920 00000100:00100000:0.0:1788530309.365077:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 210 00000100:00100000:0.0:1788530309.365095:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+35:12415:x1875409531665920:12345-192.168.202.41@tcp:34:lfs.0 00010000:00010000:0.0:1788530309.365208:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e12575134b lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.365235:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e12575134b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.365253:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e12575134b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.365276:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e125751352 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.365283:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e125751352 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.365289:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e125751352 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.365437:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100800/0xb28d70e125751359 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.365465:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100800/0xb28d70e125751359 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.365474:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100800/0xb28d70e125751359 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788530309.365541:0:6524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100800/0xb28d70e125751359 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.365557:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e12575134b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.365614:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e12575134b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.365622:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e12575134b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.365630:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d100c00 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:0.0:1788530309.365634:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e12575134b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.365642:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e12575134b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.365665:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a9f2b995b00) 00010000:00010000:0.0:1788530309.365669:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788530309.365675:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e12575134b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.365688:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e12575134b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.365707:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e125751352 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.365714:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e125751352 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.365721:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e125751352 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.365726:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d101800 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:0.0:1788530309.365729:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e125751352 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.365736:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e125751352 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.365745:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9a9e0241d000) 00010000:00010000:0.0:1788530309.365748:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788530309.365750:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e125751352 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.365757:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e125751352 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.365775:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100800/0xb28d70e125751359 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.365784:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100800/0xb28d70e125751359 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.365796:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100800/0xb28d70e125751359 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.365802:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d100800 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:0.0:1788530309.365805:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100800/0xb28d70e125751359 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.365811:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100800/0xb28d70e125751359 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.365819:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a9f0cf59500) 00010000:00010000:0.0:1788530309.365822:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788530309.365826:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100800/0xb28d70e125751359 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.365832:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100800/0xb28d70e125751359 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530309.365972:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+35:12415:x1875409531665920:12345-192.168.202.41@tcp:34:lfs.0 Request processed in 880us (1129us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530309.365982:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 210 00000100:00100000:2.0:1788530309.471985:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530309.472082:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531666176 00000100:00100000:0.0:1788530309.472093:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531666176 00000100:00100000:0.0:1788530309.472173:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 211 00000100:00100000:0.0:1788530309.472183:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37377b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+35:12418:x1875409531666176:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:0.0:1788530309.472205:0:8678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530309.472225:0:8678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100800/0xb28d70e125751360 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550b51 expref: -99 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.472334:0:8678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e125751367 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.472350:0:8678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e125751367 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.472361:0:8678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e125751367 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.472374:0:8678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e12575136e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.472380:0:8678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e12575136e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.472387:0:8678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e12575136e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.472513:0:8678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100000/0xb28d70e125751375 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.472523:0:8678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100000/0xb28d70e125751375 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.472529:0:8678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100000/0xb28d70e125751375 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788530309.472538:0:8678:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788530309.472648:0:8678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e125751367 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.472665:0:8678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e125751367 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.472678:0:8678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e125751367 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.472684:0:8678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d101800 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:0.0:1788530309.472688:0:8678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e125751367 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.472696:0:8678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e125751367 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.472707:0:8678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a9f2b995b00) 00010000:00010000:0.0:1788530309.472709:0:8678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788530309.472714:0:8678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e125751367 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.472720:0:8678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e125751367 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.472730:0:8678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e12575136e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.472736:0:8678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e12575136e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.472741:0:8678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e12575136e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.472745:0:8678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d100c00 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:0.0:1788530309.472747:0:8678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e12575136e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.472760:0:8678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e12575136e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.472767:0:8678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9a9e0241d000) 00010000:00010000:0.0:1788530309.472769:0:8678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788530309.472771:0:8678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e12575136e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.472776:0:8678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e12575136e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.472821:0:8678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100800/0xb28d70e125751360 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b51 expref: 38 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.472837:0:8678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100000/0xb28d70e125751375 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b51 expref: 37 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.472845:0:8678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a9f0cf59500) 00010000:00010000:0.0:1788530309.472847:0:8678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788530309.472849:0:8678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d100000, rc 0) 00000100:00100000:0.0:1788530309.472926:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37377b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+37:12418:x1875409531666176:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 743us (955us total) trans 4294967479 rc 0/0 00000100:00100000:0.0:1788530309.472934:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 211 00000100:00100000:2.0:1788530309.484033:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530309.484191:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531666304 00000100:00100000:3.0:1788530309.484205:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531666304 00000100:00100000:3.0:1788530309.484819:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 212 00000100:00100000:3.0:1788530309.484836:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37376a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+37:12418:x1875409531666304:12345-192.168.202.41@tcp:54:lfs.0 00010000:00010000:3.0:1788530309.484998:0:10720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b000/0xb28d70e125751383 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530309.485021:0:10720:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d600/0xb28d70e12575131a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b35 expref: 37 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530309.485033:0:10720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b000/0xb28d70e125751383 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530309.485080:0:10720:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d600/0xb28d70e12575131a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b35 expref: 37 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530309.485097:0:10720:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d600/0xb28d70e12575131a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b35 expref: 37 pid: 6523 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530309.485138:0:10720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d43800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:10720:1875409555854208:192.168.202.41@tcp:104: 00000100:00100000:3.0:1788530309.485329:0:10720:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f1019c600 going to sleep for 11 seconds 00000100:00100000:3.0:1788530309.489827:0:10720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d43800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:10720:1875409555854208:192.168.202.41@tcp:104: 00010000:00010000:3.0:1788530309.489866:0:10720:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b000/0xb28d70e125751383 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530309.494687:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530309.495044:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531666560 00000100:00100000:0.0:1788530309.495055:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531666560 00000100:00100000:0.0:1788530309.495121:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 52 00000100:00100000:0.0:1788530309.495133:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37374380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+38:6175:x1875409531666560:12345-192.168.202.41@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788530309.495417:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37374380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+39:6175:x1875409531666560:12345-192.168.202.41@tcp:35:ldlm_bl.0 Request processed in 285us (742us total) trans 4294967480 rc 0/0 00000100:00100000:0.0:1788530309.495425:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 52 00000100:00100000:1.0:1788530309.500913:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530309.501088:0:10347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531666688 00000100:00100000:2.0:1788530309.501106:0:10347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531666688 00010000:00010000:2.0:1788530309.501169:0:10347:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d600/0xb28d70e12575131a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b35 expref: 39 pid: 6523 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530309.501276:0:10347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 102 00000100:00100000:2.0:1788530309.501289:0:10347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+39:2399:x1875409531666688:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788530309.501306:0:10347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788530309.501313:0:10347:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d600/0xb28d70e12575131a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b35 expref: 39 pid: 6523 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530309.501327:0:10347:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d600/0xb28d70e12575131a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b35 expref: 39 pid: 6523 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530309.501351:0:10347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d600/0xb28d70e12575131a lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b35 expref: 39 pid: 6523 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530309.501388:0:10347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a9f0cf59500) 00010000:00010000:2.0:1788530309.501394:0:10347:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b000/0xb28d70e125751383 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530309.501404:0:10347:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b000/0xb28d70e125751383 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530309.501423:0:10347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b000/0xb28d70e125751383 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530309.501454:0:10347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788530309.501516:0:10347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+38:2399:x1875409531666688:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 229us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530309.501524:0:10347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 102 00010000:00010000:3.0:1788530309.501591:0:10720:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b000/0xb28d70e125751383 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530309.501611:0:10720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b000/0xb28d70e125751383 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530309.501668:0:10720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b000/0xb28d70e125751383 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530309.501676:0:10720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b000/0xb28d70e125751383 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530309.501683:0:10720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b000/0xb28d70e125751383 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530309.501995:0:10720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d36b000 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:3.0:1788530309.502002:0:10720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b000/0xb28d70e125751383 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530309.502011:0:10720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b000/0xb28d70e125751383 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530309.502022:0:10720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a9f0cf59500) 00010000:00010000:3.0:1788530309.502031:0:10720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788530309.502036:0:10720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b000/0xb28d70e125751383 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530309.502043:0:10720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b000/0xb28d70e125751383 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530309.502091:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37376a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+37:12418:x1875409531666304:12345-192.168.202.41@tcp:54:lfs.0 Request processed in 17260us (18071us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530309.502101:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 212 00000100:00100000:1.0:1788530309.510145:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530309.510313:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531666944 00000100:00100000:0.0:1788530309.510323:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531666944 00000100:00100000:0.0:1788530309.510967:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 53 00000100:00100000:0.0:1788530309.510980:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+37:12418:x1875409531666944:12345-192.168.202.41@tcp:35:lfs.0 00000100:00100000:0.0:1788530309.511210:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+38:12418:x1875409531666944:12345-192.168.202.41@tcp:35:lfs.0 Request processed in 233us (1076us total) trans 4294967481 rc 0/0 00000100:00100000:0.0:1788530309.511218:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 53 00000100:00100000:0.0:1788530309.641961:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530309.642056:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531667200 00000100:00100000:3.0:1788530309.642068:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531667200 00000100:00100000:3.0:1788530309.642144:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 213 00000100:00100000:3.0:1788530309.642154:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+38:12429:x1875409531667200:12345-192.168.202.41@tcp:101:cat.0 00010000:00010000:3.0:1788530309.642182:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788530309.642206:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b000/0xb28d70e12575138a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550b58 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530309.642284:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e125751391 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530309.642299:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e125751391 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530309.642310:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e125751391 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530309.642325:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b400/0xb28d70e125751398 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530309.642332:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b400/0xb28d70e125751398 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530309.642497:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b400/0xb28d70e125751398 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530309.643167:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d600/0xb28d70e12575139f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530309.643183:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d600/0xb28d70e12575139f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530309.643191:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d600/0xb28d70e12575139f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788530309.643203:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:2.0:1788530309.643297:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e125751391 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530309.643305:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e125751391 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530309.643312:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e125751391 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530309.643319:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d36b200 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:2.0:1788530309.643324:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e125751391 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530309.643332:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e125751391 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530309.643685:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a9f2b995b00) 00010000:00010000:2.0:1788530309.643689:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788530309.643695:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e125751391 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530309.643701:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e125751391 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530309.643716:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b400/0xb28d70e125751398 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530309.643721:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b400/0xb28d70e125751398 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530309.643727:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b400/0xb28d70e125751398 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530309.643731:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d36b400 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:2.0:1788530309.643734:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b400/0xb28d70e125751398 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530309.643741:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b400/0xb28d70e125751398 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530309.643749:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9a9f0cf59600) 00010000:00010000:2.0:1788530309.643751:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788530309.643754:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b400/0xb28d70e125751398 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530309.643760:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b400/0xb28d70e125751398 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530309.643845:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b000/0xb28d70e12575138a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b58 expref: 41 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530309.643866:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d600/0xb28d70e12575139f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b58 expref: 40 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530309.643874:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a9f0cf59500) 00010000:00010000:2.0:1788530309.643876:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788530309.643878:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d20d600, rc 0) 00000100:00100000:2.0:1788530309.644015:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+40:12429:x1875409531667200:12345-192.168.202.41@tcp:101:cat.0 Request processed in 1860us (2063us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1788530309.644043:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 213 00000100:00100000:1.0:1788530309.651263:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530309.651378:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531667456 00000100:00100000:2.0:1788530309.651389:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531667456 00000100:00100000:2.0:1788530309.651453:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 54 00000100:00100000:2.0:1788530309.651465:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+40:12429:x1875409531667456:12345-192.168.202.41@tcp:35:cat.0 00000100:00100000:2.0:1788530309.651987:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+41:12429:x1875409531667456:12345-192.168.202.41@tcp:35:cat.0 Request processed in 522us (731us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1788530309.652015:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 54 00000100:00100000:1.0:1788530309.689360:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530309.689851:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531667712 00000100:00100000:0.0:1788530309.689862:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531667712 00000100:00100000:0.0:1788530309.689955:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 214 00000100:00100000:0.0:1788530309.689966:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+41:12430:x1875409531667712:12345-192.168.202.41@tcp:36:rm.0 00010000:00010000:0.0:1788530309.690039:0:8678:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1788530309.690092:0:8678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36be00/0xb28d70e12575133d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b43 expref: 41 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.690123:0:8678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d600/0xb28d70e12575139f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b58 expref: 40 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.690137:0:8678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100000/0xb28d70e125751375 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b51 expref: 39 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.690149:0:8678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e12575132f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b3c expref: 38 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.690176:0:8678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a9f0cf59500) 00010000:00010000:0.0:1788530309.690183:0:8678:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788530309.690211:0:8678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e1257513ad lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.690225:0:8678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e1257513ad lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.690234:0:8678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e1257513ad lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.690248:0:8678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100400/0xb28d70e1257513b4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.690256:0:8678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100400/0xb28d70e1257513b4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.690263:0:8678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100400/0xb28d70e1257513b4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.690357:0:8678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101000/0xb28d70e1257513bb lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.690366:0:8678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101000/0xb28d70e1257513bb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.690383:0:8678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101000/0xb28d70e1257513bb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788530309.690751:0:8678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:0.0:1788530309.690762:0:8678:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 517593201115ns, next at 518593198585ns, rc = 0 00010000:00010000:0.0:1788530309.690824:0:8678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101a00/0xb28d70e1257513c2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.690835:0:8678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101a00/0xb28d70e1257513c2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.690843:0:8678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101a00/0xb28d70e1257513c2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.690850:0:8678:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101a00/0xb28d70e1257513c2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.690857:0:8678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101a00/0xb28d70e1257513c2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.690863:0:8678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101a00/0xb28d70e1257513c2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.690896:0:8678:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788530309.690916:0:8678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101000/0xb28d70e1257513bb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.690923:0:8678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101000/0xb28d70e1257513bb lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.690929:0:8678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101000/0xb28d70e1257513bb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.690936:0:8678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d101000 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:0.0:1788530309.690941:0:8678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101000/0xb28d70e1257513bb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.690950:0:8678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101000/0xb28d70e1257513bb lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.690970:0:8678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a9f0cf59500) 00010000:00010000:0.0:1788530309.690974:0:8678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788530309.690978:0:8678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101000/0xb28d70e1257513bb lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.690984:0:8678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101000/0xb28d70e1257513bb lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.691003:0:8678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e1257513ad lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.691009:0:8678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e1257513ad lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.691014:0:8678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e1257513ad lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.691019:0:8678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d101800 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:0.0:1788530309.691022:0:8678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e1257513ad lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.691028:0:8678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e1257513ad lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.691034:0:8678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a9f2b995b00) 00010000:00010000:0.0:1788530309.691036:0:8678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788530309.691039:0:8678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e1257513ad lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.691044:0:8678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e1257513ad lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788530309.691063:0:8678:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000010d36d67 reply state 000000002772559d transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100400/0xb28d70e1257513b4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.691073:0:8678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100400/0xb28d70e1257513b4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.691080:0:8678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9a9e0241d000) 00010000:00010000:0.0:1788530309.691082:0:8678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788530309.691085:0:8678:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788530309.691166:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+39:12430:x1875409531667712:12345-192.168.202.41@tcp:36:rm.0 Request processed in 1200us (1815us total) trans 4294967484 rc 0/0 00000100:00100000:0.0:1788530309.691174:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 214 00010000:00010000:3.0:1788530309.691659:0:10348:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788530309.691666:0:10348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101a00/0xb28d70e1257513c2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530309.691673:0:10348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d101a00 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:3.0:1788530309.691677:0:10348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101a00/0xb28d70e1257513c2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530309.691685:0:10348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101a00/0xb28d70e1257513c2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530309.691695:0:10348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a9f0cf59500) 00010000:00010000:3.0:1788530309.691697:0:10348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788530309.691700:0:10348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101a00/0xb28d70e1257513c2 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530309.691706:0:10348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101a00/0xb28d70e1257513c2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530309.691716:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530309.691718:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530309.691720:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788530309.757627:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530309.757737:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531667968 00000100:00100000:2.0:1788530309.757748:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531667968 00000100:00100000:2.0:1788530309.757820:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 215 00000100:00100000:2.0:1788530309.757831:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+39:12436:x1875409531667968:12345-192.168.202.41@tcp:101:bash.0 00010000:00010000:2.0:1788530309.757856:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530309.757876:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20cc00/0xb28d70e1257513c9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550b5f expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530309.758004:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20dc00/0xb28d70e1257513d0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530309.758020:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20dc00/0xb28d70e1257513d0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530309.758032:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20dc00/0xb28d70e1257513d0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530309.758043:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c800/0xb28d70e1257513d7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530309.758050:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c800/0xb28d70e1257513d7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530309.758057:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c800/0xb28d70e1257513d7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788530309.758703:0:6523:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:2.0:1788530309.758853:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d400/0xb28d70e1257513de lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530309.758864:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d400/0xb28d70e1257513de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530309.758872:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d400/0xb28d70e1257513de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530309.758903:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20dc00/0xb28d70e1257513d0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530309.759022:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20dc00/0xb28d70e1257513d0 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530309.759028:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20dc00/0xb28d70e1257513d0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530309.759034:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d20dc00 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:2.0:1788530309.759038:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20dc00/0xb28d70e1257513d0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530309.759045:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20dc00/0xb28d70e1257513d0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530309.759058:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a9f2b995b00) 00010000:00010000:2.0:1788530309.759060:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788530309.759065:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20dc00/0xb28d70e1257513d0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530309.759070:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20dc00/0xb28d70e1257513d0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788530309.759083:0:6523:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000060ab9e09 reply state 00000000ab3dbc71 transno 4294967485 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c800/0xb28d70e1257513d7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530309.759094:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c800/0xb28d70e1257513d7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530309.759100:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9a9e0241d000) 00010000:00010000:2.0:1788530309.759103:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788530309.759106:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788530309.759134:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20cc00/0xb28d70e1257513c9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b5f expref: 42 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530309.759157:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d400/0xb28d70e1257513de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b5f expref: 41 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530309.759166:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a9f2b995a00) 00010000:00010000:2.0:1788530309.759168:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788530309.759170:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d20d400, rc 0) 00000100:00100000:2.0:1788530309.759237:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+42:12436:x1875409531667968:12345-192.168.202.41@tcp:101:bash.0 Request processed in 1407us (1618us total) trans 4294967485 rc 0/0 00000100:00100000:2.0:1788530309.760102:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 215 00000100:00100000:0.0:1788530309.763151:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530309.763664:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531668096 00000100:00100000:2.0:1788530309.763676:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531668096 00000100:00100000:2.0:1788530309.763771:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 68 00000100:00100000:2.0:1788530309.763783:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+7:2400:x1875409531668096:12345-192.168.202.41@tcp:101:bash.0 00010000:00010000:2.0:1788530309.763804:0:8439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530309.763829:0:8439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000038101456/0xb28d70e1257513ec lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550b66 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788530309.763857:0:8439:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788530309.763882:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=517s v=(0 0) 00010000:00010000:2.0:1788530309.763887:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788530309.763898:0:8439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000038101456/0xb28d70e1257513ec lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b66 expref: 8 pid: 8439 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530309.763928:0:8439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000038101456/0xb28d70e1257513ec lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b66 expref: 8 pid: 8439 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530309.763971:0:8439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d20d600, rc 0) 00000100:00100000:2.0:1788530309.764052:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+8:2400:x1875409531668096:12345-192.168.202.41@tcp:101:bash.0 Request processed in 271us (915us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530309.764059:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 68 00000100:00080000:3.0:1788530309.764199:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788530309.767799:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530309.767900:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531668224 00000100:00100000:2.0:1788530309.767913:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531668224 00000100:00100000:2.0:1788530309.767980:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 69 00000100:00100000:2.0:1788530309.767991:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+8:12436:x1875409531668224:12345-192.168.202.41@tcp:101:bash.0 00010000:00010000:2.0:1788530309.768008:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530309.768025:0:8438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e2d8757/0xb28d70e1257513f3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550b6d expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530309.768056:0:8438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000038101456/0xb28d70e1257513ec lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b66 expref: 9 pid: 8439 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530309.768064:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788530309.768068:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788530309.768072:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e2d8757/0xb28d70e1257513f3 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b6d expref: 9 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530309.768110:0:8438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000038101456/0xb28d70e1257513ec lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b66 expref: 9 pid: 8439 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530309.768125:0:8438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000038101456/0xb28d70e1257513ec lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b66 expref: 9 pid: 8439 timeout: 617 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530309.768145:0:8438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37375180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8438:1875409555854336:192.168.202.41@tcp:104: 00000100:00100000:2.0:1788530309.768233:0:8438:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f33e24780 going to sleep for 11 seconds 00000100:00100000:1.0:1788530309.772145:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530309.772280:0:8438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37375180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8438:1875409555854336:192.168.202.41@tcp:104: 00010000:00010000:2.0:1788530309.772329:0:8438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000e2d8757/0xb28d70e1257513f3 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b6d expref: 9 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530309.772371:0:8438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d20da00, rc 0) 00000100:00100000:2.0:1788530309.772458:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+9:12436:x1875409531668224:12345-192.168.202.41@tcp:101:bash.0 Request processed in 4467us (4671us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530309.772468:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 69 00000100:00100000:3.0:1788530309.772990:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531668352 00000100:00100000:3.0:1788530309.772997:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531668352 00010000:00010000:3.0:1788530309.773040:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000038101456/0xb28d70e1257513ec lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b66 expref: 9 pid: 8439 timeout: 617 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530309.773097:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 103 00000100:00100000:3.0:1788530309.773107:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2a1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+9:2400:x1875409531668352:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788530309.773123:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788530309.773157:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000038101456/0xb28d70e1257513ec lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b66 expref: 9 pid: 8439 timeout: 617 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530309.773171:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000038101456/0xb28d70e1257513ec lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b66 expref: 9 pid: 8439 timeout: 617 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530309.773197:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000038101456/0xb28d70e1257513ec lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b66 expref: 9 pid: 8439 timeout: 617 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530309.773215:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788530309.773219:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788530309.773228:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000e2d8757/0xb28d70e1257513f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b6d expref: 8 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530309.773239:0:6508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e2d8757/0xb28d70e1257513f3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b6d expref: 8 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530309.773285:0:6508:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000000e2d8757/0xb28d70e1257513f3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b6d expref: 8 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530309.773302:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d43800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6508:1875409555854464:192.168.202.41@tcp:105: 00000100:00100000:3.0:1788530309.773860:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f1019c600 going to sleep for 11 seconds 00000100:00100000:3.0:1788530309.777059:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d43800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6508:1875409555854464:192.168.202.41@tcp:105: 00010000:00010000:3.0:1788530309.777087:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788530309.777141:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2a1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+8:2400:x1875409531668352:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 4035us (5006us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530309.777152:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 103 00000100:00100000:1.0:1788530309.781212:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530309.781506:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531668608 00000100:00100000:2.0:1788530309.781517:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531668608 00000100:00100000:2.0:1788530309.781676:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 55 00000100:00100000:2.0:1788530309.781688:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+42:12436:x1875409531668608:12345-192.168.202.41@tcp:35:bash.0 00000100:00100000:2.0:1788530309.782059:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+43:12436:x1875409531668608:12345-192.168.202.41@tcp:35:bash.0 Request processed in 372us (863us total) trans 4294967486 rc 0/0 00000100:00100000:2.0:1788530309.782067:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 55 00000100:00100000:1.0:1788530309.941516:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530309.942039:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531668736 00000100:00100000:0.0:1788530309.942054:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531668736 00000100:00100000:0.0:1788530309.942211:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 216 00000100:00100000:0.0:1788530309.942223:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+43:12452:x1875409531668736:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:0.0:1788530309.942264:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530309.942289:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e1257513fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550b74 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.942615:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101000/0xb28d70e125751401 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.942632:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101000/0xb28d70e125751401 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.942644:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101000/0xb28d70e125751401 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788530309.942716:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1788530309.942721:0:6524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788530309.942745:0:6524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101000/0xb28d70e125751401 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.942773:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e1257513fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b74 expref: 45 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.942794:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101000/0xb28d70e125751401 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b74 expref: 44 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.942804:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a9f2b995b00) 00010000:00010000:0.0:1788530309.942808:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788530309.942812:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d101000, rc 0) 00000100:00100000:0.0:1788530309.942895:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+44:12452:x1875409531668736:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 675us (1397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530309.942903:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 216 00000100:00100000:1.0:1788530309.948876:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530309.948975:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531668992 00000100:00100000:2.0:1788530309.948987:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531668992 00000100:00100000:2.0:1788530309.949070:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 217 00000100:00100000:2.0:1788530309.949082:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+44:12452:x1875409531668992:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:2.0:1788530309.949109:0:8678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530309.949135:0:8678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20cc00/0xb28d70e125751408 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550b7b expref: -99 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530309.949288:0:8678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20dc00/0xb28d70e12575140f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530309.949305:0:8678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20dc00/0xb28d70e12575140f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530309.949320:0:8678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20dc00/0xb28d70e12575140f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788530309.949331:0:8678:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788530309.949870:0:8678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20cc00/0xb28d70e125751408 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b7b expref: 47 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530309.949894:0:8678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20dc00/0xb28d70e12575140f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b7b expref: 46 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530309.949905:0:8678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a9f2b995a00) 00010000:00010000:2.0:1788530309.949908:0:8678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788530309.949913:0:8678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d20dc00, rc 0) 00000100:00100000:2.0:1788530309.949997:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+46:12452:x1875409531668992:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 917us (1130us total) trans 4294967487 rc 0/0 00000100:00100000:2.0:1788530309.950005:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 217 00000100:00100000:1.0:1788530309.953899:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530309.954002:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531669248 00000100:00100000:3.0:1788530309.954020:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531669248 00000100:00100000:3.0:1788530309.954145:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 218 00000100:00100000:3.0:1788530309.954160:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f05f47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+46:12452:x1875409531669248:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:3.0:1788530309.954201:0:10720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788530309.954233:0:10720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e12575141d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550b82 expref: -99 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530309.954394:0:10720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36be00/0xb28d70e125751424 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530309.954917:0:10720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36be00/0xb28d70e125751424 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530309.954934:0:10720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36be00/0xb28d70e125751424 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788530309.954949:0:10720:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788530309.955503:0:10720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e12575141d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b82 expref: 49 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530309.955524:0:10720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36be00/0xb28d70e125751424 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b82 expref: 48 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530309.955583:0:10720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a9f2b995a00) 00010000:00010000:3.0:1788530309.955587:0:10720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788530309.955591:0:10720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d36be00, rc 0) 00000100:00100000:3.0:1788530309.959952:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f05f47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+48:12452:x1875409531669248:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 5776us (6048us total) trans 4294967488 rc 0/0 00000100:00100000:3.0:1788530309.959979:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 218 00000100:00100000:1.0:1788530309.960325:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530309.960598:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531669376 00000100:00100000:2.0:1788530309.960608:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531669376 00000100:00100000:2.0:1788530309.960678:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 13 00000100:00100000:2.0:1788530309.960699:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f05f45880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+48:2401:x1875409531669376:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788530309.960714:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788530309.960751:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20dc00/0xb28d70e12575140f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b7b expref: 48 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530309.960770:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a9f2b995a00) 00010000:00010000:2.0:1788530309.960776:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788530309.960835:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f05f45880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+47:2401:x1875409531669376:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 147us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530309.960842:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 13 00000100:00100000:0.0:1788530309.973763:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530309.974120:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531669504 00000100:00100000:2.0:1788530309.974136:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531669504 00000100:00100000:2.0:1788530309.974213:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 70 00000100:00100000:2.0:1788530309.974225:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+8:2402:x1875409531669504:12345-192.168.202.41@tcp:1:lfs.0 00010000:00010000:2.0:1788530309.974298:0:8439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000947541ff/0xb28d70e125751432 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530309.974325:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000e2d8757/0xb28d70e1257513f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b6d expref: 8 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530309.974333:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788530309.974337:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788530309.974342:0:8439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000947541ff/0xb28d70e125751432 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530309.974398:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000e2d8757/0xb28d70e1257513f3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b6d expref: 8 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530309.974414:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000e2d8757/0xb28d70e1257513f3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b6d expref: 8 pid: 8438 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530309.974459:0:8439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37375180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8439:1875409555854592:192.168.202.41@tcp:104: 00000100:00100000:2.0:1788530309.974618:0:8439:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f33e246c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788530309.977436:0:8439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37375180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8439:1875409555854592:192.168.202.41@tcp:104: 00010000:00010000:2.0:1788530309.977481:0:8439:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000947541ff/0xb28d70e125751432 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530309.979903:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530309.979992:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531669632 00000100:00100000:2.0:1788530309.980006:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531669632 00002000:00100000:2.0:1788530309.980087:0:8443:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff9a9e03d3dc00 x1875409531669632/t0(0) o4->aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41@192.168.202.41@tcp:250/0 lens 504/0 e 0 to 0 dl 1788530320 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788530309.980100:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a9e03d3dc00 with x1875409531669632 ext(0->8) 00010000:00010000:2.0:1788530309.980112:0:8443:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000000e2d8757/0xb28d70e1257513f3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b6d expref: 9 pid: 8438 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530309.980132:0:8443:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000000e2d8757/0xb28d70e1257513f3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b6d expref: 9 pid: 8438 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788530309.980140:0:8443:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9a9e03d3dc00 00000100:00100000:2.0:1788530309.980233:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 3 00000100:00100000:2.0:1788530309.980256:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+9:2400:x1875409531669632:12345-192.168.202.41@tcp:4:lfs.0 00000001:00080000:1.0:1788530309.984670:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:1.0:1788530309.984689:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:2.0:1788530309.987393:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+7:2400:x1875409531669632:12345-192.168.202.41@tcp:4:lfs.0 Request processed in 7136us (7491us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788530309.987410:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 3 00002000:00100000:2.0:1788530309.987443:0:8443:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff9a9e03d3dc00 x1875409531669632/t4294967309(0) o4->aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41@192.168.202.41@tcp:250/0 lens 504/448 e 0 to 0 dl 1788530320 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788530309.987455:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a9e03d3dc00 with x1875409531669632 ext(0->8) 00010000:00010000:2.0:1788530309.987466:0:8443:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000000e2d8757/0xb28d70e1257513f3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b6d expref: 7 pid: 8438 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530309.987490:0:8443:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000000e2d8757/0xb28d70e1257513f3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b6d expref: 7 pid: 8438 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788530309.987499:0:8443:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9a9e03d3dc00 00000100:00100000:1.0:1788530309.994593:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530309.995534:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531669760 00000100:00100000:0.0:1788530309.995550:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531669760 00010000:00010000:0.0:1788530309.995870:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000e2d8757/0xb28d70e1257513f3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b6d expref: 7 pid: 8438 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530309.996143:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 104 00000100:00100000:0.0:1788530309.996155:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f396c0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+7:2402:x1875409531669760:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788530309.996175:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788530309.996218:0:6509:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788530309.996221:0:6509:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1788530309 00002000:00010000:0.0:1788530309.996224:0:6509:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1788530309 00002000:00010000:0.0:1788530309.996226:0:6509:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1788530309 00002000:00010000:0.0:1788530309.996229:0:6509:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1788530309.996236:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000e2d8757/0xb28d70e1257513f3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b6d expref: 7 pid: 8438 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.996272:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000e2d8757/0xb28d70e1257513f3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b6d expref: 7 pid: 8438 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.996303:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e2d8757/0xb28d70e1257513f3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b6d expref: 7 pid: 8438 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.996326:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788530309.996332:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788530309.996349:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000947541ff/0xb28d70e125751432 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.996360:0:6509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000947541ff/0xb28d70e125751432 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530309.996404:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788530309.996470:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f396c0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+6:2402:x1875409531669760:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 317us (1908us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530309.996479:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 104 00010000:00010000:2.0:1788530309.996840:0:8439:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000947541ff/0xb28d70e125751432 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530309.996851:0:8439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000947541ff/0xb28d70e125751432 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530309.996873:0:8439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000947541ff/0xb28d70e125751432 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530309.996882:0:8439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000947541ff/0xb28d70e125751432 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530309.996891:0:8439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000947541ff/0xb28d70e125751432 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530309.996899:0:8439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d20dc00 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:2.0:1788530309.996912:0:8439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000947541ff/0xb28d70e125751432 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530309.996929:0:8439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000947541ff/0xb28d70e125751432 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530309.996944:0:8439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000947541ff/0xb28d70e125751432 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530309.996952:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000947541ff/0xb28d70e125751432 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530309.997023:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2402:x1875409531669504:12345-192.168.202.41@tcp:1:lfs.0 Request processed in 22799us (23460us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530309.997032:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 70 00000100:00100000:1.0:1788530310.007848:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530310.007961:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531670016 00000100:00100000:0.0:1788530310.007988:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531670016 00000100:00100000:0.0:1788530310.008229:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 56 00000100:00100000:0.0:1788530310.008244:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f39599850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+47:12452:x1875409531670016:12345-192.168.202.41@tcp:35:lfs.0 00000004:00010000:0.0:1788530310.008348:0:6527:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36be00/0xb28d70e125751424 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b82 expref: 47 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788530310.008676:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:0.0:1788530310.008814:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000001:00080000:0.0:1788530310.010203:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00010000:00010000:0.0:1788530310.010271:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e125751439 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530310.010296:0:6527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d400/0xb28d70e1257513de lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b5f expref: 51 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530310.010305:0:6527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e125751439 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530310.010351:0:6527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d400/0xb28d70e1257513de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b5f expref: 51 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530310.010369:0:6527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d400/0xb28d70e1257513de lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b5f expref: 51 pid: 6523 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530310.010401:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d3ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6527:1875409555854720:192.168.202.41@tcp:104: 00000100:00100000:0.0:1788530310.010511:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f18143b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788530310.016628:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d3ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6527:1875409555854720:192.168.202.41@tcp:104: 00010000:00010000:3.0:1788530310.016673:0:6527:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e125751439 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530310.022675:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530310.024842:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531670144 00000100:00100000:2.0:1788530310.024863:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531670144 00010000:00010000:2.0:1788530310.024951:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d400/0xb28d70e1257513de lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b5f expref: 52 pid: 6523 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530310.025004:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 105 00000100:00100000:2.0:1788530310.025016:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f05f44a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+52:2400:x1875409531670144:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788530310.025034:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788530310.025042:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d400/0xb28d70e1257513de lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b5f expref: 52 pid: 6523 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530310.025058:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d400/0xb28d70e1257513de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b5f expref: 52 pid: 6523 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530310.025117:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d400/0xb28d70e1257513de lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b5f expref: 52 pid: 6523 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530310.025142:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a9f2b995a00) 00010000:00010000:2.0:1788530310.025149:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e125751439 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530310.025161:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e125751439 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530310.025172:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e125751439 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530310.025222:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788530310.025546:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f05f44a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+51:2400:x1875409531670144:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 530us (2894us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530310.025555:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 105 00010000:00010000:1.0:1788530310.026535:0:6527:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e125751439 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530310.026550:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e125751439 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788530310.026748:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000001:00080000:1.0:1788530310.026932:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:1.0:1788530310.027093:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f05f46300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6527:1875409555854848:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788530310.027198:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530310.028638:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f06a253c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788530310.036539:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555854848 00000100:00100000:0.0:1788530310.036581:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555854848 00000100:00100000:0.0:1788530310.036670:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1788530310.036711:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f05f44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6527:x1875409555854848:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788530310.036905:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f05f44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6527:x1875409555854848:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 201us (9706us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530310.036913:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1788530310.037154:0:6527:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967308 gen 2 00000004:00080000:1.0:1788530310.037164:0:6527:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967308 00000004:00080000:1.0:1788530310.037194:0:6527:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a9e03ee3b80, transno 4294967308 00000100:00100000:1.0:1788530310.037217:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f05f46300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6527:1875409555854848:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788530310.037432:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00000100:00100000:1.0:1788530310.037529:0:6527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f05f46300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6527:1875409555854976:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788530310.037615:0:6527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530310.037659:0:6527:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f08cd5540 going to sleep for 11 seconds 00000100:00100000:1.0:1788530310.037679:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555854976 00000100:00100000:1.0:1788530310.037960:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555854976 00000100:00100000:1.0:1788530310.038004:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1788530310.038013:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f05f47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6527:x1875409555854976:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788530310.038181:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f05f47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6527:x1875409555854976:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 168us (565us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1788530310.038189:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1788530310.038233:0:6527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f05f46300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6527:1875409555854976:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788530310.038311:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:1.0:1788530310.040580:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e125751439 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530310.040603:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e125751439 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530310.040613:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e125751439 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530310.040619:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d101800 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:1.0:1788530310.040624:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e125751439 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530310.040633:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e125751439 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530310.040661:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a9f2b995a00) 00010000:00010000:1.0:1788530310.040664:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788530310.040902:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e125751439 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530310.040909:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101800/0xb28d70e125751439 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788530310.041210:0:6527:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788530310.041301:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:1.0:1788530310.041315:0:6527:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 517943753610ns, next at 518943751001ns, rc = 0 00000001:00080000:1.0:1788530310.041326:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967496 00010000:00010000:1.0:1788530310.041395:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a9f2b995a00) 00010000:00010000:1.0:1788530310.041399:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788530310.041408:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36be00/0xb28d70e125751424 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b82 expref: 55 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530310.044020:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f39599850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+54:12452:x1875409531670016:12345-192.168.202.41@tcp:35:lfs.0 Request processed in 35760us (36314us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1788530310.044038:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 56 00000020:00080000:1.0:1788530310.044048:0:6527:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:3.0:1788530310.044529:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788530310.061113:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530310.061794:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531670272 00000100:00100000:2.0:1788530310.061806:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531670272 00000100:00100000:2.0:1788530310.061885:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 219 00000100:00100000:2.0:1788530310.061896:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f05f46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+54:12452:x1875409531670272:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:2.0:1788530310.061935:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530310.061964:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d400/0xb28d70e125751440 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550b89 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530310.062031:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d400/0xb28d70e125751440 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b89 expref: 55 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530310.062068:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d400/0xb28d70e125751440 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b89 expref: 55 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530310.062089:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a9f2b995800) 00010000:00010000:2.0:1788530310.062092:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788530310.062096:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d20d400, rc 0) 00000100:00100000:2.0:1788530310.062163:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f05f46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+55:12452:x1875409531670272:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 269us (1068us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530310.062171:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 219 00000100:00100000:2.0:1788530310.068872:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530310.069212:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531670528 00000100:00100000:3.0:1788530310.069234:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531670528 00000100:00100000:3.0:1788530310.069475:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 57 00000100:00100000:3.0:1788530310.069490:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37375180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+55:12452:x1875409531670528:12345-192.168.202.41@tcp:35:lfs.0 00000100:00100000:3.0:1788530310.069815:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37375180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+56:12452:x1875409531670528:12345-192.168.202.41@tcp:35:lfs.0 Request processed in 329us (959us total) trans 4294967498 rc 0/0 00000100:00100000:3.0:1788530310.069824:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 57 00000100:00100000:2.0:1788530310.169502:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530310.170056:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531670656 00000100:00100000:1.0:1788530310.170072:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531670656 00000100:00100000:1.0:1788530310.170167:0:10719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 220 00000100:00100000:1.0:1788530310.170178:0:10719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37374a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+56:12462:x1875409531670656:12345-192.168.202.41@tcp:34:lfs.0 00010000:00010000:1.0:1788530310.170297:0:10719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb200/0xb28d70e125751447 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530310.170316:0:10719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb200/0xb28d70e125751447 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530310.170508:0:10719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb200/0xb28d70e125751447 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530310.170520:0:10719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea600/0xb28d70e12575144e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530310.170526:0:10719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea600/0xb28d70e12575144e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530310.170531:0:10719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea600/0xb28d70e12575144e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530310.170792:0:10719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eaa00/0xb28d70e125751455 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530310.170802:0:10719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eaa00/0xb28d70e125751455 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530310.170808:0:10719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eaa00/0xb28d70e125751455 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788530310.170881:0:10719:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eaa00/0xb28d70e125751455 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530310.170896:0:10719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb200/0xb28d70e125751447 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530310.170905:0:10719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb200/0xb28d70e125751447 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530310.170913:0:10719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb200/0xb28d70e125751447 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530310.170932:0:10719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f012eb200 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:1.0:1788530310.170939:0:10719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb200/0xb28d70e125751447 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530310.170948:0:10719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb200/0xb28d70e125751447 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530310.170966:0:10719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a9f2b995b00) 00010000:00010000:1.0:1788530310.170969:0:10719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788530310.170975:0:10719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb200/0xb28d70e125751447 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530310.170982:0:10719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb200/0xb28d70e125751447 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530310.170996:0:10719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea600/0xb28d70e12575144e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530310.171000:0:10719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea600/0xb28d70e12575144e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530310.171004:0:10719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea600/0xb28d70e12575144e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530310.171007:0:10719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f012ea600 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:1.0:1788530310.171008:0:10719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea600/0xb28d70e12575144e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530310.171012:0:10719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea600/0xb28d70e12575144e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530310.171024:0:10719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9a9e0241d000) 00010000:00010000:1.0:1788530310.171026:0:10719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788530310.171029:0:10719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea600/0xb28d70e12575144e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530310.171032:0:10719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea600/0xb28d70e12575144e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530310.171040:0:10719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eaa00/0xb28d70e125751455 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530310.171045:0:10719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eaa00/0xb28d70e125751455 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530310.171051:0:10719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eaa00/0xb28d70e125751455 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530310.171056:0:10719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f012eaa00 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:1.0:1788530310.171059:0:10719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eaa00/0xb28d70e125751455 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530310.171064:0:10719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eaa00/0xb28d70e125751455 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530310.171070:0:10719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a9f2b995800) 00010000:00010000:1.0:1788530310.171072:0:10719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788530310.171074:0:10719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eaa00/0xb28d70e125751455 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530310.171080:0:10719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eaa00/0xb28d70e125751455 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530310.171213:0:10719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37374a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+56:12462:x1875409531670656:12345-192.168.202.41@tcp:34:lfs.0 Request processed in 1034us (1720us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530310.171221:0:10719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 220 00000100:00100000:0.0:1788530310.214231:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530310.214436:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531670912 00000100:00100000:2.0:1788530310.214450:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531670912 00000100:00100000:3.0:1788530310.214590:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 221 00000100:00100000:3.0:1788530310.214774:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+56:12465:x1875409531670912:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:3.0:1788530310.214805:0:10720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788530310.214831:0:10720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e12575145c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550b90 expref: -99 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530310.214995:0:10720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b000/0xb28d70e125751463 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530310.215013:0:10720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b000/0xb28d70e125751463 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530310.215027:0:10720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b000/0xb28d70e125751463 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530310.215040:0:10720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b400/0xb28d70e12575146a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530310.215048:0:10720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b400/0xb28d70e12575146a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530310.215055:0:10720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b400/0xb28d70e12575146a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530310.215179:0:10720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e125751471 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530310.215189:0:10720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e125751471 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530310.215196:0:10720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e125751471 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788530310.215206:0:10720:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788530310.215280:0:10720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b000/0xb28d70e125751463 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530310.215297:0:10720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b000/0xb28d70e125751463 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530310.215304:0:10720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b000/0xb28d70e125751463 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530310.215310:0:10720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d36b000 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:3.0:1788530310.215315:0:10720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b000/0xb28d70e125751463 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530310.215322:0:10720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b000/0xb28d70e125751463 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530310.215333:0:10720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a9f2b995b00) 00010000:00010000:3.0:1788530310.215337:0:10720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788530310.215341:0:10720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b000/0xb28d70e125751463 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530310.215347:0:10720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b000/0xb28d70e125751463 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530310.215361:0:10720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b400/0xb28d70e12575146a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530310.215367:0:10720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b400/0xb28d70e12575146a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530310.215496:0:10720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b400/0xb28d70e12575146a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530310.215502:0:10720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d36b400 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:3.0:1788530310.215510:0:10720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b400/0xb28d70e12575146a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530310.215517:0:10720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b400/0xb28d70e12575146a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530310.215526:0:10720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9a9e0241d000) 00010000:00010000:3.0:1788530310.215529:0:10720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788530310.215532:0:10720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b400/0xb28d70e12575146a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530310.215538:0:10720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b400/0xb28d70e12575146a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530310.215777:0:10720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e12575145c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b90 expref: 59 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530310.215793:0:10720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e125751471 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b90 expref: 58 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530310.215801:0:10720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a9f2b995800) 00010000:00010000:3.0:1788530310.215803:0:10720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788530310.215806:0:10720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d36b200, rc 0) 00000100:00100000:3.0:1788530310.215871:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+58:12465:x1875409531670912:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 1271us (1649us total) trans 4294967499 rc 0/0 00000100:00100000:3.0:1788530310.215879:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 221 00000100:00100000:3.0:1788530310.220015:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530310.220128:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531671040 00000100:00100000:2.0:1788530310.220139:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531671040 00000100:00100000:2.0:1788530310.220204:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 222 00000100:00100000:2.0:1788530310.220213:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+58:12465:x1875409531671040:12345-192.168.202.41@tcp:54:lfs.0 00010000:00010000:2.0:1788530310.220443:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d000/0xb28d70e12575147f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530310.220461:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d000/0xb28d70e12575147f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530310.220472:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d000/0xb28d70e12575147f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530310.220504:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d000/0xb28d70e12575147f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530310.220521:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d000/0xb28d70e12575147f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530310.220526:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d000/0xb28d70e12575147f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530310.220530:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d20d000 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:2.0:1788530310.220533:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d000/0xb28d70e12575147f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530310.220547:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d000/0xb28d70e12575147f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530310.220557:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a9f2b995800) 00010000:00010000:2.0:1788530310.220599:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788530310.220604:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d000/0xb28d70e12575147f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530310.220611:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d000/0xb28d70e12575147f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530310.220880:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+58:12465:x1875409531671040:12345-192.168.202.41@tcp:54:lfs.0 Request processed in 666us (870us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530310.220889:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 222 00000100:00100000:2.0:1788530310.223362:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530310.223455:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531671296 00000100:00100000:1.0:1788530310.223473:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531671296 00000100:00100000:1.0:1788530310.223548:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 58 00000100:00100000:1.0:1788530310.223591:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37376680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+58:12465:x1875409531671296:12345-192.168.202.41@tcp:35:lfs.0 00000100:00100000:1.0:1788530310.224049:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37376680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+59:12465:x1875409531671296:12345-192.168.202.41@tcp:35:lfs.0 Request processed in 488us (700us total) trans 4294967500 rc 0/0 00000100:00100000:1.0:1788530310.224057:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 58 00000100:00100000:0.0:1788530310.268015:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530310.268091:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531671552 00000100:00100000:2.0:1788530310.268103:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531671552 00000100:00100000:2.0:1788530310.268263:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 223 00000100:00100000:2.0:1788530310.268278:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+59:12475:x1875409531671552:12345-192.168.202.41@tcp:101:bash.0 00010000:00010000:2.0:1788530310.268339:0:8678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530310.268344:0:8678:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788530310.268402:0:8678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101000/0xb28d70e125751401 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b74 expref: 59 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530310.268430:0:8678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a9f2b995b00) 00010000:00010000:2.0:1788530310.268437:0:8678:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788530310.268459:0:8678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d000/0xb28d70e125751486 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550b97 expref: -99 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530310.268848:0:8678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e12575148d lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530310.268866:0:8678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e125751471 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b90 expref: 59 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530310.268875:0:8678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e12575148d lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530310.268915:0:8678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e125751471 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b90 expref: 59 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530310.268932:0:8678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e125751471 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b90 expref: 59 pid: 10720 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530310.268950:0:8678:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37374380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8678:1875409555855104:192.168.202.41@tcp:104: 00000100:00100000:2.0:1788530310.269192:0:8678:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f33e246c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788530310.272862:0:8678:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37374380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8678:1875409555855104:192.168.202.41@tcp:104: 00010000:00010000:2.0:1788530310.272928:0:8678:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e12575148d lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530310.276481:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530310.276815:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531671680 00000100:00100000:3.0:1788530310.276826:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531671680 00010000:00010000:3.0:1788530310.276866:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e125751471 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b90 expref: 60 pid: 10720 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530310.276920:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 106 00000100:00100000:3.0:1788530310.276929:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d3c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+60:2400:x1875409531671680:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788530310.276943:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788530310.276950:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e125751471 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b90 expref: 60 pid: 10720 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530310.276964:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e125751471 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b90 expref: 60 pid: 10720 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530310.276985:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e125751471 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b90 expref: 60 pid: 10720 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530310.277000:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a9f2b995800) 00010000:00010000:3.0:1788530310.277005:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e12575148d lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530310.277014:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e12575148d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530310.277022:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e12575148d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530310.277052:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788530310.277109:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d3c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+59:2400:x1875409531671680:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 181us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530310.277117:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 106 00010000:00010000:2.0:1788530310.278766:0:8678:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e12575148d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530310.278784:0:8678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e12575148d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788530310.278807:0:8678:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788530310.278982:0:8678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d000/0xb28d70e125751486 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b97 expref: 60 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530310.278999:0:8678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e12575148d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b97 expref: 59 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530310.279006:0:8678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a9f2b995800) 00010000:00010000:2.0:1788530310.279008:0:8678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788530310.279011:0:8678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d20c000, rc 0) 00000100:00100000:2.0:1788530310.279082:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+59:12475:x1875409531671552:12345-192.168.202.41@tcp:101:bash.0 Request processed in 10808us (11081us total) trans 4294967501 rc 0/0 00000100:00100000:2.0:1788530310.279093:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 223 00000100:00100000:0.0:1788530310.281233:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530310.281394:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531671808 00000100:00100000:2.0:1788530310.281410:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531671808 00000100:00100000:2.0:1788530310.281510:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 224 00000100:00100000:2.0:1788530310.281520:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+59:12475:x1875409531671808:12345-192.168.202.41@tcp:101:bash.0 00010000:00010000:2.0:1788530310.281551:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530310.281598:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d200/0xb28d70e12575149b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550b9e expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530310.281645:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ca00/0xb28d70e1257514a2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530310.281670:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ca00/0xb28d70e1257514a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530310.281687:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ca00/0xb28d70e1257514a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530310.281822:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d200/0xb28d70e12575149b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b9e expref: 61 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530310.281843:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ca00/0xb28d70e1257514a2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b9e expref: 60 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530310.281853:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a9f2b995800) 00010000:00010000:2.0:1788530310.281856:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788530310.281860:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d20ca00, rc 0) 00000100:00100000:2.0:1788530310.281936:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+60:12475:x1875409531671808:12345-192.168.202.41@tcp:101:bash.0 Request processed in 417us (721us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530310.281944:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 224 00000100:00100000:3.0:1788530310.288169:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530310.289205:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531672064 00000100:00100000:0.0:1788530310.289222:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531672064 00000100:00100000:0.0:1788530310.289326:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 225 00000100:00100000:0.0:1788530310.289338:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+60:12475:x1875409531672064:12345-192.168.202.41@tcp:36:bash.0 00010000:00010000:0.0:1788530310.289638:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101a00/0xb28d70e1257514a9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530310.289670:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101a00/0xb28d70e1257514a9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530310.289683:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101a00/0xb28d70e1257514a9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788530310.289735:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967502 00000004:00010000:0.0:1788530310.289761:0:6524:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000033e84e20 reply state 00000000608146a6 transno 4294967503 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101a00/0xb28d70e1257514a9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530310.289776:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101a00/0xb28d70e1257514a9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530310.289785:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a9f2b995800) 00010000:00010000:0.0:1788530310.289805:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788530310.289811:0:6524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788530310.289943:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+63:12475:x1875409531672064:12345-192.168.202.41@tcp:36:bash.0 Request processed in 606us (1794us total) trans 4294967503 rc 0/0 00000100:00100000:0.0:1788530310.289952:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 225 00000020:00080000:0.0:1788530310.289959:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788530310.299001:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530310.305416:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531672192 00000100:00100000:2.0:1788530310.305441:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531672192 00000100:00100000:2.0:1788530310.305587:0:10719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 226 00000100:00100000:2.0:1788530310.305600:0:10719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f05f47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+63:12475:x1875409531672192:12345-192.168.202.41@tcp:101:bash.0 00010000:00010000:2.0:1788530310.305628:0:10719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530310.305663:0:10719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d200/0xb28d70e1257514b0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550ba5 expref: -99 pid: 10719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530310.305796:0:10719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d000/0xb28d70e1257514b7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530310.305814:0:10719:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e12575148d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b97 expref: 64 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530310.305825:0:10719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d000/0xb28d70e1257514b7 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530310.305864:0:10719:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e12575148d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b97 expref: 64 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530310.305891:0:10719:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e12575148d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b97 expref: 64 pid: 8678 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530310.305905:0:10719:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37374380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10719:1875409555855232:192.168.202.41@tcp:104: 00000100:00100000:2.0:1788530310.306031:0:10719:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f33e246c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788530310.309990:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530310.310347:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531672320 00000100:00100000:3.0:1788530310.310367:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531672320 00010000:00010000:3.0:1788530310.310422:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e12575148d lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b97 expref: 65 pid: 8678 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530310.310471:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 107 00000100:00100000:3.0:1788530310.310482:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f05f44700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+65:2400:x1875409531672320:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788530310.310499:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788530310.310506:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e12575148d lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b97 expref: 65 pid: 8678 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530310.310519:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e12575148d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b97 expref: 65 pid: 8678 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530310.310542:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a9f2b995800) 00010000:00010000:3.0:1788530310.310548:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d000/0xb28d70e1257514b7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530310.310587:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d000/0xb28d70e1257514b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530310.310596:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d000/0xb28d70e1257514b7 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530310.310615:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788530310.310682:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f05f44700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+65:2400:x1875409531672320:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 200us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530310.310690:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 107 00010000:00010000:2.0:1788530310.317680:0:10719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e12575148d lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b97 expref: 64 pid: 8678 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530310.317730:0:10719:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37374380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10719:1875409555855232:192.168.202.41@tcp:104: 00010000:00010000:2.0:1788530310.317765:0:10719:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d000/0xb28d70e1257514b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530310.317775:0:10719:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d000/0xb28d70e1257514b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530310.317803:0:10719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d000/0xb28d70e1257514b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788530310.317865:0:10719:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788530310.317881:0:10719:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788530310.317922:0:10719:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d000/0xb28d70e1257514b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530310.317978:0:10719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d200/0xb28d70e1257514b0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550ba5 expref: 64 pid: 10719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530310.318000:0:10719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d000/0xb28d70e1257514b7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550ba5 expref: 63 pid: 10719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530310.318013:0:10719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a9f2b995800) 00010000:00010000:2.0:1788530310.318016:0:10719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788530310.318021:0:10719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d20d000, rc 0) 00000100:00100000:3.0:1788530310.321708:0:10719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f05f47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+63:12475:x1875409531672192:12345-192.168.202.41@tcp:101:bash.0 Request processed in 16099us (22711us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530310.321736:0:10719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 226 00000100:00100000:1.0:1788530310.330635:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530310.330746:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531672576 00000100:00100000:3.0:1788530310.330760:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531672576 00000100:00100000:3.0:1788530310.330831:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 59 00000100:00100000:3.0:1788530310.330843:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f05f46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+63:12475:x1875409531672576:12345-192.168.202.41@tcp:35:bash.0 00000100:00100000:3.0:1788530310.332687:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f05f46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+64:12475:x1875409531672576:12345-192.168.202.41@tcp:35:bash.0 Request processed in 1832us (2048us total) trans 4294967504 rc 0/0 00000100:00100000:3.0:1788530310.332704:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 59 00010000:00010000:2.0:1788530310.337506:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788530310.450067:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530310.450233:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531672704 00000100:00100000:0.0:1788530310.450245:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531672704 00000100:00100000:0.0:1788530310.450399:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 227 00000100:00100000:0.0:1788530310.450412:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37374380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+64:12481:x1875409531672704:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:0.0:1788530310.450850:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530310.450877:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e1257514be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550bac expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530310.450958:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100800/0xb28d70e1257514c5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530310.450976:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100800/0xb28d70e1257514c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530310.450988:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100800/0xb28d70e1257514c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788530310.451035:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1788530310.451050:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788530310.451070:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100800/0xb28d70e1257514c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530310.451095:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e1257514be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550bac expref: 66 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530310.451137:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100800/0xb28d70e1257514c5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550bac expref: 65 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530310.451146:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a9f2b995b00) 00010000:00010000:0.0:1788530310.451149:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788530310.451153:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d100800, rc 0) 00000100:00100000:0.0:1788530310.451210:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37374380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+65:12481:x1875409531672704:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 801us (1161us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530310.451217:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 227 00000100:00100000:2.0:1788530310.457951:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530310.457998:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531672832 00000100:00100000:0.0:1788530310.458008:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531672832 00000100:00100000:0.0:1788530310.458083:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 228 00000100:00100000:0.0:1788530310.458095:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37374000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+65:12481:x1875409531672832:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:0.0:1788530310.458125:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530310.458157:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101000/0xb28d70e1257514cc lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550bb3 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530310.458241:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101600/0xb28d70e1257514d3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530310.458331:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101600/0xb28d70e1257514d3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530310.458344:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101600/0xb28d70e1257514d3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530310.458365:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100000/0xb28d70e1257514da lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530310.458980:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100000/0xb28d70e1257514da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530310.458993:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100000/0xb28d70e1257514da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530310.459123:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e1257514e1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530310.459134:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e1257514e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530310.459142:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e1257514e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788530310.459211:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788530310.459217:0:6524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788530310.459338:0:6524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e1257514e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530310.459466:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e1257514e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530310.459477:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101600/0xb28d70e1257514d3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530310.459484:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101600/0xb28d70e1257514d3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530310.459492:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101600/0xb28d70e1257514d3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530310.459512:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d101600 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:0.0:1788530310.459517:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101600/0xb28d70e1257514d3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530310.459524:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101600/0xb28d70e1257514d3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530310.459538:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a9f2b995b00) 00010000:00010000:0.0:1788530310.459541:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788530310.459546:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101600/0xb28d70e1257514d3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530310.459552:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101600/0xb28d70e1257514d3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530310.459588:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100000/0xb28d70e1257514da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530310.459595:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100000/0xb28d70e1257514da lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530310.459685:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100000/0xb28d70e1257514da lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530310.459693:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d100000 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:0.0:1788530310.459696:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100000/0xb28d70e1257514da lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530310.459702:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100000/0xb28d70e1257514da lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530310.459720:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9a9e0241d000) 00010000:00010000:0.0:1788530310.459723:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788530310.459726:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100000/0xb28d70e1257514da lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530310.459733:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100000/0xb28d70e1257514da lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530310.459765:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101000/0xb28d70e1257514cc lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550bb3 expref: 67 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530310.459779:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e1257514e1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550bb3 expref: 66 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530310.459785:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a9f2b995800) 00010000:00010000:0.0:1788530310.459788:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788530310.459791:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d100c00, rc 0) 00000100:00100000:0.0:1788530310.459889:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37374000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+66:12481:x1875409531672832:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 1795us (1947us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530310.459898:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 228 00000100:00100000:1.0:1788530310.465814:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530310.469848:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530310.470359:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531673216 00000100:00100000:3.0:1788530310.470371:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531673216 00000100:00100000:3.0:1788530310.470952:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 14 00000100:00100000:3.0:1788530310.470965:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37374700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+66:2399:x1875409531673216:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788530310.470984:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788530310.471017:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e1257514e1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550bb3 expref: 66 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530310.471042:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a9f2b995800) 00010000:00010000:3.0:1788530310.471048:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788530310.471120:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37374700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+65:2399:x1875409531673216:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 157us (1285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530310.471128:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 14 00000100:00100000:0.0:1788530310.472553:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531673088 00000100:00100000:0.0:1788530310.472591:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531673088 00000100:00100000:0.0:1788530310.472695:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 229 00000100:00100000:0.0:1788530310.472707:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f05f46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+65:12481:x1875409531673088:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:0.0:1788530310.472731:0:8678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530310.472756:0:8678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101000/0xb28d70e1257514e8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550bba expref: -99 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530310.472931:0:8678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100000/0xb28d70e1257514ef lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530310.472951:0:8678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d000/0xb28d70e1257514b7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550ba5 expref: 66 pid: 10719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530310.472961:0:8678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100000/0xb28d70e1257514ef lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530310.473007:0:8678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d000/0xb28d70e1257514b7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550ba5 expref: 66 pid: 10719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530310.473023:0:8678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d000/0xb28d70e1257514b7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550ba5 expref: 66 pid: 10719 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530310.473039:0:8678:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d3e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8678:1875409555855360:192.168.202.41@tcp:104: 00000100:00100000:0.0:1788530310.473164:0:8678:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f18143000 going to sleep for 11 seconds 00000100:00100000:2.0:1788530310.482496:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530310.482726:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531673344 00000100:00100000:3.0:1788530310.482737:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531673344 00010000:00010000:3.0:1788530310.482789:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d000/0xb28d70e1257514b7 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550ba5 expref: 67 pid: 10719 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530310.482859:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 108 00000100:00100000:3.0:1788530310.482870:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+67:2400:x1875409531673344:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788530310.482890:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788530310.482899:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d000/0xb28d70e1257514b7 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550ba5 expref: 67 pid: 10719 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530310.482925:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d000/0xb28d70e1257514b7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550ba5 expref: 67 pid: 10719 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530310.482954:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a9f2b995800) 00010000:00010000:3.0:1788530310.482961:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100000/0xb28d70e1257514ef lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530310.482973:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100000/0xb28d70e1257514ef lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530310.482983:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100000/0xb28d70e1257514ef lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530310.483006:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788530310.483098:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+67:2400:x1875409531673344:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 224us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530310.483108:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 108 00010000:00010000:0.0:1788530310.485228:0:8678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d000/0xb28d70e1257514b7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550ba5 expref: 66 pid: 10719 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530310.485275:0:8678:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d3e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8678:1875409555855360:192.168.202.41@tcp:104: 00010000:00010000:0.0:1788530310.485307:0:8678:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100000/0xb28d70e1257514ef lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530310.485319:0:8678:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100000/0xb28d70e1257514ef lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530310.485360:0:8678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100000/0xb28d70e1257514ef lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788530310.485401:0:8678:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788530310.485589:0:8678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101000/0xb28d70e1257514e8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550bba expref: 67 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530310.485605:0:8678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100000/0xb28d70e1257514ef lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550bba expref: 66 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530310.485615:0:8678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a9f2b995800) 00010000:00010000:0.0:1788530310.485618:0:8678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788530310.485622:0:8678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d100000, rc 0) 00000100:00100000:0.0:1788530310.485702:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f05f46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+66:12481:x1875409531673088:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 12997us (19898us total) trans 4294967505 rc 0/0 00000100:00100000:0.0:1788530310.485712:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 229 00000100:00100000:2.0:1788530310.496720:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530310.496842:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531673600 00000100:00100000:0.0:1788530310.496858:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531673600 00000100:00100000:0.0:1788530310.496980:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 15 00000100:00100000:0.0:1788530310.496995:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+66:12481:x1875409531673600:12345-192.168.202.41@tcp:103:lfs.0 00010000:00010000:0.0:1788530310.497021:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788530310.497075:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d400/0xb28d70e125751440 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b89 expref: 66 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530310.497104:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a9f2b995800) 00010000:00010000:0.0:1788530310.497110:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788530310.497208:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+65:12481:x1875409531673600:12345-192.168.202.41@tcp:103:lfs.0 Request processed in 215us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530310.497218:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 15 00000100:00100000:1.0:1788530310.501020:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530310.502221:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531673728 00000100:00100000:3.0:1788530310.502244:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531673728 00000100:00100000:2.0:1788530310.502835:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 230 00000100:00100000:2.0:1788530310.502853:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f05f45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+65:12481:x1875409531673728:12345-192.168.202.41@tcp:58:lfs.0 00010000:00010000:2.0:1788530310.503192:0:10720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ce00/0xb28d70e1257514fd lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530310.503243:0:10720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ce00/0xb28d70e1257514fd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530310.503759:0:10720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ce00/0xb28d70e1257514fd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788530310.504000:0:10720:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1788530310.504365:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f05f45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+65:12481:x1875409531673728:12345-192.168.202.41@tcp:58:lfs.0 Request processed in 1511us (3355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530310.504384:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 230 00000100:00100000:1.0:1788530310.508345:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530310.508726:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531673856 00000100:00100000:2.0:1788530310.508739:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531673856 00000100:00100000:2.0:1788530310.508872:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 231 00000100:00100000:2.0:1788530310.508884:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f05f47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+65:12481:x1875409531673856:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:2.0:1788530310.508908:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530310.508943:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d400/0xb28d70e125751504 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550bc1 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530310.509004:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ce00/0xb28d70e1257514fd lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530310.509016:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d400/0xb28d70e125751504 lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550bc1 expref: 66 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530310.509047:0:6525:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ce00/0xb28d70e1257514fd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530310.509062:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d400/0xb28d70e125751504 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550bc1 expref: 66 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530310.509093:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a9f2b995800) 00010000:00010000:2.0:1788530310.509096:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788530310.509100:0:6525:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d400/0xb28d70e125751504 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550bc1 expref: 66 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530310.509108:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d20d400, rc 0) 00000100:00100000:2.0:1788530310.509173:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f05f47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+66:12481:x1875409531673856:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 291us (842us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530310.509181:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 231 00000100:00100000:1.0:1788530310.725287:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555855488:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788530310.725386:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530310.725726:0:14186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555855488 00000100:00100000:3.0:1788530310.725740:0:14186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555855488 00000100:00100000:3.0:1788530310.725865:0:14186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1788530310.725878:0:14186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f05f45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555855488:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788530310.726125:0:14186:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1788530310.730907:0:14186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f05f45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555855488:12345-0@lo:41:osp-pre-0-1.0 Request processed in 5018us (5509us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530310.731435:0:14186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1788530310.732093:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555855488:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788530311.233201:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788530311.233255:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555855616:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788530311.233361:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530311.233519:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555855616 00000100:00100000:3.0:1788530311.233529:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555855616 00000100:00100000:3.0:1788530311.233609:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788530311.233620:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1875409555855616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788530311.233659:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1788530311.233712:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1875409555855616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530311.233720:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788530311.233775:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555855616:0@lo:13:osp-pre-0-0.0 00000004:00080000:2.0:1788530311.233999:0:8751:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 519136435469ns, next at 520135337026ns, rc = 0 00000040:00080000:0.0:1788530311.234049:0:13811:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788530311.234055:0:13811:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788530311.234110:0:13811:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1788530311.234118:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788530311.234270:0:13811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d3ce00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13811:1875409555855744:192.168.202.41@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788530311.234352:0:13811:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f181430c0 going to sleep for 11 seconds 00000004:00080000:1.0:1788530311.237721:0:9907:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 519140157125ns, next at 520140154210ns, rc = 0 00000100:00100000:1.0:1788530311.237745:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788530311.237765:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f05f45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555855872:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788530311.237847:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530311.237901:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555855872 00000100:00100000:2.0:1788530311.237992:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555856000:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788530311.238023:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530311.238156:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875409555856512:0@lo:400:kworker.0 00000100:00100000:2.0:1788530311.238190:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530311.238193:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555856000 00000100:00100000:3.0:1788530311.238203:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555856000 00000100:00100000:2.0:1788530311.238212:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555857024:0@lo:400:kworker.0 00000100:00100000:2.0:1788530311.238242:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530311.238258:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788530311.238263:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788530311.238271:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555856000:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788530311.238273:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3647:1875409555856128:0@lo:400:kworker.0 00002000:00000024:3.0:1788530311.238304:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1788530311.238310:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530311.238340:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555856640:0@lo:400:kworker.0 00000100:00100000:3.0:1788530311.238360:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555856000:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530311.238368:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00080000:3.0:1788530311.238413:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788530311.238426:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555856128 00000100:00100000:3.0:1788530311.238429:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555856128 00000100:00100000:3.0:1788530311.238455:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 450 00000100:00100000:3.0:1788530311.238463:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:3647:x1875409555856128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530311.238497:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:3647:x1875409555856128:12345-0@lo:400:kworker.0 Request processed in 35us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530311.238504:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 450 00000100:00100000:3.0:1788530311.239231:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530311.239293:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555856384:0@lo:400:kworker.0 00000100:00100000:1.0:1788530311.239451:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555855872 00000100:00100000:1.0:1788530311.239492:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788530311.239498:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f05f45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1875409555855872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788530311.239516:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1788530311.239671:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555857024 00000100:00100000:0.0:1788530311.239676:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555857024 00000100:00100000:0.0:1788530311.239711:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788530311.239719:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03766680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555857024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530311.242768:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f05f45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1875409555855872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3249us (4901us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530311.242790:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00080000:1.0:1788530311.242858:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788530311.242874:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788530311.242911:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875409555856256:0@lo:400:kworker.0 00000100:00100000:1.0:1788530311.242967:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530311.243013:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875409555856768:0@lo:400:kworker.0 00000100:00100000:1.0:1788530311.243038:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530311.243062:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875409555857280:0@lo:400:kworker.0 00000100:00100000:1.0:1788530311.243083:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530311.243144:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f05f45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555855872:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788530311.243172:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788530311.243179:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555857408:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788530311.243204:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530311.243235:0:9912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555857408 00000100:00100000:1.0:1788530311.243825:0:9912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555857408 00000100:00100000:1.0:1788530311.243992:0:9912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788530311.244007:0:9912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3649:x1875409555857408:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788530311.244040:0:9912:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1788530311.244121:0:9912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3649:x1875409555857408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 117us (914us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530311.244155:0:9912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788530311.244230:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555857408:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788530311.244280:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555856512 00000100:00100000:1.0:1788530311.244286:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555856512 00000100:00100000:1.0:1788530311.244354:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531673984 00000100:00100000:1.0:1788530311.244358:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531673984 00000100:00100000:1.0:1788530311.244396:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555856256 00000100:00100000:1.0:1788530311.244400:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555856256 00000100:00100000:1.0:1788530311.244416:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555856768 00000100:00100000:1.0:1788530311.244419:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555856768 00000100:00100000:1.0:1788530311.244433:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555857280 00000100:00100000:1.0:1788530311.244435:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555857280 00000100:00100000:1.0:1788530311.244451:0:10719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 402 00000100:00100000:1.0:1788530311.244457:0:10719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875409555856512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530311.244496:0:10719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875409555856512:12345-0@lo:400:kworker.0 Request processed in 38us (6306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530311.244502:0:10719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 402 00000100:00100000:1.0:1788530311.244516:0:10719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 403 00000100:00100000:1.0:1788530311.244522:0:10719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875409555856256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530311.244554:0:10719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875409555856256:12345-0@lo:400:kworker.0 Request processed in 32us (1586us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530311.244868:0:10719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 403 00000100:00100000:1.0:1788530311.244885:0:10719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 404 00000100:00100000:1.0:1788530311.244894:0:10719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875409555856768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530311.245004:0:10719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875409555856768:12345-0@lo:400:kworker.0 Request processed in 111us (1964us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530311.245010:0:10719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 404 00000100:00100000:1.0:1788530311.245035:0:10719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 405 00000100:00100000:1.0:1788530311.245041:0:10719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875409555857280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530311.245072:0:10719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875409555857280:12345-0@lo:400:kworker.0 Request processed in 32us (1989us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530311.245079:0:10719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 405 00000100:00100000:1.0:1788530311.245095:0:10719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 232 00000100:00100000:1.0:1788530311.245102:0:10719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+67:12482:x1875409531673984:12345-192.168.202.41@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788530311.245126:0:10719:0:(mdt_handler.c:7977:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788530311.245832:0:10719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+67:12482:x1875409531673984:12345-192.168.202.41@tcp:53:lhsmtool_posix.0 Request processed in 726us (6602us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530311.245842:0:10719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 232 00000100:00080000:1.0:1788530311.245884:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788530311.245889:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788530311.245938:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875409555856256:0@lo:400:kworker.0 00000100:00100000:1.0:1788530311.245952:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875409555856768:0@lo:400:kworker.0 00010000:00080000:1.0:1788530311.245967:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e037e4a80 x1875409555857280/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530327 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530311.245978:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875409555857280:0@lo:400:kworker.0 00000100:00100000:3.0:1788530311.249192:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530311.249682:0:13811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d3ce00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13811:1875409555855744:192.168.202.41@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788530311.251754:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555856384 00000100:00100000:1.0:1788530311.251769:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555856384 00000100:00100000:1.0:1788530311.251853:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1788530311.252849:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875409555856896:0@lo:400:kworker.0 00000100:00100000:3.0:1788530311.253113:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530311.253196:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555856896 00000100:00100000:3.0:1788530311.253201:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555856896 00000100:00100000:1.0:1788530311.253538:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555856384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530311.254043:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555856384:12345-0@lo:400:kworker.0 Request processed in 2179us (4860us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530311.254069:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00080000:1.0:1788530311.254123:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788530311.255071:0:10719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 406 00000100:00100000:3.0:1788530311.255089:0:10719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875409555856896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530311.255159:0:10719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875409555856896:12345-0@lo:400:kworker.0 Request processed in 78us (2047us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530311.255165:0:10719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 406 00000100:00100000:3.0:1788530311.255229:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555856384:0@lo:400:kworker.0 00000100:00100000:0.0:1788530311.255705:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03766680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555857024:12345-0@lo:400:kworker.0 Request processed in 15985us (17460us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530311.255715:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788530311.255879:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530311.256172:0:14186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555856640 00000100:00100000:0.0:1788530311.256180:0:14186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555856640 00000100:00100000:0.0:1788530311.256217:0:14186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1788530311.256224:0:14186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03766d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555856640:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1788530311.256349:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e037e4380 x1875409555856896/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530327 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530311.256492:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875409555857152:0@lo:400:kworker.0 00000100:00100000:2.0:1788530311.256538:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530311.256613:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875409555856512:0@lo:400:kworker.0 00000100:00100000:2.0:1788530311.256626:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555857024:0@lo:400:kworker.0 00000100:00100000:2.0:1788530311.256655:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555856000:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788530311.256684:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3647:1875409555856128:0@lo:400:kworker.0 00000100:00100000:1.0:1788530311.256701:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555857152 00000100:00100000:1.0:1788530311.256708:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555857152 00000100:00100000:1.0:1788530311.256770:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 407 00000100:00100000:1.0:1788530311.256777:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03765180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875409555857152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530311.256817:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03765180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875409555857152:12345-0@lo:400:kworker.0 Request processed in 41us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530311.256824:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 407 00000100:00100000:3.0:1788530311.256989:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875409555856896:0@lo:400:kworker.0 00000100:00100000:0.0:1788530311.257320:0:14186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03766d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555856640:12345-0@lo:400:kworker.0 Request processed in 1095us (1441us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530311.257340:0:14186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00080000:2.0:1788530311.257997:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788530311.258029:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555856640:0@lo:400:kworker.0 00000100:00100000:2.0:1788530311.258042:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875409555857152:0@lo:400:kworker.0 00000100:00100000:2.0:1788530311.263132:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530311.263313:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531674112 00000100:00100000:1.0:1788530311.263336:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531674112 00000100:00100000:1.0:1788530311.263597:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 233 00000100:00100000:1.0:1788530311.263610:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03764000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+66:12482:x1875409531674112:12345-192.168.202.41@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788530311.263695:0:8678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ebe00/0xb28d70e12575150b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530311.263713:0:8678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ebe00/0xb28d70e12575150b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530311.263728:0:8678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ebe00/0xb28d70e12575150b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530311.263747:0:8678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eae00/0xb28d70e125751512 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530311.263755:0:8678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eae00/0xb28d70e125751512 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530311.263763:0:8678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eae00/0xb28d70e125751512 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530311.263804:0:8678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb400/0xb28d70e125751519 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530311.263814:0:8678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb400/0xb28d70e125751519 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530311.263821:0:8678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb400/0xb28d70e125751519 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788530311.263897:0:8678:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788530311.263901:0:8678:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788530311.263914:0:8678:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb400/0xb28d70e125751519 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530311.263926:0:8678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ebe00/0xb28d70e12575150b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530311.263933:0:8678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ebe00/0xb28d70e12575150b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530311.263941:0:8678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ebe00/0xb28d70e12575150b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530311.263948:0:8678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f012ebe00 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:1.0:1788530311.263952:0:8678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ebe00/0xb28d70e12575150b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530311.263961:0:8678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ebe00/0xb28d70e12575150b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530311.263973:0:8678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a9f2b992000) 00010000:00010000:1.0:1788530311.263983:0:8678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788530311.263990:0:8678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ebe00/0xb28d70e12575150b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530311.263997:0:8678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ebe00/0xb28d70e12575150b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530311.264014:0:8678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eae00/0xb28d70e125751512 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530311.264022:0:8678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eae00/0xb28d70e125751512 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530311.264029:0:8678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eae00/0xb28d70e125751512 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530311.264035:0:8678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f012eae00 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:1.0:1788530311.264038:0:8678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eae00/0xb28d70e125751512 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530311.264045:0:8678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eae00/0xb28d70e125751512 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530311.264053:0:8678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff9a9f32a71d00) 00010000:00010000:1.0:1788530311.264056:0:8678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788530311.264059:0:8678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eae00/0xb28d70e125751512 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530311.264065:0:8678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eae00/0xb28d70e125751512 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530311.264082:0:8678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb400/0xb28d70e125751519 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530311.264095:0:8678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb400/0xb28d70e125751519 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530311.264102:0:8678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb400/0xb28d70e125751519 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530311.264107:0:8678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f012eb400 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:1.0:1788530311.264110:0:8678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb400/0xb28d70e125751519 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530311.264118:0:8678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb400/0xb28d70e125751519 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530311.264126:0:8678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a9f2b995800) 00010000:00010000:1.0:1788530311.264128:0:8678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788530311.264132:0:8678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb400/0xb28d70e125751519 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530311.264138:0:8678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb400/0xb28d70e125751519 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530311.264230:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03764000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+66:12482:x1875409531674112:12345-192.168.202.41@tcp:34:lhsmtool_posix.0 Request processed in 622us (1110us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530311.264249:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 233 00000100:00100000:1.0:1788530311.270370:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530311.270683:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531674368 00000100:00100000:3.0:1788530311.270708:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531674368 00000100:00100000:3.0:1788530311.270847:0:10719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 234 00000100:00100000:3.0:1788530311.270858:0:10719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+66:12482:x1875409531674368:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788530311.270888:0:10719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788530311.270909:0:10719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e125751520 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550bc8 expref: -99 pid: 10719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530311.271018:0:10719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b400/0xb28d70e125751527 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530311.271034:0:10719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b400/0xb28d70e125751527 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530311.271044:0:10719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b400/0xb28d70e125751527 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788530311.271056:0:10719:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788530311.271136:0:10719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b400/0xb28d70e125751527 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530311.271144:0:10719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b400/0xb28d70e125751527 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530311.271151:0:10719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b400/0xb28d70e125751527 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530311.271157:0:10719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d36b400 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:3.0:1788530311.271161:0:10719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b400/0xb28d70e125751527 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530311.271168:0:10719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b400/0xb28d70e125751527 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530311.271188:0:10719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a9f2b995800) 00010000:00010000:3.0:1788530311.271191:0:10719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788530311.271196:0:10719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b400/0xb28d70e125751527 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530311.271202:0:10719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b400/0xb28d70e125751527 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530311.271255:0:10719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e125751520 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550bc8 expref: 68 pid: 10719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530311.271266:0:10719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a9f2b992000) 00010000:00010000:3.0:1788530311.271269:0:10719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788530311.271273:0:10719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e125751520 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550bc8 expref: 68 pid: 10719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530311.271284:0:10719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d36b200, rc 0) 00000100:00100000:3.0:1788530311.271359:0:10719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+67:12482:x1875409531674368:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 503us (1000us total) trans 4294967506 rc 301/301 00000100:00100000:3.0:1788530311.271367:0:10719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 234 00000100:00100000:3.0:1788530311.274295:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530311.274465:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531674496 00000100:00100000:1.0:1788530311.274482:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531674496 00000100:00100000:1.0:1788530311.274740:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 235 00000100:00100000:1.0:1788530311.274752:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+67:12482:x1875409531674496:12345-192.168.202.41@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788530311.274822:0:6524:0:(mdt_handler.c:7977:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788530311.275086:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+67:12482:x1875409531674496:12345-192.168.202.41@tcp:53:lhsmtool_posix.0 Request processed in 336us (803us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530311.275095:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 235 00000100:00100000:3.0:1788530311.279934:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530311.281810:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531674752 00000100:00100000:1.0:1788530311.281837:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531674752 00000100:00100000:1.0:1788530311.281975:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 236 00000100:00100000:1.0:1788530311.281987:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+67:12482:x1875409531674752:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788530311.282011:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530311.282015:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788530311.282043:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100800/0xb28d70e1257514c5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550bac expref: 67 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530311.282065:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a9f2b995b00) 00010000:00010000:1.0:1788530311.282071:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788530311.282087:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb000/0xb28d70e125751535 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550bcf expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788530311.283725:0:6524:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x6:0x0], index 1: 0 00010000:00010000:1.0:1788530311.284140:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb400/0xb28d70e12575153c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530311.284165:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb400/0xb28d70e12575153c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530311.284179:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb400/0xb28d70e12575153c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530311.284299:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb000/0xb28d70e125751535 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550bcf expref: 69 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530311.284323:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb400/0xb28d70e12575153c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550bcf expref: 68 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530311.284715:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9a9f32a71d00) 00010000:00010000:1.0:1788530311.284719:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788530311.284726:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f012eb400, rc 0) 00000100:00100000:1.0:1788530311.284819:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+68:12482:x1875409531674752:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 2832us (4896us total) trans 4294967507 rc 0/0 00000100:00100000:1.0:1788530311.284839:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 236 00000100:00100000:3.0:1788530311.289966:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530311.290353:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531675008 00000100:00100000:2.0:1788530311.290369:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531675008 00000100:00100000:3.0:1788530311.291103:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 237 00000100:00100000:3.0:1788530311.291115:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+68:12482:x1875409531675008:12345-192.168.202.41@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788530311.291175:0:10720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788530311.291214:0:10720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb400/0xb28d70e12575153c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550bcf expref: 68 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530311.291237:0:10720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9a9f32a71d00) 00010000:00010000:3.0:1788530311.291263:0:10720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788530311.291289:0:10720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e12575154a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530311.291305:0:10720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e12575154a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530311.291316:0:10720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e12575154a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530311.291344:0:10720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b400/0xb28d70e125751551 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x1ba462eb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530311.291353:0:10720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b400/0xb28d70e125751551 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x1ba462eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530311.291360:0:10720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b400/0xb28d70e125751551 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x1ba462eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530311.291421:0:10720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e12575154a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530311.291429:0:10720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e12575154a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530311.291436:0:10720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e12575154a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530311.291443:0:10720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d36b200 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:3.0:1788530311.291453:0:10720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e12575154a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530311.291462:0:10720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e12575154a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530311.291471:0:10720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a9f2b995b00) 00010000:00010000:3.0:1788530311.291474:0:10720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788530311.291478:0:10720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e12575154a lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530311.291484:0:10720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e12575154a lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530311.291494:0:10720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b400/0xb28d70e125751551 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x1ba462eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530311.291500:0:10720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b400/0xb28d70e125751551 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x1ba462eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530311.291506:0:10720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b400/0xb28d70e125751551 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x1ba462eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530311.291510:0:10720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d36b400 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:3.0:1788530311.291513:0:10720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b400/0xb28d70e125751551 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x1ba462eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530311.291518:0:10720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b400/0xb28d70e125751551 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x1ba462eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530311.291524:0:10720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x1ba462eb (ffff9a9f0cf59900) 00010000:00010000:3.0:1788530311.291526:0:10720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788530311.291536:0:10720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b400/0xb28d70e125751551 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x1ba462eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530311.291542:0:10720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b400/0xb28d70e125751551 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x1ba462eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530311.291691:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+67:12482:x1875409531675008:12345-192.168.202.41@tcp:36:lhsmtool_posix.0 Request processed in 576us (1733us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788530311.291701:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 237 00000100:00100000:3.0:1788530311.298801:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530311.299115:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531675136 00000100:00100000:2.0:1788530311.299126:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531675136 00000100:00100000:2.0:1788530311.299231:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 238 00000100:00100000:2.0:1788530311.299252:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+67:12482:x1875409531675136:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788530311.299274:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530311.299297:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e125751558 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550bd6 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.299343:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d200/0xb28d70e12575155f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.299357:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d200/0xb28d70e12575155f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.299369:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d200/0xb28d70e12575155f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.299521:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e125751558 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550bd6 expref: 69 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.299538:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d200/0xb28d70e12575155f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550bd6 expref: 68 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.299547:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9a9f2b995200) 00010000:00010000:2.0:1788530311.299550:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788530311.299555:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d20d200, rc 0) 00000100:00100000:2.0:1788530311.299687:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+68:12482:x1875409531675136:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 447us (900us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530311.299695:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 238 00000100:00100000:0.0:1788530311.303546:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530311.303986:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531675392 00000100:00100000:3.0:1788530311.303995:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531675392 00000100:00100000:3.0:1788530311.304102:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 239 00000100:00100000:3.0:1788530311.304113:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+68:12482:x1875409531675392:12345-192.168.202.41@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788530311.304199:0:8678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b400/0xb28d70e125751566 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530311.304216:0:8678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b400/0xb28d70e125751566 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530311.304228:0:8678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b400/0xb28d70e125751566 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788530311.304739:0:8678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00010000:3.0:1788530311.304814:0:8678:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ea519066 reply state 00000000408cf32f transno 4294967508 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b400/0xb28d70e125751566 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530311.305078:0:8678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b400/0xb28d70e125751566 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530311.305089:0:8678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9a9f2b995200) 00010000:00010000:3.0:1788530311.305108:0:8678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788530311.305114:0:8678:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788530311.305789:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+70:12482:x1875409531675392:12345-192.168.202.41@tcp:36:lhsmtool_posix.0 Request processed in 1672us (2250us total) trans 4294967508 rc 0/0 00000100:00100000:3.0:1788530311.305798:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 239 00000100:00100000:0.0:1788530311.309979:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530311.310093:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531675520 00000100:00100000:1.0:1788530311.310104:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531675520 00000100:00100000:1.0:1788530311.310222:0:10719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 240 00000100:00100000:1.0:1788530311.310234:0:10719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+70:12482:x1875409531675520:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788530311.310274:0:10719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530311.310302:0:10719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb000/0xb28d70e12575156d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550bdd expref: -99 pid: 10719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530311.310691:0:10719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb000/0xb28d70e12575156d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550bdd expref: 71 pid: 10719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530311.310708:0:10719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb000/0xb28d70e12575156d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550bdd expref: 71 pid: 10719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530311.310752:0:10719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9a9f2b995200) 00010000:00010000:1.0:1788530311.310755:0:10719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788530311.310759:0:10719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f012eb000, rc 0) 00000100:00100000:1.0:1788530311.310875:0:10719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+71:12482:x1875409531675520:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 642us (967us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530311.310882:0:10719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 240 00000100:00100000:0.0:1788530311.313706:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530311.313921:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531675648 00000100:00100000:2.0:1788530311.313937:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531675648 00000100:00100000:2.0:1788530311.314051:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 71 00000100:00100000:2.0:1788530311.314063:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+9:2400:x1875409531675648:12345-192.168.202.41@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788530311.314725:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+10:2400:x1875409531675648:12345-192.168.202.41@tcp:2:lhsmtool_posix.0 Request processed in 662us (1033us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1788530311.314737:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 71 00000100:00080000:1.0:1788530311.314817:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788530311.318438:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530311.318697:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531675904 00000100:00100000:3.0:1788530311.318710:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531675904 00000100:00100000:3.0:1788530311.318793:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 60 00000100:00100000:3.0:1788530311.318807:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+71:12482:x1875409531675904:12345-192.168.202.41@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788530311.319259:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+72:12482:x1875409531675904:12345-192.168.202.41@tcp:35:lhsmtool_posix.0 Request processed in 454us (833us total) trans 4294967509 rc 0/0 00000100:00100000:3.0:1788530311.319268:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 60 00000100:00100000:0.0:1788530311.324832:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530311.325525:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531676160 00000100:00100000:3.0:1788530311.325540:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531676160 00000100:00100000:3.0:1788530311.325734:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 241 00000100:00100000:3.0:1788530311.325748:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+72:12482:x1875409531676160:12345-192.168.202.41@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788530311.325896:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+72:12482:x1875409531676160:12345-192.168.202.41@tcp:57:lhsmtool_posix.0 Request processed in 151us (1076us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530311.327980:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 241 00000100:00100000:0.0:1788530311.333888:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530311.334085:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531676288 00000100:00100000:1.0:1788530311.334101:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531676288 00000100:00100000:1.0:1788530311.334220:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 242 00000100:00100000:1.0:1788530311.334234:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+72:12482:x1875409531676288:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788530311.334819:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530311.334850:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eae00/0xb28d70e125751574 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550be4 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530311.334958:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ebe00/0xb28d70e12575157b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530311.334976:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ebe00/0xb28d70e12575157b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530311.334990:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ebe00/0xb28d70e12575157b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788530311.335038:0:6524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788530311.335062:0:6524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ebe00/0xb28d70e12575157b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530311.335121:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eae00/0xb28d70e125751574 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550be4 expref: 74 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530311.335147:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ebe00/0xb28d70e12575157b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550be4 expref: 73 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530311.335158:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9a9f2b995200) 00010000:00010000:1.0:1788530311.335162:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788530311.335167:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f012ebe00, rc 0) 00000100:00100000:1.0:1788530311.335524:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+73:12482:x1875409531676288:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 1291us (1656us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530311.335533:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 242 00000100:00100000:0.0:1788530311.340134:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530311.340314:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531676416 00000100:00100000:1.0:1788530311.340340:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531676416 00000100:00100000:1.0:1788530311.340719:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 72 00000100:00100000:1.0:1788530311.340734:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+10:2399:x1875409531676416:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788530311.340758:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530311.340788:0:8438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000089f84ccb/0xb28d70e125751582 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550beb expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788530311.340829:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9ace86, blocks: 0x0 00010000:00010000:1.0:1788530311.340863:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=519s v=(0 0) 00010000:00010000:1.0:1788530311.340868:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788530311.340881:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000089f84ccb/0xb28d70e125751582 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550beb expref: 11 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530311.341079:0:8438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000089f84ccb/0xb28d70e125751582 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550beb expref: 11 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530311.341102:0:8438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f012eba00, rc 0) 00000100:00100000:1.0:1788530311.341218:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+11:2399:x1875409531676416:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 488us (1329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530311.341228:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 72 00000100:00100000:0.0:1788530311.347127:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530311.347305:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531676672 00000100:00100000:3.0:1788530311.347317:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531676672 00000100:00100000:3.0:1788530311.347730:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 243 00000100:00100000:3.0:1788530311.347742:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+73:12482:x1875409531676672:12345-192.168.202.41@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788530311.347894:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+73:12482:x1875409531676672:12345-192.168.202.41@tcp:57:lhsmtool_posix.0 Request processed in 154us (778us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530311.347915:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 243 00000100:00100000:3.0:1788530311.354148:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530311.354262:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531676800 00000100:00100000:2.0:1788530311.354276:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531676800 00000100:00100000:2.0:1788530311.354820:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 73 00000100:00100000:2.0:1788530311.354836:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+11:12482:x1875409531676800:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788530311.354857:0:8439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530311.354878:0:8439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c36de4c8/0xb28d70e125751589 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550bf2 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.354947:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000089f84ccb/0xb28d70e125751582 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550beb expref: 12 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.354958:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788530311.354963:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788530311.354970:0:8439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c36de4c8/0xb28d70e125751589 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550bf2 expref: 12 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.355007:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000089f84ccb/0xb28d70e125751582 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550beb expref: 12 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.355022:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000089f84ccb/0xb28d70e125751582 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550beb expref: 12 pid: 8438 timeout: 619 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530311.355037:0:8439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03765500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8439:1875409555857536:192.168.202.41@tcp:104: 00000100:00100000:2.0:1788530311.355135:0:8439:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f33e246c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788530311.358725:0:8439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03765500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8439:1875409555857536:192.168.202.41@tcp:104: 00010000:00010000:2.0:1788530311.358767:0:8439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c36de4c8/0xb28d70e125751589 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550bf2 expref: 12 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.358792:0:8439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d20c000, rc 0) 00000100:00100000:2.0:1788530311.359296:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+12:12482:x1875409531676800:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 4461us (5158us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530311.359309:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 73 00000100:00100000:0.0:1788530311.360080:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530311.361495:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531676928 00000100:00100000:2.0:1788530311.361506:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531676928 00010000:00010000:2.0:1788530311.361545:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000089f84ccb/0xb28d70e125751582 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550beb expref: 12 pid: 8438 timeout: 619 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530311.361619:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 109 00000100:00100000:2.0:1788530311.361630:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f08d7d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+12:2399:x1875409531676928:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788530311.361653:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788530311.361676:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000089f84ccb/0xb28d70e125751582 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550beb expref: 12 pid: 8438 timeout: 619 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.361691:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000089f84ccb/0xb28d70e125751582 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550beb expref: 12 pid: 8438 timeout: 619 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.361713:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000089f84ccb/0xb28d70e125751582 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550beb expref: 12 pid: 8438 timeout: 619 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.361727:0:6510:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788530311.361731:0:6510:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788530311.361737:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c36de4c8/0xb28d70e125751589 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550bf2 expref: 11 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.361744:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c36de4c8/0xb28d70e125751589 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550bf2 expref: 11 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.361774:0:6510:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c36de4c8/0xb28d70e125751589 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550bf2 expref: 11 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530311.361798:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03765500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6510:1875409555857664:192.168.202.41@tcp:105: 00000100:00100000:2.0:1788530311.366509:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f33e246c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788530311.371188:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03765500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6510:1875409555857664:192.168.202.41@tcp:105: 00010000:00010000:3.0:1788530311.371216:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788530311.371837:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f08d7d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+11:2399:x1875409531676928:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 10205us (11757us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530311.371855:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 109 00000100:00100000:0.0:1788530311.372103:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00010000:00010000:2.0:1788530311.372897:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788530311.373071:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531677056 00000100:00100000:3.0:1788530311.373082:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531677056 00002000:00100000:3.0:1788530311.373129:0:8444:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff9a9e03d3c380 x1875409531677056/t0(0) o4->aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41@192.168.202.41@tcp:252/0 lens 504/0 e 0 to 0 dl 1788530322 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788530311.373139:0:8444:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a9e03d3c380 with x1875409531677056 ext(0->12) 00002000:00010000:3.0:1788530311.373144:0:8444:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a9e03d3c380 00000100:00100000:3.0:1788530311.373165:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 7 00000100:00100000:3.0:1788530311.373171:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+11:2400:x1875409531677056:12345-192.168.202.41@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788530311.375218:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+13:2400:x1875409531677056:12345-192.168.202.41@tcp:4:lhsmtool_posix.0 Request processed in 2030us (3100us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1788530311.375231:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 7 00002000:00100000:2.0:1788530311.375932:0:8444:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff9a9e03d3c380 x1875409531677056/t4294967322(0) o4->aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41@192.168.202.41@tcp:252/0 lens 504/448 e 0 to 0 dl 1788530322 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788530311.375946:0:8444:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a9e03d3c380 with x1875409531677056 ext(0->12) 00002000:00010000:2.0:1788530311.375955:0:8444:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a9e03d3c380 00000100:00100000:0.0:1788530311.378342:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530311.378749:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531677184 00000100:00100000:2.0:1788530311.378759:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531677184 00000100:00100000:2.0:1788530311.378890:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 244 00000100:00100000:2.0:1788530311.378903:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+73:12482:x1875409531677184:12345-192.168.202.41@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788530311.381546:0:6502:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967509 is committed 00000004:00080000:1.0:1788530311.381703:0:6502:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000004:00080000:1.0:1788530311.381714:0:6502:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000004:00080000:1.0:1788530311.381740:0:6502:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:1.0:1788530311.381749:0:6502:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a9f08cd5c00 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1788530311.381754:0:6502:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a9e02577b00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a9f18626e40 00000020:00080000:1.0:1788530311.381757:0:6502:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a9e02577a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a9e03f29c00 00000004:00080000:1.0:1788530311.381780:0:6502:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:1.0:1788530311.381819:0:6502:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a9f22132540 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1788530311.381822:0:6502:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a9f3d3a6f00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a9f0533a480 00000020:00080000:1.0:1788530311.381825:0:6502:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a9f3d3a6200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a9f02598400 00000020:00080000:1.0:1788530311.381836:0:6502:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000100:00100000:1.0:1788530311.382033:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+27:12482:x1875409531677184:12345-192.168.202.41@tcp:44:lhsmtool_posix.0 Request processed in 3125us (3705us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530311.382045:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 244 00000100:00100000:0.0:1788530311.382653:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555857920:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788530311.382710:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530311.382739:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788530311.382744:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555857792:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788530311.382759:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530311.382785:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555857920 00000100:00100000:0.0:1788530311.382793:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555857920 00000100:00100000:0.0:1788530311.382834:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555857792 00000100:00100000:0.0:1788530311.382837:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555857792 00000100:00100000:0.0:1788530311.382857:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788530311.382867:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3648:x1875409555857920:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788530311.382894:0:8438:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00002000:00010000:0.0:1788530311.382938:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a9ace85, atime: 0x6a9ace85, ctime: 0x6a9ace85, blocks: 0x8 00010000:00010000:0.0:1788530311.382944:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4863c19/0xb28d70e125751590 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530311.382960:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=519s v=(0 0) 00010000:00010000:0.0:1788530311.382965:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788530311.382971:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4863c19/0xb28d70e125751590 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530311.383007:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4863c19/0xb28d70e125751590 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530311.383019:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4863c19/0xb28d70e125751590 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530311.383025:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e4863c19/0xb28d70e125751590 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530311.383043:0:8438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788530311.383182:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3648:x1875409555857920:12345-0@lo:6:osp-syn-0-0.0 Request processed in 317us (471us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1788530311.383188:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788530311.383201:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788530311.383206:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3648:x1875409555857792:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788530311.383215:0:8438:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00010000:00010000:0.0:1788530311.383228:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8c35e1e/0xb28d70e125751597 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530311.383242:0:8438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ea29484e/0xb28d70e125751344 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b4a expref: 12 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530311.383248:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1788530311.383250:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788530311.383253:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8c35e1e/0xb28d70e125751597 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530311.383285:0:8438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ea29484e/0xb28d70e125751344 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b4a expref: 12 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530311.383298:0:8438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ea29484e/0xb28d70e125751344 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b4a expref: 12 pid: 8438 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530311.383310:0:8438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03693800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8438:1875409555858048:192.168.202.41@tcp:104: 00000100:00100000:0.0:1788530311.383497:0:8438:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f181430c0 going to sleep for 11 seconds 00010000:00010000:0.0:1788530311.383512:0:10348:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788530311.383517:0:10348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e4863c19/0xb28d70e125751590 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530311.383523:0:10348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d101800 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:0.0:1788530311.383526:0:10348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4863c19/0xb28d70e125751590 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530311.383533:0:10348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4863c19/0xb28d70e125751590 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530311.383549:0:10348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e4863c19/0xb28d70e125751590 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530311.383556:0:10348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4863c19/0xb28d70e125751590 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530311.383675:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530311.383678:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530311.383680:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788530311.383715:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a9f3d2a3b80/2, rc 0, transno 4294967311 00000100:00100000:0.0:1788530311.383721:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555857920:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788530311.387153:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530311.387246:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531677312 00000100:00100000:3.0:1788530311.387257:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531677312 00000100:00100000:3.0:1788530311.387339:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 76 00000100:00100000:3.0:1788530311.387351:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03691880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+13:2400:x1875409531677312:12345-192.168.202.41@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788530311.389775:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530311.389816:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531677440 00000100:00100000:0.0:1788530311.389829:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531677440 00010000:00010000:0.0:1788530311.389874:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ea29484e/0xb28d70e125751344 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b4a expref: 14 pid: 8438 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530311.389933:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 110 00000100:00100000:0.0:1788530311.389946:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03690a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+14:2399:x1875409531677440:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788530311.389966:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788530311.389973:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ea29484e/0xb28d70e125751344 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b4a expref: 14 pid: 8438 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530311.389989:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ea29484e/0xb28d70e125751344 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b4a expref: 14 pid: 8438 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530311.390019:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788530311.390024:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788530311.390031:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d8c35e1e/0xb28d70e125751597 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530311.390057:0:6509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8c35e1e/0xb28d70e125751597 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530311.390080:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788530311.390140:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03690a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+14:2399:x1875409531677440:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 196us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530311.390149:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 110 00010000:00010000:3.0:1788530311.391122:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea29484e/0xb28d70e125751344 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b4a expref: 13 pid: 8438 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530311.391144:0:8438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03693800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8438:1875409555858048:192.168.202.41@tcp:104: 00010000:00010000:3.0:1788530311.391176:0:8438:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d8c35e1e/0xb28d70e125751597 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530311.391207:0:8438:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d8c35e1e/0xb28d70e125751597 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530311.391216:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d8c35e1e/0xb28d70e125751597 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530311.391229:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8c35e1e/0xb28d70e125751597 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.391956:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea200/0xb28d70e12575128e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.391968:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea200/0xb28d70e12575128e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.391976:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea200/0xb28d70e12575128e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.391983:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f012ea200 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:2.0:1788530311.391988:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea200/0xb28d70e12575128e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.392009:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea200/0xb28d70e12575128e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.392030:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9a9f092c5200) 00010000:00010000:2.0:1788530311.392033:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788530311.392039:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea200/0xb28d70e12575128e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.392045:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea200/0xb28d70e12575128e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.392084:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e125751336 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.392091:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e125751336 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.392097:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e125751336 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.392103:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d101c00 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:2.0:1788530311.392106:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e125751336 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.392112:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e125751336 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.392119:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a9f0cf59500) 00010000:00010000:2.0:1788530311.392121:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788530311.392124:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e125751336 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.392141:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101c00/0xb28d70e125751336 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.392162:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100400/0xb28d70e1257513b4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.392168:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100400/0xb28d70e1257513b4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.392173:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100400/0xb28d70e1257513b4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.392177:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d100400 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:2.0:1788530311.392179:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100400/0xb28d70e1257513b4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.392184:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100400/0xb28d70e1257513b4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.392192:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9a9e0241d000) 00010000:00010000:2.0:1788530311.392195:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788530311.392199:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100400/0xb28d70e1257513b4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.392205:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100400/0xb28d70e1257513b4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.392217:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c800/0xb28d70e1257513d7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.392224:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c800/0xb28d70e1257513d7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.392236:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c800/0xb28d70e1257513d7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.392340:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d20c800 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:2.0:1788530311.392344:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c800/0xb28d70e1257513d7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.392352:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c800/0xb28d70e1257513d7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.392361:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9a9e0241d000) 00010000:00010000:2.0:1788530311.392363:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788530311.392367:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c800/0xb28d70e1257513d7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.392458:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c800/0xb28d70e1257513d7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.392477:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101a00/0xb28d70e1257514a9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.392483:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101a00/0xb28d70e1257514a9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.392489:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101a00/0xb28d70e1257514a9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.392495:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d101a00 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:2.0:1788530311.392499:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101a00/0xb28d70e1257514a9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.392515:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101a00/0xb28d70e1257514a9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.392524:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a9f2b995800) 00010000:00010000:2.0:1788530311.392526:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788530311.392529:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101a00/0xb28d70e1257514a9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.392536:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101a00/0xb28d70e1257514a9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.392549:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b400/0xb28d70e125751566 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.392556:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b400/0xb28d70e125751566 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530311.393020:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d8c35e1e/0xb28d70e125751597 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530311.393073:0:8438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788530311.393773:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b400/0xb28d70e125751566 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.393781:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d36b400 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:2.0:1788530311.393786:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b400/0xb28d70e125751566 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.393796:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b400/0xb28d70e125751566 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.393810:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9a9f2b995200) 00010000:00010000:2.0:1788530311.393813:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788530311.393819:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b400/0xb28d70e125751566 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.393843:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b400/0xb28d70e125751566 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788530311.393876:0:6555:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:2.0:1788530311.393989:0:6555:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00010000:00010000:1.0:1788530311.394619:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788530311.394646:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d8c35e1e/0xb28d70e125751597 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530311.394657:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d101600 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:1.0:1788530311.394660:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8c35e1e/0xb28d70e125751597 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530311.394668:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8c35e1e/0xb28d70e125751597 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530311.394686:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d8c35e1e/0xb28d70e125751597 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530311.394694:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d8c35e1e/0xb28d70e125751597 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530311.394715:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530311.394717:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530311.394719:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788530311.395670:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a9f3d2a2a00/2, rc 0, transno 4294967323 00000100:00100000:0.0:1788530311.395694:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555857792:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788530311.395860:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3648:x1875409555857792:12345-0@lo:6:osp-syn-1-0.0 Request processed in 12651us (13096us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1788530311.395871:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000001:00080000:3.0:1788530311.396785:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000001:00080000:3.0:1788530311.396816:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967319 is committed 00000100:00100000:0.0:1788530311.397067:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03691880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+7:2400:x1875409531677312:12345-192.168.202.41@tcp:16:lhsmtool_posix.0 Request processed in 9713us (9921us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530311.397080:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 76 00000100:00100000:0.0:1788530311.401369:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530311.402022:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531677696 00000100:00100000:3.0:1788530311.402035:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531677696 00000100:00100000:3.0:1788530311.402131:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 245 00000100:00100000:3.0:1788530311.402143:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03690380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+21:12482:x1875409531677696:12345-192.168.202.41@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788530311.402226:0:8678:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788530311.402260:0:8678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ebe00/0xb28d70e12575157b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550be4 expref: 21 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530311.402309:0:8678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9a9f2b995200) 00010000:00010000:3.0:1788530311.402315:0:8678:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788530311.402368:0:8678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e12575159e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530311.402823:0:8678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e12575159e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530311.402835:0:8678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e12575159e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788530311.403020:0:8678:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001ad25f47 reply state 0000000022b780fa transno 4294967510 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e12575159e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530311.403036:0:8678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e12575159e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530311.403042:0:8678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9a9f2b995200) 00010000:00010000:3.0:1788530311.403045:0:8678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788530311.403048:0:8678:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788530311.403176:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03690380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+22:12482:x1875409531677696:12345-192.168.202.41@tcp:36:lhsmtool_posix.0 Request processed in 1033us (1859us total) trans 4294967510 rc 0/0 00000100:00100000:3.0:1788530311.403184:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 245 00000100:00100000:3.0:1788530311.409864:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530311.410139:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531677824 00000100:00100000:0.0:1788530311.410152:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531677824 00000100:00100000:0.0:1788530311.410300:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 77 00000100:00100000:0.0:1788530311.410314:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37374700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+7:2399:x1875409531677824:12345-192.168.202.41@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788530311.411203:0:8752:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788530311.411209:0:8752:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1788530309 00002000:00010000:0.0:1788530311.411212:0:8752:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 1788530309 00002000:00010000:0.0:1788530311.411213:0:8752:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1788530310 -> 1788530309 00002000:00010000:0.0:1788530311.411216:0:8752:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1788530311.411345:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37374700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+8:2399:x1875409531677824:12345-192.168.202.41@tcp:2:lhsmtool_posix.0 Request processed in 1032us (1488us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1788530311.411383:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 77 00000100:00100000:0.0:1788530311.415522:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530311.415801:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531678080 00000100:00100000:1.0:1788530311.415813:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531678080 00000100:00100000:0.0:1788530311.416130:0:10719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 246 00000100:00100000:0.0:1788530311.416147:0:10719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03690e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+22:12482:x1875409531678080:12345-192.168.202.41@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788530311.416253:0:10719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e1257515a5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530311.416276:0:10719:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d200/0xb28d70e12575155f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550bd6 expref: 22 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530311.416286:0:10719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e1257515a5 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530311.416554:0:10719:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d200/0xb28d70e12575155f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550bd6 expref: 22 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530311.416718:0:10719:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d200/0xb28d70e12575155f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550bd6 expref: 22 pid: 6525 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530311.416734:0:10719:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03693100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10719:1875409555858176:192.168.202.41@tcp:104: 00000100:00100000:0.0:1788530311.416876:0:10719:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f18143000 going to sleep for 11 seconds 00000100:00100000:0.0:1788530311.424802:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530311.424897:0:10347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531678208 00000100:00100000:1.0:1788530311.424908:0:10347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531678208 00010000:00010000:1.0:1788530311.424964:0:10347:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d200/0xb28d70e12575155f lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550bd6 expref: 23 pid: 6525 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530311.425019:0:10347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 111 00000100:00100000:1.0:1788530311.425030:0:10347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03693480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+23:2400:x1875409531678208:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788530311.425069:0:10347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788530311.425076:0:10347:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d200/0xb28d70e12575155f lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550bd6 expref: 23 pid: 6525 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530311.425092:0:10347:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d200/0xb28d70e12575155f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550bd6 expref: 23 pid: 6525 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530311.425119:0:10347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9a9f2b995200) 00010000:00010000:1.0:1788530311.425125:0:10347:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e1257515a5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530311.425136:0:10347:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e1257515a5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530311.425144:0:10347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e1257515a5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530311.425166:0:10347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788530311.425227:0:10347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03693480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+23:2400:x1875409531678208:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 198us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530311.425234:0:10347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 111 00010000:00010000:3.0:1788530311.425996:0:10719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d200/0xb28d70e12575155f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550bd6 expref: 22 pid: 6525 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530311.426016:0:10719:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03693100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10719:1875409555858176:192.168.202.41@tcp:104: 00010000:00010000:3.0:1788530311.426052:0:10719:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e1257515a5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530311.426061:0:10719:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e1257515a5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530311.426066:0:10719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e1257515a5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530311.426108:0:10719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e1257515a5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530311.426115:0:10719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e1257515a5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530311.426121:0:10719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e1257515a5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530311.426128:0:10719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d100c00 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:3.0:1788530311.426133:0:10719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e1257515a5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530311.426140:0:10719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e1257515a5 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530311.426151:0:10719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9a9f2b995200) 00010000:00010000:3.0:1788530311.426154:0:10719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788530311.426157:0:10719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e1257515a5 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530311.426163:0:10719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100c00/0xb28d70e1257515a5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10719 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530311.426236:0:10719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03690e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+21:12482:x1875409531678080:12345-192.168.202.41@tcp:55:lhsmtool_posix.0 Request processed in 10094us (10731us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788530311.426244:0:10719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 246 00000100:00100000:0.0:1788530311.436258:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530311.437226:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531678336 00000100:00100000:3.0:1788530311.437246:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531678336 00000100:00100000:2.0:1788530311.441754:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 78 00000100:00100000:2.0:1788530311.441771:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03690700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+8:2399:x1875409531678336:12345-192.168.202.41@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788530311.441818:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000057aa8d09/0xb28d70e1257515ac lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.441850:0:8438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c36de4c8/0xb28d70e125751589 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550bf2 expref: 8 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.441859:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788530311.441863:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788530311.441868:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000057aa8d09/0xb28d70e1257515ac lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.441905:0:8438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c36de4c8/0xb28d70e125751589 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550bf2 expref: 8 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.441920:0:8438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c36de4c8/0xb28d70e125751589 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550bf2 expref: 8 pid: 8439 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530311.441934:0:8438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03765f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8438:1875409555858304:192.168.202.41@tcp:104: 00000100:00100000:2.0:1788530311.442193:0:8438:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f33e24240 going to sleep for 11 seconds 00000100:00100000:1.0:1788530311.445218:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530311.445604:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531678464 00000100:00100000:0.0:1788530311.445613:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531678464 00010000:00010000:0.0:1788530311.445663:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c36de4c8/0xb28d70e125751589 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550bf2 expref: 9 pid: 8439 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530311.445721:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 112 00000100:00100000:0.0:1788530311.445733:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d81f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+9:2400:x1875409531678464:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788530311.445749:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788530311.445771:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c36de4c8/0xb28d70e125751589 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550bf2 expref: 9 pid: 8439 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530311.445787:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c36de4c8/0xb28d70e125751589 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550bf2 expref: 9 pid: 8439 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530311.445811:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788530311.445815:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788530311.445834:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000057aa8d09/0xb28d70e1257515ac lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530311.445845:0:6509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000057aa8d09/0xb28d70e1257515ac lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530311.445866:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788530311.445922:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d81f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+9:2400:x1875409531678464:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 190us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530311.445930:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 112 00010000:00010000:2.0:1788530311.446789:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c36de4c8/0xb28d70e125751589 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550bf2 expref: 8 pid: 8439 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530311.446805:0:8438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03765f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8438:1875409555858304:192.168.202.41@tcp:104: 00010000:00010000:2.0:1788530311.446894:0:8438:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000057aa8d09/0xb28d70e1257515ac lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.446906:0:8438:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000057aa8d09/0xb28d70e1257515ac lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.446914:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000057aa8d09/0xb28d70e1257515ac lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.446936:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000057aa8d09/0xb28d70e1257515ac lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.446944:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000057aa8d09/0xb28d70e1257515ac lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.447010:0:8438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000057aa8d09/0xb28d70e1257515ac lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.447020:0:8438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d20c800 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:2.0:1788530311.447025:0:8438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000057aa8d09/0xb28d70e1257515ac lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.447049:0:8438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000057aa8d09/0xb28d70e1257515ac lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.447063:0:8438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000057aa8d09/0xb28d70e1257515ac lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.447071:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000057aa8d09/0xb28d70e1257515ac lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530311.447178:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03690700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+7:2399:x1875409531678336:12345-192.168.202.41@tcp:1:lhsmtool_posix.0 Request processed in 5411us (10931us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530311.447187:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 78 00000100:00100000:1.0:1788530311.454095:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530311.454351:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531678720 00000100:00100000:3.0:1788530311.454365:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531678720 00000100:00100000:0.0:1788530311.455196:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 247 00000100:00100000:0.0:1788530311.455213:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+21:12482:x1875409531678720:12345-192.168.202.41@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788530311.455355:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101a00/0xb28d70e1257515b3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530311.456094:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ca00/0xb28d70e1257514a2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b9e expref: 21 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530311.456108:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101a00/0xb28d70e1257515b3 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530311.456155:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ca00/0xb28d70e1257514a2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b9e expref: 21 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530311.456173:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ca00/0xb28d70e1257514a2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b9e expref: 21 pid: 6523 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530311.456194:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03691f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6523:1875409555858432:192.168.202.41@tcp:104: 00000100:00100000:0.0:1788530311.456323:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f181439c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788530311.460208:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530311.460339:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03691f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6523:1875409555858432:192.168.202.41@tcp:104: 00010000:00010000:0.0:1788530311.460479:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101a00/0xb28d70e1257515b3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530311.461501:0:10347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531678848 00000100:00100000:2.0:1788530311.461511:0:10347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531678848 00010000:00010000:2.0:1788530311.461714:0:10347:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ca00/0xb28d70e1257514a2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b9e expref: 22 pid: 6523 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530311.461764:0:10347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 113 00000100:00100000:2.0:1788530311.461777:0:10347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d81500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+22:2400:x1875409531678848:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788530311.461796:0:10347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788530311.461805:0:10347:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ca00/0xb28d70e1257514a2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b9e expref: 22 pid: 6523 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.461819:0:10347:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ca00/0xb28d70e1257514a2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b9e expref: 22 pid: 6523 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.461881:0:10347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ca00/0xb28d70e1257514a2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b9e expref: 22 pid: 6523 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.461899:0:10347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a9f2b995800) 00010000:00010000:2.0:1788530311.461905:0:10347:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d400/0xb28d70e125751504 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550bc1 expref: 21 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.461916:0:10347:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101a00/0xb28d70e1257515b3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.461925:0:10347:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101a00/0xb28d70e1257515b3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.461934:0:10347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101a00/0xb28d70e1257515b3 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.461968:0:10347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788530311.462040:0:10347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d81500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+21:2400:x1875409531678848:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 266us (1849us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530311.462048:0:10347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 113 00010000:00010000:0.0:1788530311.462483:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101a00/0xb28d70e1257515b3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530311.462493:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101a00/0xb28d70e1257515b3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530311.463705:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100400/0xb28d70e1257515ba lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530311.463728:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb000/0xb28d70e12575156d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550bdd expref: 21 pid: 10719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530311.463748:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100400/0xb28d70e1257515ba lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530311.463790:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb000/0xb28d70e12575156d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550bdd expref: 21 pid: 10719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530311.463805:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb000/0xb28d70e12575156d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550bdd expref: 21 pid: 10719 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530311.463819:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03691f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6523:1875409555858560:192.168.202.41@tcp:104: 00000100:00100000:0.0:1788530311.463920:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f18143180 going to sleep for 11 seconds 00000100:00100000:0.0:1788530311.468939:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530311.469082:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03691f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6523:1875409555858560:192.168.202.41@tcp:104: 00000100:00100000:1.0:1788530311.469110:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531678976 00000100:00100000:1.0:1788530311.469122:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531678976 00010000:00010000:2.0:1788530311.469123:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100400/0xb28d70e1257515ba lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530311.469176:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb000/0xb28d70e12575156d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550bdd expref: 22 pid: 10719 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530311.469507:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 114 00000100:00100000:1.0:1788530311.469521:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03692d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+22:2399:x1875409531678976:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788530311.469541:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788530311.469550:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb000/0xb28d70e12575156d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550bdd expref: 22 pid: 10719 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530311.472950:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb000/0xb28d70e12575156d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550bdd expref: 22 pid: 10719 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530311.472989:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb000/0xb28d70e12575156d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550bdd expref: 22 pid: 10719 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530311.473007:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9a9f2b995200) 00010000:00010000:1.0:1788530311.473012:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100400/0xb28d70e1257515ba lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530311.473032:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100400/0xb28d70e1257515ba lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530311.473039:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100400/0xb28d70e1257515ba lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530311.473087:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788530311.473170:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03692d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+21:2399:x1875409531678976:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 3651us (4240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530311.473183:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 114 00010000:00010000:2.0:1788530311.473307:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100400/0xb28d70e1257515ba lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.473318:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100400/0xb28d70e1257515ba lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788530311.473455:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:2.0:1788530311.473689:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000001:00080000:2.0:1788530311.473727:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:2.0:1788530311.473818:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03765f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6523:1875409555858688:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788530311.473889:0:6523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530311.473926:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f33e246c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788530311.474951:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555858688 00000100:00100000:1.0:1788530311.474981:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555858688 00000100:00100000:1.0:1788530311.475184:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1788530311.475199:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03767480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6523:x1875409555858688:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788530311.475409:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03767480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6523:x1875409555858688:12345-0@lo:1000:mdt00_000.0 Request processed in 213us (1518us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530311.475415:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1788530311.475497:0:6523:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967319 gen 2 00000004:00080000:2.0:1788530311.475506:0:6523:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967319 committed transno 4294967319 00000100:00100000:2.0:1788530311.475545:0:6523:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9a9f3d2a2a00 x1875409555857792/t4294967323(4294967323) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788530327 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530311.475584:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03765f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6523:1875409555858688:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1788530311.475770:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967514 00000100:00100000:2.0:1788530311.475863:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03765f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6523:1875409555858816:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788530311.475902:0:6523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530311.476006:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f33e24780 going to sleep for 11 seconds 00000100:00100000:3.0:1788530311.476465:0:14186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555858816 00000100:00100000:3.0:1788530311.476472:0:14186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555858816 00000100:00100000:3.0:1788530311.476555:0:14186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1788530311.476590:0:14186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03765c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6523:x1875409555858816:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788530311.476744:0:14186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03765c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6523:x1875409555858816:12345-0@lo:1000:mdt00_000.0 Request processed in 157us (841us total) trans 4294967325 rc 0/0 00000100:00100000:3.0:1788530311.476752:0:14186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1788530311.476844:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03765f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6523:1875409555858816:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1788530311.476891:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100400/0xb28d70e1257515ba lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530311.476902:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100400/0xb28d70e1257515ba lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530311.476911:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100400/0xb28d70e1257515ba lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530311.476919:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d100400 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:0.0:1788530311.476925:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100400/0xb28d70e1257515ba lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530311.476939:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100400/0xb28d70e1257515ba lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530311.476979:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9a9f2b995200) 00010000:00010000:0.0:1788530311.476982:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788530311.476987:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100400/0xb28d70e1257515ba lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530311.476994:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100400/0xb28d70e1257515ba lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530311.477020:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ce00/0xb28d70e1257514fd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530311.477025:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ce00/0xb28d70e1257514fd lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530311.477031:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ce00/0xb28d70e1257514fd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530311.477036:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d20ce00 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:0.0:1788530311.477039:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ce00/0xb28d70e1257514fd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530311.477045:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ce00/0xb28d70e1257514fd lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530311.477052:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a9f2b995800) 00010000:00010000:0.0:1788530311.477054:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788530311.477062:0:6523:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d400/0xb28d70e125751504 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550bc1 expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530311.477073:0:6523:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d400/0xb28d70e125751504 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550bc1 expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530311.477090:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d400/0xb28d70e125751504 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550bc1 expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530311.477120:0:6523:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d400/0xb28d70e125751504 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550bc1 expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530311.477132:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03691500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6523:1875409555858944:192.168.202.41@tcp:105: 00000100:00100000:0.0:1788530311.477194:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f18143b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788530311.487174:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03691500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6523:1875409555858944:192.168.202.41@tcp:105: 00010000:00010000:2.0:1788530311.487208:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ce00/0xb28d70e1257514fd lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.487220:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ce00/0xb28d70e1257514fd lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.487256:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ca00/0xb28d70e1257515c1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.487271:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ca00/0xb28d70e1257515c1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.487302:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ca00/0xb28d70e1257515c1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.487314:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ca00/0xb28d70e1257515c1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.487321:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ca00/0xb28d70e1257515c1 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.487329:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ca00/0xb28d70e1257515c1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.487334:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d20ca00 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:2.0:1788530311.487339:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ca00/0xb28d70e1257515c1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.487346:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ca00/0xb28d70e1257515c1 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.487358:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a9f2b995800) 00010000:00010000:2.0:1788530311.487361:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788530311.487365:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ca00/0xb28d70e1257515c1 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530311.488062:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530311.488166:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531679104 00000100:00100000:1.0:1788530311.488176:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531679104 00000100:00100000:1.0:1788530311.488237:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 61 00000100:00100000:1.0:1788530311.488258:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f06270a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+25:12481:x1875409531679104:12345-192.168.202.41@tcp:49:lfs.0 00000100:00100000:1.0:1788530311.488420:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f06270a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+25:12481:x1875409531679104:12345-192.168.202.41@tcp:49:lfs.0 Request processed in 163us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530311.488429:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 61 00010000:00010000:2.0:1788530311.488805:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ca00/0xb28d70e1257515c1 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.488837:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101a00/0xb28d70e1257515b3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.488844:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101a00/0xb28d70e1257515b3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.488863:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101a00/0xb28d70e1257515b3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.488870:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d101a00 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:2.0:1788530311.488874:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101a00/0xb28d70e1257515b3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.488883:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101a00/0xb28d70e1257515b3 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.488909:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a9f2b995800) 00010000:00010000:2.0:1788530311.488912:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788530311.488918:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101a00/0xb28d70e1257515b3 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.488924:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101a00/0xb28d70e1257515b3 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530311.489555:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+24:12482:x1875409531678720:12345-192.168.202.41@tcp:57:lhsmtool_posix.0 Request processed in 34341us (35468us total) trans 4294967515 rc 0/0 00000040:00080000:1.0:1788530311.489899:0:13811:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788530311.489904:0:13811:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:2.0:1788530311.490315:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 247 00000020:00080000:2.0:1788530311.490333:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788530311.490480:0:13811:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1788530311.490489:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788530311.494172:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530311.495645:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531679360 00000100:00100000:1.0:1788530311.495665:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531679360 00000100:00100000:1.0:1788530311.495767:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 248 00000100:00100000:1.0:1788530311.495780:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03690000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+24:12481:x1875409531679360:12345-192.168.202.41@tcp:58:lfs.0 00000100:00100000:2.0:1788530311.496302:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530311.496695:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531679616 00000100:00100000:3.0:1788530311.496704:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531679616 00000100:00100000:3.0:1788530311.496753:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 62 00000100:00100000:3.0:1788530311.496762:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f39598c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+25:12482:x1875409531679616:12345-192.168.202.41@tcp:35:lhsmtool_posix.0 00000040:00080000:1.0:1788530311.497138:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000004:00080000:3.0:1788530311.497303:0:6526:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000100:00100000:1.0:1788530311.497452:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03690000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+26:12481:x1875409531679360:12345-192.168.202.41@tcp:58:lfs.0 Request processed in 1673us (3295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530311.497461:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 248 00000001:00080000:3.0:1788530311.499220:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967516 00010000:00010000:3.0:1788530311.499313:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e1257515c8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530311.500032:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e1257515c8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530311.500051:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e1257515c8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530311.500082:0:6526:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e1257515c8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530311.500090:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e1257515c8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530311.500097:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e1257515c8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.503432:0:6526:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788530311.503661:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f39598c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+26:12482:x1875409531679616:12345-192.168.202.41@tcp:35:lhsmtool_posix.0 Request processed in 6890us (7352us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1788530311.503675:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 62 00000020:00080000:2.0:1788530311.503682:0:6526:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788530311.504737:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788530311.504753:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e1257515c8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530311.504766:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d36b800 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:3.0:1788530311.504772:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e1257515c8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530311.504784:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e1257515c8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530311.504808:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9a9f2b995200) 00010000:00010000:3.0:1788530311.504811:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788530311.504817:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e1257515c8 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530311.504882:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e1257515c8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.505184:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530311.505223:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530311.505226:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788530311.535859:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530311.536260:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531679744 00000100:00100000:3.0:1788530311.536280:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531679744 00000100:00100000:3.0:1788530311.536529:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 249 00000100:00100000:3.0:1788530311.536558:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03764e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+26:12484:x1875409531679744:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:2.0:1788530311.537011:0:10720:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530311.537039:0:10720:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ce00/0xb28d70e1257515cf lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550bf9 expref: -99 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.537119:0:10720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e1257515d6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.537137:0:10720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e1257515d6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.537151:0:10720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e1257515d6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.537168:0:10720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c200/0xb28d70e1257515dd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.537176:0:10720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c200/0xb28d70e1257515dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.537183:0:10720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c200/0xb28d70e1257515dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.537280:0:10720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20cc00/0xb28d70e1257515e4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.537292:0:10720:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100000/0xb28d70e1257514ef lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550bba expref: 27 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.537302:0:10720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20cc00/0xb28d70e1257515e4 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.537706:0:10720:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100000/0xb28d70e1257514ef lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550bba expref: 27 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530311.537725:0:10720:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100000/0xb28d70e1257514ef lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550bba expref: 27 pid: 8678 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530311.537740:0:10720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03767800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:10720:1875409555859072:192.168.202.41@tcp:104: 00000100:00100000:2.0:1788530311.537876:0:10720:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f07d236c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788530311.542087:0:10720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03767800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:10720:1875409555859072:192.168.202.41@tcp:104: 00010000:00010000:2.0:1788530311.542120:0:10720:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20cc00/0xb28d70e1257515e4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530311.544812:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530311.545516:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531680000 00000100:00100000:0.0:1788530311.545530:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531680000 00000100:00100000:0.0:1788530311.546248:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 63 00000100:00100000:0.0:1788530311.546260:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03767800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+28:6176:x1875409531680000:12345-192.168.202.41@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788530311.547210:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03767800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+29:6176:x1875409531680000:12345-192.168.202.41@tcp:35:ldlm_bl.0 Request processed in 946us (2403us total) trans 4294967518 rc 0/0 00000100:00100000:0.0:1788530311.547221:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 63 00000100:00100000:0.0:1788530311.550089:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530311.550285:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531680128 00000100:00100000:3.0:1788530311.550296:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531680128 00010000:00010000:3.0:1788530311.550348:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100000/0xb28d70e1257514ef lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550bba expref: 29 pid: 8678 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530311.550553:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 115 00000100:00100000:3.0:1788530311.550602:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03693b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+29:2399:x1875409531680128:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788530311.550618:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788530311.550625:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100000/0xb28d70e1257514ef lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550bba expref: 29 pid: 8678 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530311.550649:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100000/0xb28d70e1257514ef lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550bba expref: 29 pid: 8678 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530311.550677:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100000/0xb28d70e1257514ef lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550bba expref: 29 pid: 8678 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530311.550695:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a9f2b995800) 00010000:00010000:3.0:1788530311.550701:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20cc00/0xb28d70e1257515e4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530311.550711:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20cc00/0xb28d70e1257515e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530311.550719:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20cc00/0xb28d70e1257515e4 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530311.550871:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788530311.550994:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03693b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+28:2399:x1875409531680128:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 394us (916us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530311.551002:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 115 00010000:00010000:1.0:1788530311.556229:0:10720:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20cc00/0xb28d70e1257515e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530311.556297:0:10720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20cc00/0xb28d70e1257515e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788530311.556606:0:10720:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788530311.556613:0:10720:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788530311.556654:0:10720:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20cc00/0xb28d70e1257515e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530311.556672:0:10720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20cc00/0xb28d70e1257515e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530311.556683:0:10720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e1257515d6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530311.556691:0:10720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e1257515d6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530311.556700:0:10720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e1257515d6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530311.556707:0:10720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d20c000 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:1.0:1788530311.556712:0:10720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e1257515d6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530311.556720:0:10720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e1257515d6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530311.556739:0:10720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a9f2b995b00) 00010000:00010000:1.0:1788530311.556742:0:10720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788530311.556749:0:10720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e1257515d6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530311.556767:0:10720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c000/0xb28d70e1257515d6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530311.556792:0:10720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c200/0xb28d70e1257515dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530311.556798:0:10720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c200/0xb28d70e1257515dd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530311.556804:0:10720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c200/0xb28d70e1257515dd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530311.556810:0:10720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d20c200 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:1.0:1788530311.556813:0:10720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c200/0xb28d70e1257515dd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530311.556819:0:10720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c200/0xb28d70e1257515dd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530311.556840:0:10720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9a9f2b995d00) 00010000:00010000:1.0:1788530311.556842:0:10720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788530311.556846:0:10720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c200/0xb28d70e1257515dd lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530311.556851:0:10720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c200/0xb28d70e1257515dd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530311.557193:0:10720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ce00/0xb28d70e1257515cf lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550bf9 expref: 28 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530311.557230:0:10720:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20cc00/0xb28d70e1257515e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550bf9 expref: 27 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530311.557239:0:10720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a9f2b995800) 00010000:00010000:1.0:1788530311.557242:0:10720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788530311.557245:0:10720:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d20cc00, rc 0) 00000100:00100000:1.0:1788530311.557605:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03764e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+27:12484:x1875409531679744:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 21047us (21758us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530311.557616:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 249 00000100:00100000:0.0:1788530312.166864:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530312.166912:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530312.166932:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530312.166958:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530312.166978:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530312.167001:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530312.167033:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531680256 00000100:00100000:0.0:1788530312.167046:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531680256 00000100:00100000:0.0:1788530312.167122:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 451 00000100:00100000:0.0:1788530312.167134:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f442bcd-b742-4e76-ad7b-709f731358a0+14:2401:x1875409531680256:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1788530312.167230:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f442bcd-b742-4e76-ad7b-709f731358a0+14:2401:x1875409531680256:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 98us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530312.167238:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 451 00000100:00100000:0.0:1788530312.167289:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531680640 00000100:00100000:0.0:1788530312.167293:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531680640 00000100:00100000:0.0:1788530312.167323:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531680512 00000100:00100000:0.0:1788530312.167326:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531680512 00000100:00100000:0.0:1788530312.167494:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 119 00000100:00100000:0.0:1788530312.167502:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03692a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+7:2401:x1875409531680640:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1788530312.167536:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03692a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+7:2401:x1875409531680640:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 36us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530312.167543:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 119 00000100:00100000:0.0:1788530312.167555:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 120 00000100:00100000:0.0:1788530312.167590:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03692680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2401:x1875409531680512:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1788530312.167613:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03692680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2401:x1875409531680512:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 53us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530312.167619:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 120 00000100:00080000:0.0:1788530312.167647:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788530312.167722:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531680384 00000100:00100000:3.0:1788530312.167726:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531680384 00000100:00100000:3.0:1788530312.167768:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531680896 00000100:00100000:3.0:1788530312.167771:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531680896 00000100:00100000:3.0:1788530312.167786:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531680768 00000100:00100000:3.0:1788530312.167788:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531680768 00000100:00100000:3.0:1788530312.167807:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 408 00000100:00100000:3.0:1788530312.167813:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03691180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2401:x1875409531680384:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1788530312.167839:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03691180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2401:x1875409531680384:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 27us (984us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530312.167845:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 408 00000100:00100000:3.0:1788530312.167858:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 409 00000100:00100000:3.0:1788530312.167863:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03691c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2401:x1875409531680896:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1788530312.167880:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03691c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2401:x1875409531680896:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 17us (947us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530312.167886:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 409 00000100:00100000:3.0:1788530312.167904:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 410 00000100:00100000:3.0:1788530312.167911:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03691500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2401:x1875409531680768:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1788530312.167929:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03691500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2401:x1875409531680768:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 20us (928us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530312.167935:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 410 00000100:00080000:3.0:1788530312.167967:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788530312.167970:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788530312.256909:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555859200:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788530312.257031:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530312.257262:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555859200 00000100:00100000:3.0:1788530312.257276:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555859200 00000100:00100000:3.0:1788530312.257378:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1788530312.257390:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03766a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555859200:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788530312.257436:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446453248 avail 1300213760 00000100:00100000:3.0:1788530312.258457:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03766a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555859200:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1061us (1419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530312.258475:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1788530312.258797:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555859200:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788530312.386857:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788530312.513760:0:13811:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788530312.513777:0:13811:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788530312.513849:0:13811:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788530312.513859:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788530312.514236:0:13811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d83100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13811:1875409555859328:192.168.202.41@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788530312.514398:0:13811:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f3740c900 going to sleep for 11 seconds 00000100:00100000:0.0:1788530312.529544:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530312.529602:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531681024 00000100:00100000:0.0:1788530312.529614:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531681024 00000100:00100000:0.0:1788530312.529722:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 250 00000100:00100000:0.0:1788530312.529734:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03691f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+28:12495:x1875409531681024:12345-192.168.202.41@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788530312.529781:0:6525:0:(mdt_handler.c:7977:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788530312.529915:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03691f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+28:12495:x1875409531681024:12345-192.168.202.41@tcp:53:lhsmtool_posix.0 Request processed in 183us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530312.529923:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 250 00000100:00100000:1.0:1788530312.531712:0:13811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d83100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13811:1875409555859328:192.168.202.41@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788530312.548181:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530312.548379:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531681280 00000100:00100000:2.0:1788530312.548393:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531681280 00000100:00100000:2.0:1788530312.548483:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 251 00000100:00100000:2.0:1788530312.548495:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03693100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+27:12495:x1875409531681280:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788530312.548517:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530312.548549:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ce00/0xb28d70e1257515eb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550c00 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530312.548955:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c200/0xb28d70e1257515f2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530312.548983:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c200/0xb28d70e1257515f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530312.549001:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c200/0xb28d70e1257515f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788530312.549029:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788530312.549226:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20ce00/0xb28d70e1257515eb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550c00 expref: 30 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530312.549251:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c200/0xb28d70e1257515f2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550c00 expref: 29 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530312.549261:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a9f2b995800) 00010000:00010000:2.0:1788530312.549264:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788530312.549269:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d20c200, rc 0) 00000100:00100000:2.0:1788530312.549476:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03693100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+29:12495:x1875409531681280:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 982us (1307us total) trans 4294967519 rc 0/0 00000100:00100000:2.0:1788530312.549484:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 251 00000100:00100000:3.0:1788530312.558303:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530312.558953:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531681408 00000100:00100000:1.0:1788530312.558971:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531681408 00000100:00100000:1.0:1788530312.559064:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 16 00000100:00100000:1.0:1788530312.559079:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f08d7f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+29:2399:x1875409531681408:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788530312.559105:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788530312.559147:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c200/0xb28d70e1257515f2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550c00 expref: 29 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530312.559174:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a9f2b995800) 00010000:00010000:1.0:1788530312.559190:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788530312.559286:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f08d7f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+28:2399:x1875409531681408:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 210us (998us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530312.559295:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 16 00000100:00100000:2.0:1788530312.578250:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530312.578452:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531681664 00000100:00100000:3.0:1788530312.578464:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531681664 00000100:00100000:3.0:1788530312.578646:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 252 00000100:00100000:3.0:1788530312.578659:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03766300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+28:12495:x1875409531681664:12345-192.168.202.41@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788530312.578760:0:10720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e125751600 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530312.578785:0:10720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e125751600 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530312.578800:0:10720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e125751600 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530312.579114:0:10720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e125751600 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530312.579123:0:10720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e125751600 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530312.579130:0:10720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e125751600 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530312.579152:0:10720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d36b800 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:3.0:1788530312.579158:0:10720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e125751600 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530312.579168:0:10720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e125751600 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530312.579184:0:10720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a9f2b995800) 00010000:00010000:3.0:1788530312.579187:0:10720:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788530312.579193:0:10720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e125751600 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530312.579199:0:10720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e125751600 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10720 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530312.579374:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03766300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+29:12495:x1875409531681664:12345-192.168.202.41@tcp:57:lhsmtool_posix.0 Request processed in 708us (1131us total) trans 4294967520 rc 0/0 00000100:00100000:3.0:1788530312.579383:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 252 00000040:00080000:0.0:1788530312.579512:0:13811:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788530312.579518:0:13811:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788530312.580343:0:13811:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1788530312.580367:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788530312.587863:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530312.588023:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531681920 00000100:00100000:0.0:1788530312.588035:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531681920 00000100:00100000:0.0:1788530312.588100:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 64 00000100:00100000:0.0:1788530312.588111:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03767100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+29:12495:x1875409531681920:12345-192.168.202.41@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788530312.588336:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03767100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+30:12495:x1875409531681920:12345-192.168.202.41@tcp:35:lhsmtool_posix.0 Request processed in 226us (483us total) trans 4294967521 rc 0/0 00000100:00100000:0.0:1788530312.588344:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 64 00000040:00080000:3.0:1788530312.635348:0:14775:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788530312.635363:0:14775:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788530312.635403:0:14775:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788530312.635410:0:14775:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788530312.903849:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530312.904007:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531682176 00000100:00100000:3.0:1788530312.904022:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531682176 00000100:00100000:3.0:1788530312.904136:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 253 00000100:00100000:3.0:1788530312.904151:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03693800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+30:12508:x1875409531682176:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:3.0:1788530312.904188:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788530312.904223:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e125751607 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550c07 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530312.904400:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b000/0xb28d70e12575160e lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530312.904422:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b000/0xb28d70e12575160e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530312.904438:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b000/0xb28d70e12575160e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788530312.904451:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788530312.904721:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b800/0xb28d70e125751607 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550c07 expref: 33 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530312.904742:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b000/0xb28d70e12575160e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550c07 expref: 32 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530312.904753:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a9f2b995800) 00010000:00010000:3.0:1788530312.904757:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788530312.904761:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d36b000, rc 0) 00000100:00100000:3.0:1788530312.904918:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03693800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+32:12508:x1875409531682176:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 770us (1088us total) trans 4294967522 rc 0/0 00000100:00100000:3.0:1788530312.904926:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 253 00000100:00100000:2.0:1788530312.918776:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530312.919159:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531682304 00000100:00100000:2.0:1788530312.919172:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531682304 00000100:00100000:2.0:1788530312.919246:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 254 00000100:00100000:2.0:1788530312.919257:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03765880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+32:12508:x1875409531682304:12345-192.168.202.41@tcp:54:lfs.0 00010000:00010000:2.0:1788530312.919327:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c800/0xb28d70e12575161c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530312.919356:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c800/0xb28d70e12575161c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530312.919368:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c800/0xb28d70e12575161c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530312.919405:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c800/0xb28d70e12575161c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530312.919412:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c800/0xb28d70e12575161c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530312.919420:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c800/0xb28d70e12575161c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530312.919426:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d20c800 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:2.0:1788530312.919430:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c800/0xb28d70e12575161c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530312.919437:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c800/0xb28d70e12575161c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530312.919448:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a9f2b995800) 00010000:00010000:2.0:1788530312.919467:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788530312.919473:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c800/0xb28d70e12575161c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530312.919480:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c800/0xb28d70e12575161c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530312.919593:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03765880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+32:12508:x1875409531682304:12345-192.168.202.41@tcp:54:lfs.0 Request processed in 338us (831us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530312.919608:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 254 00000100:00100000:1.0:1788530313.038704:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530313.039196:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531682432 00000100:00100000:0.0:1788530313.039207:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531682432 00000100:00100000:0.0:1788530313.039312:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 79 00000100:00100000:0.0:1788530313.039322:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+7:2399:x1875409531682432:12345-192.168.202.41@tcp:101:cat.0 00010000:00010000:0.0:1788530313.039341:0:8752:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530313.039365:0:8752:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c27f05a2/0xb28d70e125751623 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550c0e expref: -99 pid: 8752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788530313.039399:0:8752:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 13, mtime: 0x6a9ace85, atime: 0x6a9ace85, ctime: 0x6a9ace85, blocks: 0x8 00010000:00010000:0.0:1788530313.039444:0:8752:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=520s v=(0 0) 00010000:00010000:0.0:1788530313.039449:0:8752:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788530313.039460:0:8752:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c27f05a2/0xb28d70e125751623 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550c0e expref: 8 pid: 8752 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530313.039479:0:8752:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c27f05a2/0xb28d70e125751623 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550c0e expref: 8 pid: 8752 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530313.039493:0:8752:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d100400, rc 0) 00000100:00100000:0.0:1788530313.039548:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+8:2399:x1875409531682432:12345-192.168.202.41@tcp:101:cat.0 Request processed in 229us (856us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530313.039553:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 79 00000100:00080000:3.0:1788530313.040008:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788530313.043475:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530313.043531:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531682560 00000100:00100000:0.0:1788530313.043543:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531682560 00002000:00100000:0.0:1788530313.043631:0:8443:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff9a9e03764700 x1875409531682560/t0(0) o3->aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41@192.168.202.41@tcp:254/0 lens 488/0 e 0 to 0 dl 1788530324 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788530313.043643:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a9e03764700 with x1875409531682560 ext(0->4095) 00002000:00010000:0.0:1788530313.043649:0:8443:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a9e03764700 00000100:00100000:0.0:1788530313.043684:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 8 00000100:00100000:0.0:1788530313.043696:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03764700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+8:2401:x1875409531682560:12345-192.168.202.41@tcp:3:cat.0 00000100:00100000:0.0:1788530313.046899:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03764700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+8:2401:x1875409531682560:12345-192.168.202.41@tcp:3:cat.0 Request processed in 3191us (3426us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1788530313.046916:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 8 00002000:00100000:0.0:1788530313.046931:0:8443:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff9a9e03764700 x1875409531682560/t0(0) o3->aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41@192.168.202.41@tcp:254/0 lens 488/4536 e 0 to 0 dl 1788530324 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788530313.046963:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a9e03764700 with x1875409531682560 ext(0->4095) 00002000:00010000:0.0:1788530313.046970:0:8443:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a9e03764700 00010000:00010000:1.0:1788530313.411257:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530314.432807:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788530315.393536:0:13816:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788530315.465480:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788530315.663254:0:13811:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788530315.663263:0:13811:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788530315.663293:0:13811:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788530315.663302:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788530315.842031:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788530315.842069:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03690a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555859456:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788530315.842169:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530315.846304:0:14186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555859456 00000100:00100000:3.0:1788530315.846334:0:14186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555859456 00000100:00100000:3.0:1788530315.846464:0:14186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1788530315.846480:0:14186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03693480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555859456:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788530315.846650:0:14186:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1788530315.846746:0:14186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03693480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555859456:12345-0@lo:41:osp-pre-0-1.0 Request processed in 269us (4578us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530315.846755:0:14186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1788530315.846818:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03690a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555859456:0@lo:41:osp-pre-0-1.0 00000001:00080000:1.0:1788530315.847202:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000100:00100000:2.0:1788530316.359862:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555859584:0@lo:13:osp-pre-1-1.0 00000004:00080000:1.0:1788530316.359879:0:9907:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 524262317073ns, next at 525262314453ns, rc = 0 00000100:00100000:2.0:1788530316.359934:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530316.359982:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555859712:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788530316.359982:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3649:1875409555859968:0@lo:400:kworker.0 00000100:00100000:2.0:1788530316.360003:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530316.360012:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530316.360034:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555860480:0@lo:400:kworker.0 00000100:00100000:1.0:1788530316.360057:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530316.360075:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555860992:0@lo:400:kworker.0 00000100:00100000:1.0:1788530316.360099:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530316.360136:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788530316.360141:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875409555860096:0@lo:400:kworker.0 00000100:00100000:0.0:1788530316.360143:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555859840:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788530316.360168:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530316.360178:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530316.360186:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875409555860352:0@lo:400:kworker.0 00000100:00100000:1.0:1788530316.360193:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875409555860608:0@lo:400:kworker.0 00000100:00100000:0.0:1788530316.360207:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530316.360222:0:9912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555859584 00000100:00100000:0.0:1788530316.360224:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555860864:0@lo:400:kworker.0 00000100:00100000:1.0:1788530316.360229:0:9912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555859584 00000100:00100000:0.0:1788530316.360242:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530316.360255:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555861376:0@lo:400:kworker.0 00000100:00100000:1.0:1788530316.360281:0:9912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555859712 00000100:00100000:0.0:1788530316.360283:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530316.360284:0:9912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555859712 00000100:00100000:1.0:1788530316.360299:0:9912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555859840 00000100:00100000:0.0:1788530316.360301:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788530316.360306:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555860224:0@lo:400:kworker.0 00000100:00100000:1.0:1788530316.360309:0:9912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555859840 00000100:00100000:0.0:1788530316.360327:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530316.360343:0:9912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788530316.360343:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875409555860736:0@lo:400:kworker.0 00000100:00100000:1.0:1788530316.360351:0:9912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37375180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555859584:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788530316.360361:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530316.360375:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875409555861248:0@lo:400:kworker.0 00002000:00000024:1.0:1788530316.360380:0:9912:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788530316.360391:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530316.360415:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555860096 00000100:00100000:1.0:1788530316.360416:0:9912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37375180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555859584:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530316.360418:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555860096 00000100:00100000:1.0:1788530316.360423:0:9912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788530316.360439:0:9912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788530316.360444:0:9912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37376680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555859712:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788530316.360458:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555860352 00002000:00000024:1.0:1788530316.360459:0:9912:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788530316.360466:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555860352 00000100:00100000:1.0:1788530316.360483:0:9912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37376680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555859712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 39us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530316.360487:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555860736 00000100:00100000:1.0:1788530316.360489:0:9912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788530316.360489:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555860736 00000100:00100000:1.0:1788530316.360499:0:9912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788530316.360502:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555861248 00000100:00100000:1.0:1788530316.360504:0:9912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03692d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1875409555859840:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788530316.360504:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555861248 00002000:00000024:1.0:1788530316.360512:0:9912:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788530316.360538:0:9912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03692d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1875409555859840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 34us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530316.360545:0:9912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788530316.360617:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555859968 00000100:00100000:1.0:1788530316.360620:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555859968 00000100:00100000:1.0:1788530316.360646:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 452 00000100:00100000:1.0:1788530316.360653:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:3649:x1875409555859968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530316.360693:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 411 00000100:00100000:0.0:1788530316.360700:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875409555860096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530316.360731:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875409555860096:12345-0@lo:400:kworker.0 Request processed in 32us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530316.360737:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 411 00000100:00100000:0.0:1788530316.360751:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 412 00000100:00100000:0.0:1788530316.360757:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03693b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875409555860352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530316.360781:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03693b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875409555860352:12345-0@lo:400:kworker.0 Request processed in 25us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530316.360786:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 412 00000100:00100000:0.0:1788530316.360798:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 413 00000100:00100000:0.0:1788530316.360803:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f328e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875409555860736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530316.360828:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f328e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875409555860736:12345-0@lo:400:kworker.0 Request processed in 25us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530316.360833:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 413 00000100:00100000:0.0:1788530316.360844:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 414 00000100:00100000:0.0:1788530316.360850:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f328e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875409555861248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530316.360876:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f328e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875409555861248:12345-0@lo:400:kworker.0 Request processed in 26us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530316.360881:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 414 00000100:00100000:0.0:1788530316.360901:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555860992 00000100:00100000:0.0:1788530316.360905:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555860992 00000100:00100000:0.0:1788530316.360938:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555860864 00000100:00100000:0.0:1788530316.360941:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555860864 00000100:00100000:0.0:1788530316.360950:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555861376 00000100:00100000:0.0:1788530316.360952:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555861376 00000100:00100000:0.0:1788530316.360961:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788530316.360966:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555860992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530316.360995:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555860992:12345-0@lo:400:kworker.0 Request processed in 29us (895us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530316.361001:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788530316.361012:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788530316.361018:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03690a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555860864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530316.361043:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03690a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555860864:12345-0@lo:400:kworker.0 Request processed in 25us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530316.361047:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788530316.361057:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788530316.361061:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f328e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3648:x1875409555861376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530316.361081:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f328e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3648:x1875409555861376:12345-0@lo:400:kworker.0 Request processed in 20us (809us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530316.361086:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788530316.361101:0:14186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555860480 00000100:00100000:0.0:1788530316.361104:0:14186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555860480 00000100:00100000:0.0:1788530316.361125:0:14186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555860224 00000100:00100000:0.0:1788530316.361127:0:14186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555860224 00000100:00100000:0.0:1788530316.361137:0:14186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1788530316.361142:0:14186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555860480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530316.361171:0:14186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555860480:12345-0@lo:400:kworker.0 Request processed in 28us (1114us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530316.361186:0:14186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1788530316.361198:0:14186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1788530316.361202:0:14186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f328e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555860224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530316.361229:0:14186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f328e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555860224:12345-0@lo:400:kworker.0 Request processed in 26us (901us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530316.361234:0:14186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00080000:0.0:1788530316.361321:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788530316.361326:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788530316.361328:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788530316.361339:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530316.361361:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875409555861120:0@lo:400:kworker.0 00000100:00100000:0.0:1788530316.361387:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530316.361420:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555860480:0@lo:400:kworker.0 00000100:00100000:0.0:1788530316.361431:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:0.0:1788530316.361436:0:3649:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:0.0:1788530316.361452:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a9f3d2a3b80, transno 4294967311 00000100:00100000:0.0:1788530316.361461:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555860992:0@lo:400:kworker.0 00000100:00100000:0.0:1788530316.361480:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875409555860096:0@lo:400:kworker.0 00000100:00100000:2.0:1788530316.361953:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555859584:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788530316.361966:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555859712:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788530316.363366:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555860608 00000100:00100000:0.0:1788530316.363387:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555860608 00000100:00100000:0.0:1788530316.363472:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555861120 00000100:00100000:0.0:1788530316.363475:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555861120 00000100:00100000:0.0:1788530316.363502:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 415 00000100:00100000:1.0:1788530316.363522:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:3649:x1875409555859968:12345-0@lo:400:kworker.0 Request processed in 2868us (3506us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530316.363533:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 452 00000100:00100000:1.0:1788530316.363645:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555860224:0@lo:400:kworker.0 00000100:00100000:0.0:1788530316.364791:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f328e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875409555860608:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1788530316.364798:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e037e4e00 x1875409555860736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530332 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530316.364816:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875409555860736:0@lo:400:kworker.0 00010000:00080000:1.0:1788530316.364845:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e037e6d80 x1875409555861248/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530332 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530316.364853:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875409555861248:0@lo:400:kworker.0 00000100:00100000:0.0:1788530316.364880:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f328e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875409555860608:12345-0@lo:400:kworker.0 Request processed in 250us (3540us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530316.364898:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 415 00000100:00100000:0.0:1788530316.364933:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 416 00000100:00100000:0.0:1788530316.364941:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f328e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875409555861120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530316.364977:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f328e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875409555861120:12345-0@lo:400:kworker.0 Request processed in 37us (3588us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530316.364982:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 416 00000100:00080000:0.0:1788530316.365025:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788530316.365087:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875409555860608:0@lo:400:kworker.0 00000100:00100000:0.0:1788530316.365099:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875409555861120:0@lo:400:kworker.0 00000100:00100000:0.0:1788530316.365112:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3649:1875409555859968:0@lo:400:kworker.0 00000100:00100000:1.0:1788530316.365469:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555859840:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788530316.365484:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875409555860352:0@lo:400:kworker.0 00000100:00100000:1.0:1788530316.365499:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555860864:0@lo:400:kworker.0 00000100:00100000:1.0:1788530316.365509:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555861376:0@lo:400:kworker.0 00000100:00100000:1.0:1788530316.368783:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f06272300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555861504:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788530316.368924:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530316.368985:0:9912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555861504 00000100:00100000:1.0:1788530316.368992:0:9912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555861504 00000100:00100000:1.0:1788530316.369035:0:9912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788530316.369043:0:9912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555861504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788530316.369066:0:9912:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788530316.369113:0:9912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555861504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530316.369121:0:9912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788530316.369169:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f06272300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555861504:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788530316.489920:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788530316.869300:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967325 is committed 00000001:00080000:3.0:1788530316.869317:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000004:00080000:0.0:1788530316.871461:0:6502:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 10 committed 00000001:00080000:0.0:1788530316.871505:0:6502:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:0.0:1788530316.871542:0:6502:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a9f33e24f00 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:0.0:1788530316.871548:0:6502:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a9e03607300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a9e0273bd80 00000020:00080000:0.0:1788530316.871552:0:6502:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a9e03607200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a9f32bd5800 00000020:00080000:0.0:1788530316.871623:0:6502:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000100:00100000:2.0:1788530316.871843:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555861632:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788530316.871934:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530316.872041:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555861632 00000100:00100000:2.0:1788530316.872051:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555861632 00000100:00100000:2.0:1788530316.872116:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788530316.872127:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555861632:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1788530316.872287:0:8438:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1788530316.872291:0:8438:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 1788530309 -> 1788530309 00002000:00010000:2.0:1788530316.872293:0:8438:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 1788530309 -> 1788530309 00002000:00010000:2.0:1788530316.872295:0:8438:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1788530309 -> 1788530309 00002000:00010000:2.0:1788530316.872297:0:8438:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1788530316.872338:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3650:x1875409555861632:12345-0@lo:2:osp-syn-1-0.0 Request processed in 213us (404us total) trans 4294967326 rc 0/0 00000100:00100000:2.0:1788530316.872346:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788530316.872393:0:3650:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:2.0:1788530316.872413:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a9f3d2a2a00, transno 4294967323 00000004:00080000:2.0:1788530316.872424:0:3650:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:2.0:1788530316.872447:0:3650:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9a9e03765500 x1875409555861632/t4294967326(4294967326) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1788530332 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1788530316.872458:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a9e03765500/2, rc 0, transno 4294967326 00000100:00100000:2.0:1788530316.872464:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555861632:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1788530316.872627:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e12575159e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530316.872638:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e12575159e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530316.872646:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e12575159e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530316.872652:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d36b200 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:1.0:1788530316.872733:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e12575159e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530316.872743:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e12575159e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530316.872767:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9a9f2b995200) 00010000:00010000:1.0:1788530316.872771:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788530316.872775:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e12575159e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530316.872782:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b200/0xb28d70e12575159e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1788530316.872895:0:6555:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:3.0:1788530316.872944:0:6555:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:2.0:1788530317.289679:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530317.289735:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530317.289787:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530317.289831:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530317.290300:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530317.290318:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530317.290351:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530317.290396:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531683200 00000100:00100000:2.0:1788530317.290412:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531683200 00000100:00100000:2.0:1788530317.290511:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531683072 00000100:00100000:2.0:1788530317.290515:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531683072 00000100:00100000:2.0:1788530317.290545:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 124 00000100:00100000:2.0:1788530317.290557:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+7:2401:x1875409531683200:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1788530317.291165:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+7:2401:x1875409531683200:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 608us (1374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530317.291176:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 124 00000100:00100000:2.0:1788530317.291209:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 125 00000100:00100000:2.0:1788530317.291217:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2401:x1875409531683072:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1788530317.291247:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2401:x1875409531683072:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 32us (928us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530317.291281:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 125 00000100:00100000:0.0:1788530317.291702:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531682944 00000100:00100000:0.0:1788530317.291711:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531682944 00000100:00100000:0.0:1788530317.291787:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531683456 00000100:00100000:0.0:1788530317.291792:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531683456 00000100:00100000:0.0:1788530317.291818:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531682816 00000100:00100000:0.0:1788530317.291822:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531682816 00000100:00100000:0.0:1788530317.291854:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531683328 00000100:00100000:0.0:1788530317.291860:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531683328 00000100:00100000:0.0:1788530317.291878:0:10719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 417 00000100:00100000:0.0:1788530317.291887:0:10719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03765f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2401:x1875409531682944:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1788530317.291941:0:10719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03765f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2401:x1875409531682944:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 56us (2206us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530317.291948:0:10719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 417 00000100:00100000:0.0:1788530317.291965:0:10719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 418 00000100:00100000:0.0:1788530317.291971:0:10719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2401:x1875409531683456:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1788530317.291996:0:10719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2401:x1875409531683456:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 25us (2165us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530317.292003:0:10719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 418 00000100:00100000:0.0:1788530317.292015:0:10719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 419 00000100:00100000:0.0:1788530317.292023:0:10719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+18:2401:x1875409531682816:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1788530317.292053:0:10719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+18:2401:x1875409531682816:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 31us (1754us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530317.292059:0:10719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 419 00000100:00100000:0.0:1788530317.292071:0:10719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 420 00000100:00100000:0.0:1788530317.292077:0:10719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2401:x1875409531683328:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1788530317.292100:0:10719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2401:x1875409531683328:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 23us (1748us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530317.292106:0:10719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 420 00000100:00080000:0.0:1788530317.292144:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788530317.292149:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788530317.292152:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788530317.292156:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788530317.292968:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531682688 00000100:00100000:3.0:1788530317.292978:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531682688 00000100:00100000:3.0:1788530317.293027:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 453 00000100:00100000:3.0:1788530317.293035:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f442bcd-b742-4e76-ad7b-709f731358a0+14:2401:x1875409531682688:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1788530317.293091:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f442bcd-b742-4e76-ad7b-709f731358a0+14:2401:x1875409531682688:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 56us (3437us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530317.293098:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 453 00000100:00100000:2.0:1788530317.376971:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555861760:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788530317.377074:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530317.377273:0:14186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555861760 00000100:00100000:0.0:1788530317.377285:0:14186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555861760 00000100:00100000:0.0:1788530317.377375:0:14186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1788530317.377386:0:14186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555861760:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788530317.377422:0:14186:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446453248 avail 1300213760 00000100:00100000:0.0:1788530317.378132:0:14186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555861760:12345-0@lo:41:osp-pre-1-0.0 Request processed in 743us (1053us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530317.378142:0:14186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1788530317.378495:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555861760:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788530317.508095:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530318.533757:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788530319.154764:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530319.154901:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531683584 00000100:00100000:0.0:1788530319.154914:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531683584 00000100:00100000:0.0:1788530319.155048:0:10719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 255 00000100:00100000:0.0:1788530319.155064:0:10719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+18:12161:x1875409531683584:12345-192.168.202.41@tcp:60:lhsmtool_posix.0 00000100:00080000:2.0:1788530319.155425:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788530319.155481:0:10719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+18:12161:x1875409531683584:12345-192.168.202.41@tcp:60:lhsmtool_posix.0 Request processed in 421us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530319.155490:0:10719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 255 00000100:00100000:0.0:1788530319.158795:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530319.158945:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531683712 00000100:00100000:2.0:1788530319.158960:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531683712 00000100:00100000:2.0:1788530319.159074:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 256 00000100:00100000:2.0:1788530319.159088:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f328e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:12161:x1875409531683712:12345-192.168.202.41@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788530319.159257:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f328e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:12161:x1875409531683712:12345-192.168.202.41@tcp:60:lhsmtool_posix.0 Request processed in 171us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530319.159266:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 256 00000100:00080000:0.0:1788530319.159794:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788530319.162740:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530319.163297:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531683968 00000100:00100000:1.0:1788530319.163313:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531683968 00000100:00100000:1.0:1788530319.163509:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 65 00000100:00100000:1.0:1788530319.163522:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+18:12161:x1875409531683968:12345-192.168.202.41@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788530319.163914:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+19:12161:x1875409531683968:12345-192.168.202.41@tcp:35:lhsmtool_posix.0 Request processed in 392us (1186us total) trans 4294967523 rc 0/0 00000100:00100000:1.0:1788530319.163948:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 65 00000100:00100000:1.0:1788530319.477879:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530319.478434:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531684096 00000100:00100000:0.0:1788530319.478447:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531684096 00000100:00100000:1.0:1788530319.478604:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 257 00000100:00080000:2.0:1788530319.478645:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788530319.478693:0:8678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:12965:x1875409531684096:12345-192.168.202.41@tcp:101:lsof.0 00010000:00010000:1.0:1788530319.478720:0:8678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530319.478797:0:8678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea400/0xb28d70e12575162a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550c15 expref: -99 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530319.479508:0:8678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea000/0xb28d70e125751631 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530319.479528:0:8678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea000/0xb28d70e125751631 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530319.479544:0:8678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea000/0xb28d70e125751631 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788530319.479747:0:8678:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788530319.479751:0:8678:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788530319.479772:0:8678:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea000/0xb28d70e125751631 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530319.479796:0:8678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea400/0xb28d70e12575162a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550c15 expref: 7 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530319.479819:0:8678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea000/0xb28d70e125751631 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550c15 expref: 6 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530319.479910:0:8678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a9f32abda00) 00010000:00010000:1.0:1788530319.479914:0:8678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788530319.479918:0:8678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f012ea000, rc 0) 00000100:00100000:1.0:1788530319.480042:0:8678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+6:12965:x1875409531684096:12345-192.168.202.41@tcp:101:lsof.0 Request processed in 1427us (2178us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530319.487528:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 257 00010000:00010000:1.0:1788530319.557617:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530320.579511:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788530320.961028:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555861888:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788530320.961174:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530320.961704:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555861888 00000100:00100000:0.0:1788530320.961718:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555861888 00000100:00100000:0.0:1788530320.961791:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1788530320.961805:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f06270380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555861888:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788530320.961875:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1788530320.961968:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f06270380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555861888:12345-0@lo:41:osp-pre-0-1.0 Request processed in 163us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530320.961976:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1788530320.962638:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555861888:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788530321.476721:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f06270e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555862144:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788530321.476858:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530321.476944:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788530321.476954:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555862016:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788530321.476980:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530321.477118:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32a54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3647:1875409555862272:0@lo:400:kworker.0 00000100:00100000:2.0:1788530321.477151:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530321.477193:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32a57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555862784:0@lo:400:kworker.0 00000100:00100000:2.0:1788530321.477219:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530321.477234:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875409555863296:0@lo:400:kworker.0 00000100:00100000:2.0:1788530321.477257:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530321.477275:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788530321.477281:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32a57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875409555862400:0@lo:400:kworker.0 00000100:00100000:2.0:1788530321.477303:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530321.477318:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32a55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875409555862912:0@lo:400:kworker.0 00000100:00100000:2.0:1788530321.477339:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530321.477355:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875409555863424:0@lo:400:kworker.0 00000100:00100000:2.0:1788530321.477374:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530321.477401:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32a54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875409555862656:0@lo:400:kworker.0 00000100:00100000:2.0:1788530321.477422:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530321.477437:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555863168:0@lo:400:kworker.0 00000100:00100000:2.0:1788530321.477459:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530321.477480:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788530321.477486:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32a54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555862528:0@lo:400:kworker.0 00000100:00100000:2.0:1788530321.477509:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530321.477524:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32a55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875409555863040:0@lo:400:kworker.0 00000100:00100000:2.0:1788530321.477616:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530321.477635:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555863552:0@lo:400:kworker.0 00000100:00100000:2.0:1788530321.477656:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530321.477683:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555863168 00000100:00100000:2.0:1788530321.477691:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555863168 00000100:00100000:2.0:1788530321.477741:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555863552 00000100:00100000:2.0:1788530321.477751:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555863552 00000100:00100000:2.0:1788530321.477776:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788530321.477785:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555863168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530321.477837:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555863168:12345-0@lo:400:kworker.0 Request processed in 52us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530321.477844:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788530321.477864:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788530321.477870:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555863552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530321.477897:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555863552:12345-0@lo:400:kworker.0 Request processed in 27us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530321.477904:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00080000:2.0:1788530321.477925:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788530321.477929:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788530321.477951:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555863296 00000100:00100000:2.0:1788530321.477954:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555863296 00000100:00100000:2.0:1788530321.477989:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555862400 00000100:00100000:2.0:1788530321.477992:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555862400 00000100:00100000:2.0:1788530321.478002:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555862912 00000100:00100000:2.0:1788530321.478004:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555862912 00000100:00100000:2.0:1788530321.478016:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555863424 00000100:00100000:2.0:1788530321.478019:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555863424 00000100:00100000:2.0:1788530321.478032:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555862656 00000100:00100000:2.0:1788530321.478034:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555862656 00000100:00100000:2.0:1788530321.478043:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555863040 00000100:00100000:2.0:1788530321.478046:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555863040 00000100:00100000:2.0:1788530321.478059:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 421 00000100:00100000:2.0:1788530321.478065:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875409555863296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530321.478100:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875409555863296:12345-0@lo:400:kworker.0 Request processed in 35us (842us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530321.478116:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 421 00000100:00100000:2.0:1788530321.478128:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 422 00000100:00100000:2.0:1788530321.478133:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875409555862400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530321.478160:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875409555862400:12345-0@lo:400:kworker.0 Request processed in 27us (856us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530321.478165:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 422 00000100:00100000:2.0:1788530321.478176:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 423 00000100:00100000:2.0:1788530321.478182:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875409555862912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530321.478206:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875409555862912:12345-0@lo:400:kworker.0 Request processed in 25us (866us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530321.478211:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 423 00000100:00100000:2.0:1788530321.478222:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 424 00000100:00100000:2.0:1788530321.478228:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875409555863424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530321.478249:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875409555863424:12345-0@lo:400:kworker.0 Request processed in 22us (874us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530321.478254:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 424 00000100:00100000:2.0:1788530321.478264:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 425 00000100:00100000:2.0:1788530321.478270:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875409555862656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530321.478294:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875409555862656:12345-0@lo:400:kworker.0 Request processed in 25us (871us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530321.478300:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 425 00000100:00100000:2.0:1788530321.478311:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 426 00000100:00100000:2.0:1788530321.478316:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875409555863040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530321.478340:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875409555863040:12345-0@lo:400:kworker.0 Request processed in 24us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530321.478355:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 426 00000100:00080000:2.0:1788530321.478372:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788530321.478374:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788530321.478405:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32a57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875409555862400:0@lo:400:kworker.0 00000100:00100000:2.0:1788530321.478417:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32a55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875409555862912:0@lo:400:kworker.0 00010000:00080000:2.0:1788530321.478429:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f3d2b8380 x1875409555863424/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530337 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530321.478438:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875409555863424:0@lo:400:kworker.0 00000100:00100000:2.0:1788530321.478448:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875409555863296:0@lo:400:kworker.0 00010000:00080000:2.0:1788530321.478483:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f32a55880 x1875409555863040/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530337 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530321.478491:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32a55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875409555863040:0@lo:400:kworker.0 00000100:00100000:2.0:1788530321.478499:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555863552:0@lo:400:kworker.0 00000100:00100000:2.0:1788530321.478508:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32a54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875409555862656:0@lo:400:kworker.0 00000100:00100000:2.0:1788530321.478516:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555863168:0@lo:400:kworker.0 00000100:00100000:0.0:1788530321.479629:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788530321.479673:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f06271c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555863680:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788530321.479753:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530321.479832:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555862144 00000100:00100000:0.0:1788530321.479839:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555862144 00000100:00100000:0.0:1788530321.479894:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555862016 00000100:00100000:0.0:1788530321.479897:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555862016 00000100:00100000:0.0:1788530321.479912:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555863680 00000100:00100000:0.0:1788530321.479914:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555863680 00000100:00100000:0.0:1788530321.479927:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788530321.479935:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555862144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788530321.479968:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788530321.480010:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555862144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (3152us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530321.480016:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788530321.480033:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788530321.480040:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1875409555862016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788530321.480058:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788530321.480083:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1875409555862016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 44us (3103us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530321.480089:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788530321.480099:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788530321.480106:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f328e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555863680:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788530321.480116:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788530321.480140:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f328e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555863680:12345-0@lo:13:osp-pre-1-1.0 Request processed in 35us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530321.480145:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788530321.480165:0:14186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555862784 00000100:00100000:0.0:1788530321.480176:0:14186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555862784 00000100:00100000:0.0:1788530321.480203:0:14186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555862528 00000100:00100000:0.0:1788530321.480206:0:14186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555862528 00000100:00100000:0.0:1788530321.480218:0:14186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1788530321.480224:0:14186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555862784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530321.480266:0:14186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555862784:12345-0@lo:400:kworker.0 Request processed in 41us (3045us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530321.480273:0:14186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1788530321.480286:0:14186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1788530321.480291:0:14186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555862528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530321.480319:0:14186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555862528:12345-0@lo:400:kworker.0 Request processed in 28us (2809us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530321.480325:0:14186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00080000:0.0:1788530321.480342:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788530321.480346:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788530321.480379:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f06271c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555863680:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788530321.480421:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32a57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555862784:0@lo:400:kworker.0 00000100:00100000:1.0:1788530321.480658:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555862272 00000100:00100000:1.0:1788530321.480663:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555862272 00000100:00100000:1.0:1788530321.480696:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 454 00000100:00100000:1.0:1788530321.480703:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:3647:x1875409555862272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530321.480743:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:3647:x1875409555862272:12345-0@lo:400:kworker.0 Request processed in 40us (3591us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530321.480749:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 454 00000100:00100000:3.0:1788530321.480833:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788530321.480845:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555863808:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788530321.480879:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530321.480952:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555863808 00000100:00100000:1.0:1788530321.480956:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555863808 00000100:00100000:1.0:1788530321.480986:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1788530321.480993:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f06271f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555863808:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788530321.481004:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788530321.481036:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f06271f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555863808:12345-0@lo:13:osp-pre-0-1.0 Request processed in 44us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530321.481043:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1788530321.481073:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555863808:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788530321.481658:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32a54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3647:1875409555862272:0@lo:400:kworker.0 00000100:00100000:2.0:1788530321.481760:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32a54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555862528:0@lo:400:kworker.0 00000100:00100000:2.0:1788530321.481780:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555862016:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788530321.481797:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f06270e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555862144:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788530321.601483:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788530322.407460:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530322.407512:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530322.407555:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530322.407636:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530322.407652:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530322.407669:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530322.407690:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530322.407716:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531684352 00000100:00100000:3.0:1788530322.407726:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531684352 00000100:00100000:1.0:1788530322.407868:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531684224 00000100:00100000:1.0:1788530322.407874:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531684224 00000100:00100000:1.0:1788530322.407934:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 455 00000100:00100000:1.0:1788530322.407946:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f442bcd-b742-4e76-ad7b-709f731358a0+14:2400:x1875409531684224:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1788530322.408001:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531684608 00000100:00100000:2.0:1788530322.408006:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531684608 00000100:00100000:1.0:1788530322.408018:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f442bcd-b742-4e76-ad7b-709f731358a0+14:2400:x1875409531684224:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 73us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530322.408028:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 455 00000100:00100000:2.0:1788530322.408048:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531684736 00000100:00100000:2.0:1788530322.408053:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531684736 00000100:00100000:1.0:1788530322.408068:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531684864 00000100:00100000:1.0:1788530322.408074:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531684864 00000100:00100000:2.0:1788530322.408084:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 128 00000100:00100000:2.0:1788530322.408095:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f33f9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2400:x1875409531684608:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1788530322.408106:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531684480 00000100:00100000:1.0:1788530322.408110:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531684480 00000100:00100000:1.0:1788530322.408129:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531684992 00000100:00100000:1.0:1788530322.408133:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531684992 00000100:00100000:2.0:1788530322.408135:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f33f9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2400:x1875409531684608:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 43us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530322.408144:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 128 00000100:00100000:1.0:1788530322.408153:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 427 00000100:00100000:1.0:1788530322.408162:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f06273800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+19:2400:x1875409531684352:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1788530322.408201:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f06273800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+19:2400:x1875409531684352:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 39us (751us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530322.408209:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 427 00000100:00100000:2.0:1788530322.408317:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 129 00000100:00100000:2.0:1788530322.408325:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f06273b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+7:2400:x1875409531684736:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1788530322.408350:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f06273b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+7:2400:x1875409531684736:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 26us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530322.408357:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 129 00000100:00100000:3.0:1788530322.408609:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 428 00000100:00100000:3.0:1788530322.408620:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f06271880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+6:2400:x1875409531684864:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1788530322.408714:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f06271880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+6:2400:x1875409531684864:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 96us (1157us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530322.408721:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 428 00000100:00100000:3.0:1788530322.408735:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 429 00000100:00100000:3.0:1788530322.408743:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f06272a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2400:x1875409531684480:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1788530322.408766:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 430 00000100:00100000:3.0:1788530322.408772:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f06272a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2400:x1875409531684480:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 29us (1117us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530322.408781:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f06270700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2400:x1875409531684992:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1788530322.408786:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 429 00000100:00100000:1.0:1788530322.408821:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f06270700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2400:x1875409531684992:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 45us (1128us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530322.408829:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 430 00000100:00080000:0.0:1788530322.408966:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788530322.408971:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788530322.408973:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788530322.408975:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788530322.496907:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555863936:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788530322.497013:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530322.497261:0:14186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555863936 00000100:00100000:0.0:1788530322.497272:0:14186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555863936 00000100:00100000:0.0:1788530322.497329:0:14186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1788530322.497336:0:14186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f06270000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555863936:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788530322.497387:0:14186:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446453248 avail 1300213760 00000100:00100000:0.0:1788530322.498021:0:14186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f06270000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555863936:12345-0@lo:41:osp-pre-1-0.0 Request processed in 680us (1004us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530322.498032:0:14186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1788530322.498147:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555863936:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788530322.628392:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788530323.012679:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967326 is committed 00000001:00080000:0.0:1788530323.013019:0:6502:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967523 is committed 00000020:00080000:0.0:1788530323.013028:0:6502:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:3.0:1788530323.013091:0:6555:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:3.0:1788530323.013106:0:6555:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:2.0:1788530323.651913:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788530323.837447:0:14972:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 09:58:41 (1788530321) 00010000:00010000:0.0:1788530324.678914:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788530325.647556:0:13816:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788530325.697424:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788530325.890223:0:13811:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788530325.890249:0:13811:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788530325.890394:0:13811:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:1.0:1788530325.890412:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788530326.080884:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788530326.080921:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555864064:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788530326.080999:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530326.081107:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555864064 00000100:00100000:0.0:1788530326.081115:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555864064 00000100:00100000:0.0:1788530326.081172:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1788530326.081185:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f06272680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555864064:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788530326.081221:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1788530326.081273:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f06272680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555864064:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530326.081280:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1788530326.081324:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555864064:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788530326.594106:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f06271180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555864192:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788530326.594171:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530326.594237:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f06273480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555864320:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788530326.594261:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530326.594298:0:9912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555864192 00000100:00100000:3.0:1788530326.594305:0:9912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555864192 00000100:00100000:3.0:1788530326.594357:0:9912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555864320 00000100:00100000:3.0:1788530326.594360:0:9912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555864320 00000100:00100000:2.0:1788530326.594364:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788530326.594374:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f06273100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555864192:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788530326.594376:0:9912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788530326.594381:0:9912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f06271500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555864320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788530326.594401:0:9912:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923513344 avail 3691991040 00002000:00000024:2.0:1788530326.594401:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788530326.594435:0:9912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f06271500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555864320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 53us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530326.594439:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f06273100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555864192:12345-0@lo:13:osp-pre-0-1.0 Request processed in 67us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530326.594442:0:9912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788530326.594445:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00080000:3.0:1788530326.594464:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788530326.594474:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555864448:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788530326.594483:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f06271180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555864192:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788530326.594512:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530326.594524:0:9912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555864448 00000100:00100000:2.0:1788530326.594527:0:9912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555864448 00000100:00100000:3.0:1788530326.594546:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f06273480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555864320:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788530326.594552:0:9912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1788530326.594558:0:9912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f06270e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555864448:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788530326.594586:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:2.0:1788530326.594592:0:9912:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788530326.594641:0:9912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f06270e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555864448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530326.594647:0:9912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1788530326.595445:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875409555864704:0@lo:400:kworker.0 00000100:00100000:2.0:1788530326.595488:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530326.595585:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875409555865216:0@lo:400:kworker.0 00000100:00100000:2.0:1788530326.595608:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530326.595696:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3649:1875409555864576:0@lo:400:kworker.0 00000100:00100000:3.0:1788530326.595734:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530326.595760:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555865088:0@lo:400:kworker.0 00000100:00100000:3.0:1788530326.595785:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530326.595802:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875409555865600:0@lo:400:kworker.0 00000100:00100000:3.0:1788530326.595849:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555864576 00000100:00100000:3.0:1788530326.595854:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555864576 00000100:00100000:3.0:1788530326.595902:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 456 00000100:00100000:3.0:1788530326.595909:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:3649:x1875409555864576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530326.595950:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:3649:x1875409555864576:12345-0@lo:400:kworker.0 Request processed in 41us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530326.595963:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 456 00000100:00100000:3.0:1788530326.595998:0:14186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555865088 00000100:00100000:3.0:1788530326.596003:0:14186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555865088 00000100:00100000:3.0:1788530326.596030:0:14186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1788530326.596037:0:14186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f06273480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555865088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530326.596074:0:14186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f06273480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555865088:12345-0@lo:400:kworker.0 Request processed in 36us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530326.596081:0:14186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1788530326.596118:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875409555864960:0@lo:400:kworker.0 00000100:00100000:2.0:1788530326.596118:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555865728:0@lo:400:kworker.0 00000100:00100000:3.0:1788530326.596144:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530326.596146:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530326.596206:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555864704 00000100:00100000:0.0:1788530326.596211:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555864704 00000100:00100000:0.0:1788530326.596279:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555865216 00000100:00100000:0.0:1788530326.596283:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555865216 00000100:00100000:3.0:1788530326.596294:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875409555865472:0@lo:400:kworker.0 00000100:00100000:0.0:1788530326.596313:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555864960 00000100:00100000:0.0:1788530326.596316:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555864960 00000100:00100000:3.0:1788530326.596318:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530326.596329:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555865472 00000100:00100000:0.0:1788530326.596331:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555865472 00000100:00100000:0.0:1788530326.596349:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 431 00000100:00100000:3.0:1788530326.596352:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967326 gen 2 00000100:00100000:0.0:1788530326.596355:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875409555864704:12345-0@lo:400:kworker.0 00000004:00080000:3.0:1788530326.596359:0:3648:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a9e03765500, transno 4294967326 00000100:00100000:3.0:1788530326.596382:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555864448:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788530326.596394:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875409555864704:12345-0@lo:400:kworker.0 Request processed in 39us (906us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530326.596409:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788530326.596410:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 431 00000100:00100000:3.0:1788530326.596415:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555864832:0@lo:400:kworker.0 00000100:00100000:0.0:1788530326.596423:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 432 00000100:00100000:0.0:1788530326.596429:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875409555865216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530326.596437:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530326.596453:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875409555865344:0@lo:400:kworker.0 00000100:00100000:0.0:1788530326.596454:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875409555865216:12345-0@lo:400:kworker.0 Request processed in 26us (847us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530326.596461:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 432 00000100:00100000:0.0:1788530326.596471:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 433 00000100:00100000:0.0:1788530326.596476:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f06271c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875409555864960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530326.596481:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530326.596503:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555865856:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788530326.596512:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f06271c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875409555864960:12345-0@lo:400:kworker.0 Request processed in 37us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530326.596519:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 433 00000100:00100000:3.0:1788530326.596526:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530326.596529:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555865344 00000100:00100000:0.0:1788530326.596532:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555865344 00000100:00100000:0.0:1788530326.596548:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 434 00000100:00100000:3.0:1788530326.596550:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875409555864960:0@lo:400:kworker.0 00000100:00100000:0.0:1788530326.596553:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f06272300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875409555865472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530326.596592:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 435 00000100:00100000:3.0:1788530326.596600:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f06271180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875409555865344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530326.596604:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f06272300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875409555865472:12345-0@lo:400:kworker.0 Request processed in 51us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530326.596609:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 434 00000100:00100000:3.0:1788530326.596627:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f06271180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875409555865344:12345-0@lo:400:kworker.0 Request processed in 29us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530326.596947:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555865728 00000100:00100000:2.0:1788530326.596952:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555865728 00000100:00100000:2.0:1788530326.596995:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788530326.597002:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555865728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530326.597038:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555865728:12345-0@lo:400:kworker.0 Request processed in 37us (891us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530326.597043:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788530326.597211:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875409555864704:0@lo:400:kworker.0 00000100:00100000:2.0:1788530326.597238:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875409555865216:0@lo:400:kworker.0 00000100:00100000:2.0:1788530326.597247:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555865728:0@lo:400:kworker.0 00000100:00080000:2.0:1788530326.597808:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788530326.597816:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788530326.597818:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788530326.597836:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530326.597881:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3649:1875409555864576:0@lo:400:kworker.0 00000100:00100000:2.0:1788530326.597896:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555865088:0@lo:400:kworker.0 00000100:00100000:3.0:1788530326.598350:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 435 00000100:00100000:3.0:1788530326.598392:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555865600 00000100:00100000:3.0:1788530326.598397:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555865600 00000100:00100000:3.0:1788530326.598466:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 436 00000100:00100000:3.0:1788530326.598474:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875409555865600:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788530326.598523:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788530326.599113:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875409555865600:12345-0@lo:400:kworker.0 Request processed in 637us (1273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530326.599122:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 436 00010000:00080000:2.0:1788530326.599125:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f328e5880 x1875409555865600/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530342 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530326.599141:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875409555865600:0@lo:400:kworker.0 00000100:00100000:3.0:1788530326.599157:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555864832 00000100:00100000:3.0:1788530326.599163:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555864832 00000100:00100000:3.0:1788530326.599208:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1788530326.599217:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f06270a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555864832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530326.599266:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f06270a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555864832:12345-0@lo:400:kworker.0 Request processed in 50us (2828us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530326.599273:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1788530326.599296:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555865856 00000100:00100000:3.0:1788530326.599302:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555865856 00000100:00100000:3.0:1788530326.599339:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1788530326.599354:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d258000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555865856:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788530326.599372:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788530326.599402:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d258000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555865856:12345-0@lo:13:osp-pre-1-1.0 Request processed in 49us (2875us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530326.599406:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1788530326.599429:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555864832:0@lo:400:kworker.0 00010000:00080000:3.0:1788530326.599444:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f328e4380 x1875409555865344/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530342 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530326.599451:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875409555865344:0@lo:400:kworker.0 00000100:00100000:3.0:1788530326.599467:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555865856:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788530326.599476:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875409555865472:0@lo:400:kworker.0 00010000:00010000:2.0:1788530326.732873:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788530327.528299:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530327.528346:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530327.528475:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531685120 00000100:00100000:2.0:1788530327.528497:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531685120 00000100:00100000:2.0:1788530327.528602:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 457 00000100:00100000:2.0:1788530327.528614:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f442bcd-b742-4e76-ad7b-709f731358a0+14:2402:x1875409531685120:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1788530327.528724:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f442bcd-b742-4e76-ad7b-709f731358a0+14:2402:x1875409531685120:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 112us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530327.528733:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 457 00000100:00100000:3.0:1788530327.529867:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530327.529903:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530327.529946:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531685632 00000100:00100000:2.0:1788530327.529953:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531685632 00000100:00100000:2.0:1788530327.530020:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 131 00000100:00100000:2.0:1788530327.530030:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d259180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+7:2402:x1875409531685632:12345-192.168.202.41@tcp:400:kworker.0 00000100:00080000:1.0:1788530327.530036:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788530327.530086:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d259180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+7:2402:x1875409531685632:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 57us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530327.530097:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 131 00000100:00100000:3.0:1788530327.531807:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530327.532064:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531685376 00000100:00100000:0.0:1788530327.532073:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531685376 00000100:00100000:0.0:1788530327.532153:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531685888 00000100:00100000:0.0:1788530327.532157:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531685888 00000100:00100000:0.0:1788530327.532187:0:10719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 437 00000100:00100000:0.0:1788530327.532196:0:10719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d25b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2402:x1875409531685376:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1788530327.536961:0:10719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d25b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2402:x1875409531685376:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 4752us (8600us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530327.536993:0:10719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 437 00000100:00100000:0.0:1788530327.537041:0:10719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 438 00000100:00100000:0.0:1788530327.537053:0:10719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d259f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2402:x1875409531685888:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1788530327.537087:0:10719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d259f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2402:x1875409531685888:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 39us (7184us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530327.537093:0:10719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 438 00000100:00080000:1.0:1788530327.537390:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788530327.538932:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530327.538986:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530327.539032:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531685248 00000100:00100000:3.0:1788530327.539045:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531685248 00000100:00100000:3.0:1788530327.539126:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531685760 00000100:00100000:3.0:1788530327.539129:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531685760 00000100:00100000:3.0:1788530327.539155:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 439 00000100:00100000:3.0:1788530327.539166:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d258700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+18:2402:x1875409531685248:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1788530327.539894:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d258700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+18:2402:x1875409531685248:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 724us (8089us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530327.539931:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 439 00000100:00100000:3.0:1788530327.539969:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 440 00000100:00100000:3.0:1788530327.539980:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d25b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+6:2402:x1875409531685760:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1788530327.540024:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d25b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+6:2402:x1875409531685760:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 47us (1037us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530327.540031:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 440 00000100:00080000:3.0:1788530327.540182:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788530327.541267:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531685504 00000100:00100000:1.0:1788530327.541281:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531685504 00000100:00100000:1.0:1788530327.541374:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 132 00000100:00100000:1.0:1788530327.541386:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d259880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2402:x1875409531685504:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1788530327.541451:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d259880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2402:x1875409531685504:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 69us (2534us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530327.541458:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 132 00000100:00080000:3.0:1788530327.542033:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788530327.617958:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788530327.617988:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555865984:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788530327.618067:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530327.618403:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555865984 00000100:00100000:0.0:1788530327.618422:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555865984 00000100:00100000:0.0:1788530327.618476:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1788530327.618496:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555865984:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788530327.618533:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446453248 avail 1300213760 00000100:00100000:0.0:1788530327.618618:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555865984:12345-0@lo:41:osp-pre-1-0.0 Request processed in 133us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530327.618625:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1788530327.619147:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555865984:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788530327.749235:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530328.771006:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788530328.879212:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530328.879377:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531686144 00000100:00100000:1.0:1788530328.879391:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531686144 00000100:00100000:1.0:1788530328.879501:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 66 00000100:00100000:1.0:1788530328.879513:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+18:13189:x1875409531686144:12345-192.168.202.41@tcp:35:umount.0 00000100:00100000:1.0:1788530328.880031:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+19:13189:x1875409531686144:12345-192.168.202.41@tcp:35:umount.0 Request processed in 518us (834us total) trans 4294967524 rc 0/0 00000100:00100000:1.0:1788530328.880040:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 66 00000100:00100000:0.0:1788530328.897102:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530328.899214:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531686400 00000100:00100000:1.0:1788530328.899492:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531686400 00000100:00100000:0.0:1788530328.899709:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 67 00000100:00100000:0.0:1788530328.899728:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+19:13189:x1875409531686400:12345-192.168.202.41@tcp:35:umount.0 00000100:00100000:0.0:1788530328.900999:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+20:13189:x1875409531686400:12345-192.168.202.41@tcp:35:umount.0 Request processed in 1264us (3899us total) trans 4294967525 rc 0/0 00000100:00100000:0.0:1788530328.901013:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 67 00000100:00100000:3.0:1788530328.905549:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530328.908818:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531686656 00000100:00100000:1.0:1788530328.908834:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531686656 00000100:00100000:1.0:1788530328.909302:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 68 00000100:00100000:1.0:1788530328.909317:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3959a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+20:13189:x1875409531686656:12345-192.168.202.41@tcp:35:umount.0 00000100:00100000:1.0:1788530328.909713:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3959a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+21:13189:x1875409531686656:12345-192.168.202.41@tcp:35:umount.0 Request processed in 401us (4175us total) trans 4294967526 rc 0/0 00000100:00100000:1.0:1788530328.909722:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 68 00000100:00100000:3.0:1788530328.912928:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530328.913049:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531686912 00000100:00100000:2.0:1788530328.913068:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531686912 00000100:00100000:2.0:1788530328.913141:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 69 00000100:00100000:2.0:1788530328.913151:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d25a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+21:13189:x1875409531686912:12345-192.168.202.41@tcp:35:umount.0 00000100:00100000:2.0:1788530328.913888:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d25a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+22:13189:x1875409531686912:12345-192.168.202.41@tcp:35:umount.0 Request processed in 733us (965us total) trans 4294967527 rc 0/0 00000100:00100000:2.0:1788530328.913898:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 69 00000100:00100000:2.0:1788530328.920621:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530328.920661:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530328.920688:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530328.920717:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530328.921042:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531687168 00000100:00100000:3.0:1788530328.921053:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531687168 00000100:00100000:3.0:1788530328.921107:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531687040 00000100:00100000:3.0:1788530328.921110:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531687040 00000100:00100000:3.0:1788530328.921123:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531687296 00000100:00100000:3.0:1788530328.921125:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531687296 00000100:00100000:3.0:1788530328.921136:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531687424 00000100:00100000:3.0:1788530328.921139:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531687424 00000100:00100000:3.0:1788530328.921159:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 17 00000100:00100000:3.0:1788530328.921169:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f442bcd-b742-4e76-ad7b-709f731358a0+17:2402:x1875409531687168:12345-192.168.202.41@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1788530328.921175:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00010000:00010000:3.0:1788530328.921185:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1788530328.921206:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 18 00000100:00100000:2.0:1788530328.921215:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f442bcd-b742-4e76-ad7b-709f731358a0+17:2402:x1875409531687040:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788530328.921223:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788530328.921238:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f18140200/0xb28d70e125750559 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 18 type: PLN flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550761 expref: 17 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530328.921258:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788530328.921321:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f442bcd-b742-4e76-ad7b-709f731358a0+16:2402:x1875409531687040:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 107us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530328.921328:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 18 00000100:00100000:2.0:1788530328.921348:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 19 00000100:00100000:2.0:1788530328.921355:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f442bcd-b742-4e76-ad7b-709f731358a0+15:2402:x1875409531687296:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788530328.921363:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788530328.921371:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f3d100e00/0xb28d70e125750823 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550841 expref: 15 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530328.921402:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788530328.921422:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f442bcd-b742-4e76-ad7b-709f731358a0+14:2402:x1875409531687296:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 67us (732us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530328.921429:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 19 00010000:00010000:3.0:1788530328.921526:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f3d36a400/0xb28d70e12575051a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550722 expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530328.921538:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788530328.921595:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f442bcd-b742-4e76-ad7b-709f731358a0+13:2402:x1875409531687168:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 393us (1128us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530328.921791:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 17 00000100:00100000:3.0:1788530328.921805:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 20 00000100:00100000:3.0:1788530328.921812:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03767800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f442bcd-b742-4e76-ad7b-709f731358a0+12:2400:x1875409531687424:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788530328.921820:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788530328.921829:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f0c91da00/0xb28d70e125750560 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550768 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530328.921839:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788530328.921859:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03767800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f442bcd-b742-4e76-ad7b-709f731358a0+11:2400:x1875409531687424:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 48us (1142us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530328.921865:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 20 00000100:00100000:2.0:1788530328.922697:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531687808 00000100:00100000:2.0:1788530328.922711:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531687808 00000100:00100000:2.0:1788530328.922761:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 81 00000100:00100000:2.0:1788530328.922769:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03767100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+7:2398:x1875409531687808:12345-192.168.202.41@tcp:9:umount.0 00000020:00000080:2.0:1788530328.922806:0:8436:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e125750b9c 00000020:00010000:2.0:1788530328.922815:0:8436:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9a9e03e59800: total 0 00000100:00080000:2.0:1788530328.922821:0:8436:0:(import.c:65:import_set_state_nolock()) ffff9a9e03e5e800 : changing import state from FULL to CLOSED 00000020:00010000:3.0:1788530328.922857:0:6511:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9a9e03e59800: total 0 00010000:00010000:3.0:1788530328.922907:0:6511:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9a9e03e59800, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1788530328.922975:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c27f05a2/0xb28d70e125751623 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550c0e expref: 6 pid: 8752 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530328.923011:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e9f6c68/0xb28d70e125750f54 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a2b expref: 5 pid: 8752 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530328.923027:0:6511:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9a9e03e59800, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1788530328.923040:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530328.923042:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530328.923044:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1788530328.923818:0:8436:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967326 00000100:00100000:2.0:1788530328.924033:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03767100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+2:2398:x1875409531687808:12345-192.168.202.41@tcp:9:umount.0 Request processed in 1261us (2853us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530328.924044:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 81 00000100:00100000:2.0:1788530328.931805:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530328.931868:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531687936 00000100:00100000:1.0:1788530328.931881:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531687936 00000100:00100000:1.0:1788530328.931989:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 82 00000100:00100000:1.0:1788530328.932004:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03765500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2398:x1875409531687936:12345-192.168.202.41@tcp:9:umount.0 00000020:00000080:1.0:1788530328.932050:0:8752:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e125750926 00000100:00080000:1.0:1788530328.932063:0:8752:0:(import.c:65:import_set_state_nolock()) ffff9a9e03de8000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788530328.932136:0:8752:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00010000:00010000:0.0:1788530328.932156:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788530328.932362:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03765500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+2:2398:x1875409531687936:12345-192.168.202.41@tcp:9:umount.0 Request processed in 360us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530328.932371:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 82 00000100:00100000:3.0:1788530328.955319:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530328.955403:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531688960 00000100:00100000:1.0:1788530328.955415:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531688960 00000100:00100000:1.0:1788530328.955548:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 258 00000100:00100000:1.0:1788530328.955606:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d258380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+22:2398:x1875409531688960:12345-192.168.202.41@tcp:39:umount.0 00000020:00000080:1.0:1788530328.955643:0:6525:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e125750528 00000020:00010000:1.0:1788530328.955669:0:6525:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9a9f373f7000: total 0 00000100:00080000:1.0:1788530328.955675:0:6525:0:(import.c:65:import_set_state_nolock()) ffff9a9f373f7800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788530328.955709:0:6525:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00100000:1.0:1788530328.955864:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d258380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+21:2398:x1875409531688960:12345-192.168.202.41@tcp:39:umount.0 Request processed in 305us (553us total) trans 4294967528 rc 0/0 00000100:00100000:1.0:1788530328.955872:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 258 00000020:00010000:2.0:1788530328.955939:0:6512:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9a9f373f7000: total 0 00010000:00010000:2.0:1788530328.956003:0:6512:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9a9f373f7000, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1788530328.956041:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a9f2b992000) 00010000:00010000:2.0:1788530328.956045:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788530328.956055:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20c400/0xb28d70e1257508a1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550856 expref: 20 pid: 10719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530328.956115:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a9f2b995800) 00010000:00010000:2.0:1788530328.956118:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788530328.956123:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20d400/0xb28d70e125751504 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550bc1 expref: 19 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530328.956155:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a9f2b996600) 00010000:00010000:2.0:1788530328.956158:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788530328.956162:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d100600/0xb28d70e125750f3f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a24 expref: 18 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530328.956176:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a9e0241d100) 00010000:00010000:2.0:1788530328.956179:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788530328.956182:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030400/0xb28d70e125750bf7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550944 expref: 17 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530328.956195:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a9f32abd000) 00010000:00010000:2.0:1788530328.956197:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788530328.956201:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167e00/0xb28d70e125750885 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a55084f expref: 16 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530328.956220:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a9f2b995b00) 00010000:00010000:2.0:1788530328.956222:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788530328.956225:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d101400/0xb28d70e125750fd9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a4e expref: 15 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530328.956235:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a9f2b996600) 00010000:00010000:2.0:1788530328.956238:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788530328.956241:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea800/0xb28d70e125750e35 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5509de expref: 14 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530328.956253:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a9e0241d100) 00010000:00010000:2.0:1788530328.956255:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788530328.956265:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030e00/0xb28d70e1257508fc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a55086b expref: 13 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530328.956282:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a9f2b995800) 00010000:00010000:2.0:1788530328.956285:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788530328.956288:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d20cc00/0xb28d70e1257515e4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550bf9 expref: 12 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530328.956299:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a9f2b995800) 00010000:00010000:2.0:1788530328.956301:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788530328.956305:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36b000/0xb28d70e12575160e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550c07 expref: 11 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530328.956320:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a9f2b996600) 00010000:00010000:2.0:1788530328.956323:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788530328.956326:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36ae00/0xb28d70e125750f15 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a16 expref: 10 pid: 10720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530328.956340:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a9f2b995b00) 00010000:00010000:2.0:1788530328.956342:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788530328.956346:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb800/0xb28d70e1257512c6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550b27 expref: 9 pid: 10719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530328.956360:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a9f32abda00) 00010000:00010000:2.0:1788530328.956363:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788530328.956366:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb600/0xb28d70e125750fbd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550a47 expref: 8 pid: 10719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530328.956375:0:6512:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9a9f373f7000, canceled 13 locks, left on hash table 0. 00010000:00010000:2.0:1788530328.956394:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530328.956396:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530328.956397:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788530328.978193:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530328.979462:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531689088 00000100:00100000:0.0:1788530328.979607:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531689088 00000100:00100000:0.0:1788530328.979727:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 259 00000100:00100000:0.0:1788530328.979739:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d258a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+5:2398:x1875409531689088:12345-192.168.202.41@tcp:39:umount.0 00000020:00000080:0.0:1788530328.979789:0:10720:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e12575052f 00000100:00080000:0.0:1788530328.979811:0:10720:0:(import.c:65:import_set_state_nolock()) ffff9a9f373f2000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788530328.979843:0:10720:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:3.0:1788530328.979931:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788530328.980072:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d258a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41+3:2398:x1875409531689088:12345-192.168.202.41@tcp:39:umount.0 Request processed in 335us (1890us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788530328.980081:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 259 00010000:00010000:0.0:1788530329.792926:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530330.817382:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788530331.103025:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530331.103066:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530331.103099:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530331.103135:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530331.103161:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530331.103207:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531689856 00000100:00100000:0.0:1788530331.103218:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531689856 00000100:00100000:0.0:1788530331.103294:0:10719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 260 00000100:00100000:0.0:1788530331.103305:0:10719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+6:2398:x1875409531689856:12345-192.168.202.41@tcp:39:umount.0 00000020:00000080:0.0:1788530331.103352:0:10719:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e125750671 00000020:00010000:0.0:1788530331.103361:0:10719:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9a9e027aa000: total 0 00000100:00080000:0.0:1788530331.103366:0:10719:0:(import.c:65:import_set_state_nolock()) ffff9a9e027a9800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788530331.103388:0:10719:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00100000:1.0:1788530331.103674:0:10347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531689216 00000100:00100000:1.0:1788530331.103679:0:10347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531689216 00000100:00100000:1.0:1788530331.103712:0:10347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531689472 00000100:00100000:1.0:1788530331.103716:0:10347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531689472 00000100:00100000:1.0:1788530331.103728:0:10347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531689344 00000100:00100000:1.0:1788530331.103730:0:10347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531689344 00000100:00100000:1.0:1788530331.103740:0:10347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531689600 00000100:00100000:1.0:1788530331.103755:0:10347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531689600 00000100:00100000:1.0:1788530331.103775:0:10347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 21 00000100:00100000:1.0:1788530331.103783:0:10347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f442bcd-b742-4e76-ad7b-709f731358a0+13:2402:x1875409531689216:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788530331.103794:0:10347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788530331.103813:0:10347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f0c91c200/0xb28d70e12575065c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a55077d expref: 13 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530331.103830:0:10347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788530331.103881:0:10347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f442bcd-b742-4e76-ad7b-709f731358a0+12:2402:x1875409531689216:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 98us (870us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530331.103889:0:10347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 21 00000100:00100000:1.0:1788530331.103908:0:10347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 22 00000100:00100000:1.0:1788530331.103915:0:10347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2a1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f442bcd-b742-4e76-ad7b-709f731358a0+11:2399:x1875409531689472:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788530331.103923:0:10347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788530331.103933:0:10347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f42166400/0xb28d70e12575081c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a55083a expref: 11 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530331.103943:0:10347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788530331.103962:0:10347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2a1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f442bcd-b742-4e76-ad7b-709f731358a0+10:2399:x1875409531689472:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 47us (895us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530331.103969:0:10347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 22 00000100:00100000:1.0:1788530331.103982:0:10347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 23 00000100:00100000:1.0:1788530331.103988:0:10347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f08d7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f442bcd-b742-4e76-ad7b-709f731358a0+9:2402:x1875409531689344:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788530331.103995:0:10347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788530331.104004:0:10347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f0c91ce00/0xb28d70e125750663 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a5507ae expref: 9 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530331.104024:0:10347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788530331.104045:0:10347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f08d7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f442bcd-b742-4e76-ad7b-709f731358a0+8:2402:x1875409531689344:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 56us (945us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530331.104052:0:10347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 23 00000100:00100000:1.0:1788530331.104091:0:10347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 24 00000100:00100000:1.0:1788530331.104099:0:10347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f442bcd-b742-4e76-ad7b-709f731358a0+7:2399:x1875409531689600:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788530331.104107:0:10347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788530331.104116:0:10347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f18140800/0xb28d70e125750655 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550776 expref: 7 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530331.104125:0:10347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788530331.104142:0:10347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6f442bcd-b742-4e76-ad7b-709f731358a0+6:2399:x1875409531689600:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 44us (1006us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530331.104147:0:10347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 24 00000100:00100000:0.0:1788530331.104416:0:10719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2398:x1875409531689856:12345-192.168.202.41@tcp:39:umount.0 Request processed in 1112us (1253us total) trans 4294967529 rc 0/0 00000100:00100000:0.0:1788530331.104424:0:10719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 260 00000100:00080000:3.0:1788530331.104813:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:3.0:1788530331.104825:0:6511:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9a9e027aa000: total 0 00010000:00010000:3.0:1788530331.104828:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530331.104881:0:6511:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9a9e027aa000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788530331.104906:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a9f32abda00) 00010000:00010000:3.0:1788530331.104910:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788530331.104916:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea000/0xb28d70e125751631 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550c15 expref: 4 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530331.104937:0:6511:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9a9e027aa000, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1788530331.104946:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530331.104948:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530331.104949:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788530331.110044:0:6502:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc 00000001:00080000:1.0:1788530331.110065:0:6502:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967529 is committed 00000020:00000080:1.0:1788530331.110071:0:6502:0:(genops.c:885:class_export_put()) final put ffff9a9e027aa000/5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc 00000001:00100000:1.0:1788530331.110092:0:6502:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41 00000001:00080000:1.0:1788530331.110099:0:6502:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:1.0:1788530331.110108:0:6502:0:(genops.c:885:class_export_put()) final put ffff9a9f373f7000/aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41 00000020:00000080:0.0:1788530331.110589:0:476:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9e027aa000/5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc for lustre-MDT0000 00000020:00000080:0.0:1788530331.110677:0:476:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f373f7000/aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41 for lustre-MDT0000 00000020:00000080:0.0:1788530331.110724:0:476:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a9e027a9800 for lustre-MDT0000 00000020:00000080:0.0:1788530331.110729:0:476:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a9f373f7800 for lustre-MDT0000 00000100:00100000:3.0:1788530331.118274:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530331.118534:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531689984 00000100:00100000:0.0:1788530331.118546:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531689984 00000100:00100000:0.0:1788530331.118674:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 261 00000100:00100000:0.0:1788530331.118688:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d25bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+5:2398:x1875409531689984:12345-192.168.202.41@tcp:39:umount.0 00000100:00080000:3.0:1788530331.118691:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000080:0.0:1788530331.118733:0:6523:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e125750678 00000100:00080000:0.0:1788530331.118742:0:6523:0:(import.c:65:import_set_state_nolock()) ffff9a9e027ac000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788530331.118790:0:6523:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00010000:00010000:3.0:1788530331.118878:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788530331.118969:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d25bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc+3:2398:x1875409531689984:12345-192.168.202.41@tcp:39:umount.0 Request processed in 284us (705us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1788530331.118977:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 261 00000100:00100000:3.0:1788530331.143808:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530331.146005:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531690112 00000100:00100000:1.0:1788530331.146022:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531690112 00000100:00100000:1.0:1788530331.146101:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 458 00000100:00100000:1.0:1788530331.146113:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f442bcd-b742-4e76-ad7b-709f731358a0+6:2398:x1875409531690112:12345-192.168.202.41@tcp:251:umount.0 00000020:00000080:1.0:1788530331.146218:0:6516:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e125750505 00000100:00080000:1.0:1788530331.146242:0:6516:0:(import.c:65:import_set_state_nolock()) ffff9a9e0242b800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788530331.146336:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f442bcd-b742-4e76-ad7b-709f731358a0+1:2398:x1875409531690112:12345-192.168.202.41@tcp:251:umount.0 Request processed in 226us (2544us total) trans 0 rc 0/0 00010000:00010000:3.0:1788530331.146345:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788530331.146345:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 458 00000020:00000080:1.0:1788530331.146367:0:6516:0:(genops.c:885:class_export_put()) final put ffff9a9e0242e800/6f442bcd-b742-4e76-ad7b-709f731358a0 00000020:00000080:3.0:1788530331.146597:0:12493:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9e0242e800/6f442bcd-b742-4e76-ad7b-709f731358a0 for MGS 00000020:00000080:3.0:1788530331.146659:0:12493:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a9e0242b800 for MGS 00000100:00100000:2.0:1788530331.201028:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555866112:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788530331.201147:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530331.205590:0:14186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555866112 00000100:00100000:3.0:1788530331.205611:0:14186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555866112 00000100:00100000:3.0:1788530331.205695:0:14186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1788530331.205707:0:14186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03766680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555866112:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788530331.205751:0:14186:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1788530331.205856:0:14186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03766680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555866112:12345-0@lo:41:osp-pre-0-1.0 Request processed in 151us (4709us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530331.205863:0:14186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1788530331.206509:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555866112:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788530331.712796:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3650:1875409555866240:0@lo:400:kworker.0 00000100:00100000:0.0:1788530331.712875:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530331.712919:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875409555866752:0@lo:400:kworker.0 00000100:00100000:0.0:1788530331.712942:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530331.712958:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875409555867264:0@lo:400:kworker.0 00000100:00100000:0.0:1788530331.712977:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530331.712998:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788530331.713004:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555866624:0@lo:400:kworker.0 00000100:00100000:0.0:1788530331.713028:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530331.713047:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555867136:0@lo:400:kworker.0 00000100:00100000:0.0:1788530331.713066:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530331.713092:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555867648:0@lo:400:kworker.0 00000100:00100000:0.0:1788530331.713132:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530331.713170:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875409555866368:0@lo:400:kworker.0 00000100:00100000:0.0:1788530331.713193:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530331.713209:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875409555866880:0@lo:400:kworker.0 00000100:00100000:0.0:1788530331.713348:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530331.713375:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875409555867392:0@lo:400:kworker.0 00000100:00100000:0.0:1788530331.713415:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530331.713432:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788530331.713437:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875409555866496:0@lo:400:kworker.0 00000100:00100000:0.0:1788530331.713628:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530331.713647:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555867008:0@lo:400:kworker.0 00000100:00100000:0.0:1788530331.713668:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530331.713683:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555867520:0@lo:400:kworker.0 00000100:00100000:0.0:1788530331.713700:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530331.713792:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555866240 00000100:00100000:0.0:1788530331.713801:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555866240 00000100:00100000:0.0:1788530331.713849:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 459 00000100:00100000:0.0:1788530331.713857:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:3650:x1875409555866240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530331.713901:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:3650:x1875409555866240:12345-0@lo:400:kworker.0 Request processed in 45us (1026us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530331.713908:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 459 00000100:00100000:0.0:1788530331.713939:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555866752 00000100:00100000:0.0:1788530331.713942:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555866752 00000100:00100000:0.0:1788530331.713981:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555867264 00000100:00100000:0.0:1788530331.713983:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555867264 00000100:00100000:0.0:1788530331.713993:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555866368 00000100:00100000:0.0:1788530331.714004:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555866368 00000100:00100000:0.0:1788530331.714015:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555866880 00000100:00100000:0.0:1788530331.714017:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555866880 00000100:00100000:0.0:1788530331.714027:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555867392 00000100:00100000:0.0:1788530331.714029:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555867392 00000100:00100000:0.0:1788530331.714038:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555866496 00000100:00100000:0.0:1788530331.714040:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555866496 00000100:00100000:0.0:1788530331.714051:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 441 00000100:00100000:0.0:1788530331.714057:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875409555866752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530331.714087:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875409555866752:12345-0@lo:400:kworker.0 Request processed in 30us (1144us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530331.714093:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 441 00000100:00100000:0.0:1788530331.714104:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 442 00000100:00100000:0.0:1788530331.714109:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875409555867264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530331.714128:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875409555867264:12345-0@lo:400:kworker.0 Request processed in 19us (1150us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530331.714133:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 442 00000100:00100000:0.0:1788530331.714142:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 443 00000100:00100000:0.0:1788530331.714146:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875409555866368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530331.714169:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875409555866368:12345-0@lo:400:kworker.0 Request processed in 23us (976us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530331.714175:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 443 00000100:00100000:0.0:1788530331.714185:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 444 00000100:00100000:0.0:1788530331.714190:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875409555866880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530331.714214:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875409555866880:12345-0@lo:400:kworker.0 Request processed in 24us (866us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530331.715331:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 444 00000100:00100000:0.0:1788530331.715435:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 445 00000100:00100000:0.0:1788530331.715794:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875409555867392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530331.715859:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875409555867392:12345-0@lo:400:kworker.0 Request processed in 417us (2442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530331.715865:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 445 00000100:00100000:0.0:1788530331.715881:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 446 00000100:00100000:0.0:1788530331.715888:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875409555866496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530331.715916:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875409555866496:12345-0@lo:400:kworker.0 Request processed in 29us (2289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530331.715921:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 446 00000100:00100000:0.0:1788530331.715953:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555866624 00000100:00100000:0.0:1788530331.715960:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555866624 00000100:00100000:0.0:1788530331.715999:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1788530331.716006:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555866624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530331.716039:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555866624:12345-0@lo:400:kworker.0 Request processed in 33us (3009us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530331.716045:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1788530331.716084:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555867136 00000100:00100000:0.0:1788530331.716088:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555867136 00000100:00100000:0.0:1788530331.716113:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555867648 00000100:00100000:0.0:1788530331.716116:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555867648 00000100:00100000:0.0:1788530331.716128:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555867008 00000100:00100000:0.0:1788530331.716131:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555867008 00000100:00100000:0.0:1788530331.716142:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555867520 00000100:00100000:0.0:1788530331.716144:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555867520 00000100:00100000:0.0:1788530331.716157:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788530331.716162:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555867136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530331.716195:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555867136:12345-0@lo:400:kworker.0 Request processed in 33us (3128us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530331.716211:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788530331.716845:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788530331.716864:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555867648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530331.716914:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555867648:12345-0@lo:400:kworker.0 Request processed in 54us (3781us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530331.716920:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788530331.716936:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788530331.716942:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555867008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530331.716967:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555867008:12345-0@lo:400:kworker.0 Request processed in 26us (3297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530331.716972:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788530331.716981:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788530331.718439:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555867520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530331.718625:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555867520:12345-0@lo:400:kworker.0 Request processed in 1636us (4921us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530331.718634:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00080000:3.0:1788530331.718655:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788530331.718661:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788530331.718664:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788530331.718667:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788530331.718832:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875409555866496:0@lo:400:kworker.0 00000100:00100000:0.0:1788530331.718850:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555867008:0@lo:400:kworker.0 00000100:00100000:0.0:1788530331.718861:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555867520:0@lo:400:kworker.0 00000100:00100000:0.0:1788530331.718874:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875409555866368:0@lo:400:kworker.0 00010000:00080000:0.0:1788530331.718889:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e03d83480 x1875409555866880/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530347 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530331.718902:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875409555866880:0@lo:400:kworker.0 00010000:00080000:0.0:1788530331.718916:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e03d80e00 x1875409555867392/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530347 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530331.718925:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875409555867392:0@lo:400:kworker.0 00000100:00100000:0.0:1788530331.718975:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d258e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555867776:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788530331.719025:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530331.719074:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555866624:0@lo:400:kworker.0 00000100:00100000:0.0:1788530331.719090:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555867136:0@lo:400:kworker.0 00000100:00100000:0.0:1788530331.719103:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555867648:0@lo:400:kworker.0 00000100:00100000:0.0:1788530331.719117:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3650:1875409555866240:0@lo:400:kworker.0 00000100:00100000:0.0:1788530331.719130:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875409555866752:0@lo:400:kworker.0 00000100:00100000:0.0:1788530331.719143:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875409555867264:0@lo:400:kworker.0 00000100:00100000:2.0:1788530331.719303:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555867776 00000100:00100000:2.0:1788530331.719310:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555867776 00000100:00100000:2.0:1788530331.719367:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1788530331.719376:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555867776:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788530331.719403:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788530331.719470:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555867776:12345-0@lo:13:osp-pre-1-1.0 Request processed in 95us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530331.719478:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1788530331.719518:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d258e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555867776:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788530331.720807:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d259c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555868160:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788530331.720870:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530331.720930:0:9912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555868160 00000100:00100000:3.0:1788530331.720937:0:9912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555868160 00000100:00100000:3.0:1788530331.720978:0:9912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1788530331.720987:0:9912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d25b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555868160:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788530331.721020:0:9912:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788530331.721060:0:9912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d25b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555868160:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530331.721074:0:9912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1788530331.721119:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d259c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555868160:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788530331.721142:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d25ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555868032:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788530331.721163:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530331.721179:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788530331.721185:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d25aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555867904:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788530331.721206:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530331.721326:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555868032 00000100:00100000:0.0:1788530331.721331:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555868032 00000100:00100000:0.0:1788530331.721348:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555867904 00000100:00100000:0.0:1788530331.721351:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555867904 00000100:00100000:0.0:1788530331.721821:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788530331.721830:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d259c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555868032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788530331.721848:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788530331.721896:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d259c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555868032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (731us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530331.721903:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788530331.721920:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1788530331.721927:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d25a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555867904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788530331.721940:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788530331.721969:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d25a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555867904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 43us (762us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530331.721976:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1788530331.722709:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d25aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555867904:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788530331.723309:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d25ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555868032:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788530331.843634:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788530332.739085:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555868288:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788530332.739182:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530332.739381:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555868288 00000100:00100000:0.0:1788530332.739392:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555868288 00000100:00100000:0.0:1788530332.739468:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1788530332.739480:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03767800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555868288:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788530332.739521:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446453248 avail 1300213760 00000100:00100000:0.0:1788530332.739630:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03767800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555868288:12345-0@lo:41:osp-pre-1-0.0 Request processed in 152us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530332.739639:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1788530332.739748:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555868288:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788530332.873926:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788530333.497114:0:15169:0:(tgt_mount.c:2269:server_umount_begin()) umount -f 00000020:01000004:1.0:1788530333.557705:0:15169:0:(tgt_mount.c:2125:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1788530333.557761:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9e025dd000/0xb28d70e1257505e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257505ec expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530333.557777:0:15169:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9e025dd000/0xb28d70e1257505e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e1257505ec expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530333.557784:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9e025dd000/0xb28d70e1257505e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x11000400000000 nid: local remote: 0xb28d70e1257505ec expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530333.557792:0:15169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.141@tcp lock: ffff9a9e025dd000/0xb28d70e1257505e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x11000400000000 nid: local remote: 0xb28d70e1257505ec expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530333.557818:0:15169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788530333.557824:0:15169:0:(mgc_request.c:651:config_log_end()) end config log lustre-client (0) 00010000:00010000:3.0:1788530333.557841:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788530333.557850:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9e025dd000/0xb28d70e1257505e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x1000400000000 nid: local remote: 0xb28d70e1257505ec expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788530333.557853:0:15169:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788530333.557859:0:15169:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00010000:00010000:3.0:1788530333.557862:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9e025dd000 already unused, calling callback (ffffffffc1349e00) 00000100:00080000:1.0:1788530333.557866:0:15169:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 10000000:00010000:3.0:1788530333.557868:0:6512:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9e025dd000/0xb28d70e1257505e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x1000400000000 nid: local remote: 0xb28d70e1257505ec expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530333.557880:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9e025dd000/0xb28d70e1257505e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x1008400000000 nid: local remote: 0xb28d70e1257505ec expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788530333.557887:0:6512:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9e025dd000/0xb28d70e1257505e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x1009400000000 nid: local remote: 0xb28d70e1257505ec expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788530333.557893:0:6512:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00080000:1.0:1788530333.557893:0:15169:0:(import.c:65:import_set_state_nolock()) ffff9a9f32879800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 10000000:01000000:3.0:1788530333.557899:0:6512:0:(mgc_request.c:1235:mgc_blocking_ast()) log lustre-client: stale lock, won't requeue 10000000:01000000:3.0:1788530333.557902:0:6512:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788530333.557993:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9e025dd000/0xb28d70e1257505e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x5809400000020 nid: local remote: 0xb28d70e1257505ec expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530333.558001:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788530333.558031:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9e025dd000/0xb28d70e1257505e5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x5809400000020 nid: local remote: 0xb28d70e1257505ec expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530333.558039:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9e025dd000/0xb28d70e1257505e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x5809400000020 nid: local remote: 0xb28d70e1257505ec expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530333.558052:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530333.558055:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530333.558057:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788530333.558106:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d25ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3647:1875409555868544:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788530333.558174:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530333.558287:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875409555868416:0@lo:39:umount.0 00000100:00100000:0.0:1788530333.558330:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530333.558436:0:10347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555868544 00000100:00100000:1.0:1788530333.558444:0:10347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555868544 00000100:00100000:1.0:1788530333.558504:0:10347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788530333.558519:0:10347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37375500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:3647:x1875409555868544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788530333.558532:0:10347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1788530333.558540:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555868416 00000100:00100000:2.0:1788530333.558547:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555868416 00010000:00010000:1.0:1788530333.558582:0:10347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f0c91de00/0xb28d70e1257505ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb28d70e1257505e5 expref: 29 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530333.558600:0:10347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788530333.558627:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1788530333.558637:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875409555868416:12345-0@lo:39:umount.0 00000100:00100000:1.0:1788530333.558644:0:10347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37375500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+28:3647:x1875409555868544:12345-0@lo:103:ldlm_bl.0 Request processed in 130us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530333.558658:0:10347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000020:00000080:2.0:1788530333.558675:0:6524:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e1257500ac 00000100:00080000:2.0:1788530333.558684:0:6524:0:(import.c:65:import_set_state_nolock()) ffff9a9f32a9d800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788530333.559033:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3646:x1875409555868416:12345-0@lo:39:umount.0 Request processed in 397us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530333.559040:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000020:00000080:2.0:1788530333.559048:0:6524:0:(genops.c:885:class_export_put()) final put ffff9a9f32a9e000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00100000:2.0:1788530333.559086:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d25ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3647:1875409555868544:0@lo:103:ldlm_bl.0 00000020:00000080:2.0:1788530333.559107:0:12493:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f32a9e000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00010000:00010000:3.0:1788530333.559141:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788530333.559157:0:12493:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a9f32a9d800 for lustre-MDT0000 00000100:00080000:0.0:1788530333.559212:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9f32879800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788530333.559228:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875409555868416:0@lo:39:umount.0 00000100:00080000:1.0:1788530333.559280:0:15169:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788530333.559284:0:15169:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788530333.559289:0:15169:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788530333.561905:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9e025dd200/0xb28d70e1257505f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257505fa expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530333.561929:0:15169:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9e025dd200/0xb28d70e1257505f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e1257505fa expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530333.561936:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9e025dd200/0xb28d70e1257505f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x11000400000000 nid: local remote: 0xb28d70e1257505fa expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530333.561944:0:15169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.141@tcp lock: ffff9a9e025dd200/0xb28d70e1257505f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x11000400000000 nid: local remote: 0xb28d70e1257505fa expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530333.562329:0:15169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788530333.562339:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f18141600/0xb28d70e1257504bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257504c6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530333.562348:0:15169:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f18141600/0xb28d70e1257504bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e1257504c6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530333.562354:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f18141600/0xb28d70e1257504bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xb28d70e1257504c6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530333.562378:0:15169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.141@tcp lock: ffff9a9f18141600/0xb28d70e1257504bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xb28d70e1257504c6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530333.562398:0:15169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788530333.562406:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f42167c00/0xb28d70e125750854 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575085b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530333.562412:0:15169:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f42167c00/0xb28d70e125750854 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e12575085b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530333.562418:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f42167c00/0xb28d70e125750854 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xb28d70e12575085b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530333.562424:0:15169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.141@tcp lock: ffff9a9f42167c00/0xb28d70e125750854 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xb28d70e12575085b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530333.562457:0:15169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1788530333.562464:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f01526000/0xb28d70e12575000b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125750012 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530333.562471:0:15169:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f01526000/0xb28d70e12575000b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e125750012 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530333.562477:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f01526000/0xb28d70e12575000b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xb28d70e125750012 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530333.562482:0:15169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.141@tcp lock: ffff9a9f01526000/0xb28d70e12575000b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xb28d70e125750012 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530333.562501:0:15169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:1.0:1788530333.562507:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9e025ddc00/0xb28d70e125750601 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125750608 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530333.562513:0:15169:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9e025ddc00/0xb28d70e125750601 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e125750608 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530333.562520:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9e025ddc00/0xb28d70e125750601 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x11000400000000 nid: local remote: 0xb28d70e125750608 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530333.562527:0:15169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.141@tcp lock: ffff9a9e025ddc00/0xb28d70e125750601 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x11000400000000 nid: local remote: 0xb28d70e125750608 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530333.562534:0:15169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 10000000:01000000:1.0:1788530333.562538:0:15169:0:(mgc_request.c:651:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:1.0:1788530333.562616:0:15169:0:(tgt_mount.c:2175:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1788530333.562622:0:15169:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1788530333.562627:0:15169:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788530333.562635:0:15169:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/9 00000020:00080000:1.0:1788530333.562645:0:15169:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9a9e025c8000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788530333.562652:0:15169:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9a9e010c6000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788530333.562657:0:15169:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9a9f33b6d000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788530333.562662:0:15169:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9a9f33b5b000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:1.0:1788530333.562667:0:15169:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9a9f39653310) has exports, disconnecting them 00000020:00080000:1.0:1788530333.562672:0:15169:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9a9e025c8000), last request at 1788530331 00000020:00000080:1.0:1788530333.562682:0:15169:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e1257503f4 00000100:00080000:1.0:1788530333.562705:0:15169:0:(import.c:65:import_set_state_nolock()) ffff9a9e025cb000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788530333.562754:0:15169:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a9e025c8000): rc 0 00000020:00000080:1.0:1788530333.562757:0:15169:0:(genops.c:885:class_export_put()) final put ffff9a9e025c8000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1788530333.562766:0:15169:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9a9e010c6000), last request at 1788530331 00000020:00000080:1.0:1788530333.562769:0:15169:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e1257502a4 00000100:00080000:1.0:1788530333.562775:0:15169:0:(import.c:65:import_set_state_nolock()) ffff9a9e010c3800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788530333.562781:0:15169:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a9e010c6000): rc 0 00000020:00000080:1.0:1788530333.562783:0:15169:0:(genops.c:885:class_export_put()) final put ffff9a9e010c6000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:1.0:1788530333.562788:0:15169:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9a9f33b6d000), last request at 1788530049 00000020:00000080:1.0:1788530333.562790:0:15169:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e125750193 00000100:00080000:1.0:1788530333.562794:0:15169:0:(import.c:65:import_set_state_nolock()) ffff9a9f33b6e000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788530333.562799:0:15169:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a9f33b6d000): rc 0 00000020:00000080:1.0:1788530333.562801:0:15169:0:(genops.c:885:class_export_put()) final put ffff9a9f33b6d000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:1.0:1788530333.562805:0:15169:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9a9f33b5b000), last request at 1788530049 00000020:00000080:1.0:1788530333.562808:0:15169:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e125750162 00000100:00080000:1.0:1788530333.562811:0:15169:0:(import.c:65:import_set_state_nolock()) ffff9a9f33b5a000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788530333.562818:0:15169:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967529 00010000:00010000:0.0:1788530333.562872:0:10348:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788530333.562882:0:10348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9e025dd200/0xb28d70e1257505f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1000400000000 nid: local remote: 0xb28d70e1257505fa expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530333.562891:0:10348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9e025dd200 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:0.0:1788530333.562896:0:10348:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9e025dd200/0xb28d70e1257505f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1000400000000 nid: local remote: 0xb28d70e1257505fa expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788530333.562909:0:15169:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a9f33b5b000): rc 0 00010000:00010000:0.0:1788530333.562909:0:10348:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9e025dd200/0xb28d70e1257505f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1008400000000 nid: local remote: 0xb28d70e1257505fa expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00000080:1.0:1788530333.562922:0:15169:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb378079bbae0 10000000:00010000:0.0:1788530333.562922:0:10348:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9e025dd200/0xb28d70e1257505f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1009400000000 nid: local remote: 0xb28d70e1257505fa expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788530333.562933:0:10348:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788530333.562936:0:10348:0:(mgc_request.c:1235:mgc_blocking_ast()) log lustre-MDT0000: stale lock, won't requeue 10000000:01000000:0.0:1788530333.562939:0:10348:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00000100:00080000:1.0:1788530333.562952:0:15169:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788530333.562958:0:15169:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00010000:00010000:0.0:1788530333.563008:0:10348:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9e025dd200/0xb28d70e1257505f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x5809400000020 nid: local remote: 0xb28d70e1257505fa expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530333.563018:0:10348:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788530333.563051:0:10348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9e025dd200/0xb28d70e1257505f3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x5809400000020 nid: local remote: 0xb28d70e1257505fa expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530333.563059:0:10348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9e025dd200/0xb28d70e1257505f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x5809400000020 nid: local remote: 0xb28d70e1257505fa expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530333.563085:0:10348:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788530333.563090:0:10348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f18141600/0xb28d70e1257504bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xb28d70e1257504c6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530333.563096:0:10348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f18141600 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:0.0:1788530333.563099:0:10348:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f18141600/0xb28d70e1257504bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xb28d70e1257504c6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530333.563106:0:10348:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f18141600/0xb28d70e1257504bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xb28d70e1257504c6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788530333.563114:0:10348:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f18141600/0xb28d70e1257504bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xb28d70e1257504c6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788530333.563119:0:10348:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1788530333.563121:0:10348:0:(mgc_request.c:1235:mgc_blocking_ast()) log lustre-mdtir: stale lock, won't requeue 10000000:01000000:0.0:1788530333.563123:0:10348:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1788530333.563149:0:10348:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9f18141600/0xb28d70e1257504bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xb28d70e1257504c6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530333.563155:0:10348:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788530333.563171:0:10348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f18141600/0xb28d70e1257504bf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xb28d70e1257504c6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530333.563178:0:10348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f18141600/0xb28d70e1257504bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xb28d70e1257504c6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530333.563190:0:10348:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788530333.563193:0:10348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f42167c00/0xb28d70e125750854 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xb28d70e12575085b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530333.563205:0:10348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f42167c00 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:0.0:1788530333.563208:0:10348:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f42167c00/0xb28d70e125750854 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xb28d70e12575085b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530333.563214:0:10348:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f42167c00/0xb28d70e125750854 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xb28d70e12575085b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788530333.563220:0:10348:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f42167c00/0xb28d70e125750854 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xb28d70e12575085b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788530333.563226:0:10348:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788530333.563228:0:10348:0:(mgc_request.c:1235:mgc_blocking_ast()) log params: stale lock, won't requeue 10000000:01000000:0.0:1788530333.563230:0:10348:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788530333.563266:0:10348:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9f42167c00/0xb28d70e125750854 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xb28d70e12575085b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530333.563272:0:10348:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788530333.563279:0:10348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f42167c00/0xb28d70e125750854 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xb28d70e12575085b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530333.563287:0:10348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f42167c00/0xb28d70e125750854 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xb28d70e12575085b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530333.563297:0:10348:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788530333.563300:0:10348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f01526000/0xb28d70e12575000b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xb28d70e125750012 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530333.563305:0:10348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f01526000 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:0.0:1788530333.563308:0:10348:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f01526000/0xb28d70e12575000b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xb28d70e125750012 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530333.563322:0:10348:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f01526000/0xb28d70e12575000b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xb28d70e125750012 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788530333.563328:0:10348:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f01526000/0xb28d70e12575000b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xb28d70e125750012 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788530333.563334:0:10348:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1788530333.563336:0:10348:0:(mgc_request.c:1235:mgc_blocking_ast()) log lustre-barrier: stale lock, won't requeue 10000000:01000000:0.0:1788530333.563338:0:10348:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1788530333.563374:0:10348:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9f01526000/0xb28d70e12575000b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xb28d70e125750012 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530333.563380:0:10348:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788530333.563387:0:10348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f01526000/0xb28d70e12575000b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xb28d70e125750012 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530333.563393:0:10348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f01526000/0xb28d70e12575000b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xb28d70e125750012 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530333.563404:0:10348:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788530333.563407:0:10348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9e025ddc00/0xb28d70e125750601 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1000400000000 nid: local remote: 0xb28d70e125750608 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530333.563414:0:10348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9e025ddc00 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:0.0:1788530333.563416:0:10348:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9e025ddc00/0xb28d70e125750601 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1000400000000 nid: local remote: 0xb28d70e125750608 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530333.563423:0:10348:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9e025ddc00/0xb28d70e125750601 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1008400000000 nid: local remote: 0xb28d70e125750608 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788530333.563451:0:10348:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9e025ddc00/0xb28d70e125750601 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1009400000000 nid: local remote: 0xb28d70e125750608 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788530333.563457:0:10348:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788530333.563459:0:10348:0:(mgc_request.c:1235:mgc_blocking_ast()) log lustre-sptlrpc: stale lock, won't requeue 10000000:01000000:0.0:1788530333.563461:0:10348:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1788530333.563487:0:10348:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9e025ddc00/0xb28d70e125750601 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5809400000020 nid: local remote: 0xb28d70e125750608 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530333.563493:0:10348:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788530333.563498:0:10348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9e025ddc00/0xb28d70e125750601 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5809400000020 nid: local remote: 0xb28d70e125750608 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530333.563505:0:10348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9e025ddc00/0xb28d70e125750601 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5809400000020 nid: local remote: 0xb28d70e125750608 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530333.563515:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530333.563517:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530333.563519:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788530333.563538:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3648:1875409555868672:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788530333.563628:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530333.563682:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3648:1875409555869184:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788530333.563956:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530333.563981:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00080000:1.0:1788530333.563985:0:15169:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1788530333.563989:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3648:1875409555869056:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1788530333.564007:0:15169:0:(import.c:65:import_set_state_nolock()) ffff9a9f339ed000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788530333.564018:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530333.564053:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3649:1875409555868800:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788530333.564087:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530333.564114:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788530333.564120:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3649:1875409555868928:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788530333.564143:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530333.564167:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555868672 00000100:00100000:0.0:1788530333.564177:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555868672 00000100:00100000:0.0:1788530333.564219:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555869184 00000100:00100000:0.0:1788530333.564222:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555869184 00000100:00100000:0.0:1788530333.564234:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555869056 00000100:00100000:0.0:1788530333.564236:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555869056 00000100:00100000:0.0:1788530333.564246:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555868800 00000100:00100000:0.0:1788530333.564248:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555868800 00000100:00100000:0.0:1788530333.564256:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555868928 00000100:00100000:0.0:1788530333.564258:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555868928 00000100:00100000:0.0:1788530333.564271:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788530333.564279:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d81f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+32:3648:x1875409555868672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788530333.564291:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788530333.564306:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f3d36aa00/0xb28d70e1257505fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb28d70e1257505f3 expref: 32 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530333.564321:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788530333.564343:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788530333.564355:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d80e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+31:3648:x1875409555869184:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788530333.564362:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d81f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+31:3648:x1875409555868672:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (732us total) trans 0 rc 0/0 00010000:00010000:2.0:1788530333.564367:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1788530333.564372:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:2.0:1788530333.564382:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f3d36a200/0xb28d70e125750608 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb28d70e125750601 expref: 31 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530333.564394:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00010000:00010000:2.0:1788530333.564395:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788530333.564404:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d83480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:3648:x1875409555869056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788530333.564414:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788530333.564425:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f00030200/0xb28d70e125750012 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb28d70e12575000b expref: 29 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530333.564441:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d80e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+29:3648:x1875409555869184:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530333.564451:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:0.0:1788530333.564465:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788530333.564473:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788530333.564481:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d83b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+27:3649:x1875409555868800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788530333.564491:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1788530333.564495:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d83480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+27:3648:x1875409555869056:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (475us total) trans 0 rc 0/0 00010000:00010000:2.0:1788530333.564503:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f18141a00/0xb28d70e1257504c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb28d70e1257504bf expref: 27 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530333.564504:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:2.0:1788530333.564518:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788530333.564525:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788530333.564532:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f08d7d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+25:3649:x1875409555868928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788530333.564542:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788530333.564553:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f42167600/0xb28d70e12575085b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb28d70e125750854 expref: 25 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530333.564588:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788530333.564599:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d83b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+24:3649:x1875409555868800:12345-0@lo:103:ldlm_bl.0 Request processed in 118us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530333.564608:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788530333.564618:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f08d7d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+24:3649:x1875409555868928:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530333.564625:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788530333.564680:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875409555869312:0@lo:39:umount.0 00010000:00010000:2.0:1788530333.564699:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530333.564764:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788530333.565555:0:12493:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9e025c8000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1788530333.565636:0:12493:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9e010c6000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788530333.565658:0:12493:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f33b6d000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1788530333.565682:0:12493:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a9e025cb000 for lustre-MDT0000 00000020:00000080:3.0:1788530333.565686:0:12493:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a9e010c3800 for lustre-MDT0000 00000020:00000080:3.0:1788530333.565689:0:12493:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a9f33b6e000 for lustre-MDT0000 00000100:00080000:1.0:1788530333.565812:0:15169:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788530333.565819:0:15169:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:1.0:1788530333.565832:0:15169:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788530333.565898:0:15169:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1788530333.565927:0:15169:0:(import.c:65:import_set_state_nolock()) ffff9a9e02588000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1788530333.565939:0:15169:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788530333.565957:0:15169:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967326 gen 3 00000004:00080000:1.0:1788530333.565977:0:15169:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788530333.566053:0:15169:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1788530333.566064:0:15169:0:(import.c:65:import_set_state_nolock()) ffff9a9e010c4000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1788530333.566117:0:15169:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9a9f39653310) has no exports 00000100:00100000:2.0:1788530333.566686:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3649:1875409555868928:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788530333.566698:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3649:1875409555868800:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788530333.569922:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530333.569988:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875409555869440:0@lo:9:umount.0 00000100:00100000:0.0:1788530333.570029:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530333.570058:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875409555869568:0@lo:9:umount.0 00000100:00100000:0.0:1788530333.570090:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530333.570142:0:14186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555869312 00000100:00100000:0.0:1788530333.570151:0:14186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555869312 00000100:00100000:0.0:1788530333.570208:0:14186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1788530333.570219:0:14186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875409555869312:12345-0@lo:39:umount.0 00000020:00000080:0.0:1788530333.570249:0:14186:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e1257501ee 00000100:00080000:0.0:1788530333.570271:0:14186:0:(import.c:65:import_set_state_nolock()) ffff9a9f3d26a000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788530333.570297:0:14186:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:0.0:1788530333.573548:0:14186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+3:3646:x1875409555869312:12345-0@lo:39:umount.0 Request processed in 3319us (3624us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788530333.573599:0:14186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1788530333.573663:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555869440 00000100:00100000:0.0:1788530333.573675:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555869440 00000100:00100000:0.0:1788530333.574672:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555869568 00000100:00100000:0.0:1788530333.574681:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555869568 00000100:00100000:0.0:1788530333.574854:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788530333.574865:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875409555869440:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788530333.574896:0:8436:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e125750368 00000100:00080000:0.0:1788530333.574907:0:8436:0:(import.c:65:import_set_state_nolock()) ffff9a9e025c9800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788530333.574955:0:8436:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:0.0:1788530333.575135:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3646:x1875409555869440:12345-0@lo:9:umount.0 Request processed in 273us (5107us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530333.575143:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788530333.575159:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788530333.575166:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875409555869568:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788530333.575176:0:8436:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e1257504fe 00000100:00080000:0.0:1788530333.575182:0:8436:0:(import.c:65:import_set_state_nolock()) ffff9a9e027a8800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788530333.575206:0:8436:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967326 00000100:00100000:0.0:1788530333.575283:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3646:x1875409555869568:12345-0@lo:9:umount.0 Request processed in 118us (5195us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530333.575290:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:0.0:1788530333.575323:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788530333.575327:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788530333.575338:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530333.575357:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530333.575362:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788530333.575398:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9e02588000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788530333.575411:0:3646:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788530333.575413:0:3646:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788530333.575417:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875409555869440:0@lo:9:umount.0 00000100:00080000:0.0:1788530333.576773:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9e010c4000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788530333.576803:0:3646:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788530333.576806:0:3646:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788530333.576814:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875409555869568:0@lo:9:umount.0 00000100:00080000:0.0:1788530333.576845:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9f339ed000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788530333.576850:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875409555869312:0@lo:39:umount.0 00000100:00100000:1.0:1788530333.580213:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3648:1875409555869056:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788530333.580236:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3648:1875409555868672:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788530333.580245:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3648:1875409555869184:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1788530333.594399:0:15169:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9a9f39653310) has no exports 00000020:00000080:2.0:1788530333.684447:0:15169:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e125750066 00000020:00000080:2.0:1788530333.684466:0:15169:0:(genops.c:885:class_export_put()) final put ffff9a9f2b95f000/lustre-QMT0000_UUID 00000020:01000000:2.0:1788530333.684494:0:15169:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1788530333.685603:0:476:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f2b95f000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1788530333.688006:0:15169:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788530333.688025:0:15169:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788530333.688040:0:15169:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9a9f32881988) has no exports 00000020:00000080:2.0:1788530333.688892:0:15169:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e12575005f 00000020:00000080:2.0:1788530333.688906:0:15169:0:(genops.c:885:class_export_put()) final put ffff9a9f32878000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788530333.689001:0:15169:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788530333.689013:0:15169:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788530333.689017:0:15169:0:(genops.c:885:class_export_put()) final put ffff9a9f3287e000/lustre-QMT0000_UUID 00000020:00000080:2.0:1788530333.689021:0:15169:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f3287e000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1788530333.689042:0:15169:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:0.0:1788530333.689089:0:476:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f32878000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:0.0:1788530333.888881:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530334.913018:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788530335.299722:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788530335.299732:0:9518:0:(genops.c:885:class_export_put()) final put ffff9a9e027ad800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1788530335.299757:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41 00000020:00000080:3.0:1788530335.299760:0:9518:0:(genops.c:885:class_export_put()) final put ffff9a9e03e59800/aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41 00000020:00000080:0.0:1788530335.299847:0:476:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9e027ad800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1788530335.300080:0:476:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9e03e59800/aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41 for lustre-OST0001 00000020:00000080:0.0:1788530335.300105:0:476:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a9e027a8800 for lustre-OST0001 00000020:00000080:0.0:1788530335.300109:0:476:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a9e03e5e800 for lustre-OST0001 00000001:00100000:1.0:1788530335.305698:0:7454:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1788530335.305719:0:7454:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:1.0:1788530335.305732:0:7454:0:(genops.c:885:class_export_put()) final put ffff9a9f32a99800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1788530335.305758:0:7454:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc 00000001:00080000:1.0:1788530335.305763:0:7454:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:1.0:1788530335.305766:0:7454:0:(genops.c:885:class_export_put()) final put ffff9a9e027ac800/5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc 00000001:00100000:1.0:1788530335.305771:0:7454:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41 00000001:00080000:1.0:1788530335.305775:0:7454:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:1.0:1788530335.305777:0:7454:0:(genops.c:885:class_export_put()) final put ffff9a9f373f1800/aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41 00000001:00100000:2.0:1788530335.306374:0:8431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788530335.306381:0:8431:0:(genops.c:885:class_export_put()) final put ffff9a9e025cf000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1788530335.306394:0:8431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41 00000020:00000080:2.0:1788530335.306397:0:8431:0:(genops.c:885:class_export_put()) final put ffff9a9e03dee800/aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41 00000020:00000080:3.0:1788530335.306738:0:12493:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f32a99800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:3.0:1788530335.306814:0:12493:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9e027ac800/5d40b2c0-eae0-4e8b-ae82-fea9067ae2cc for lustre-MDT0001 00000020:00000080:3.0:1788530335.306842:0:12493:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f373f1800/aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41 for lustre-MDT0001 00000020:00000080:3.0:1788530335.306865:0:12493:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9e025cf000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1788530335.306901:0:12493:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9e03dee800/aa0f0d00-468b-4e6a-b1b0-bc3bb88d5c41 for lustre-OST0000 00000020:00000080:3.0:1788530335.306922:0:12493:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a9f3d26a000 for lustre-MDT0001 00000020:00000080:3.0:1788530335.306927:0:12493:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a9e027ac000 for lustre-MDT0001 00000020:00000080:3.0:1788530335.306930:0:12493:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a9f373f2000 for lustre-MDT0001 00000020:00000080:3.0:1788530335.306933:0:12493:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a9e025c9800 for lustre-OST0000 00000020:00000080:3.0:1788530335.306937:0:12493:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a9e03de8000 for lustre-OST0000 00000040:00080000:2.0:1788530335.875816:0:13816:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788530335.938654:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788530336.320985:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788530336.321024:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555869696:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788530336.321114:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530336.321414:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555869696 00000100:00100000:0.0:1788530336.321423:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555869696 00000100:00100000:0.0:1788530336.321493:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1788530336.321501:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d25aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3650:x1875409555869696:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:0.0:1788530336.321510:0:6529:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788530336.321586:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d25aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3650:x1875409555869696:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (471us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788530336.321616:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:02020000:2.0:1788530336.321780:0:3650:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:2.0:1788530336.329873:0:3650:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788530336.329883:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9a9f3bd66000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788530336.329911:0:3650:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788530336.349252:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9a9f3bd66000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788530336.349263:0:3650:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 257 00000100:00080000:2.0:1788530336.349273:0:3650:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9a9f3bd66000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:2.0:1788530336.349334:0:3650:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9f37374700 x1875409555869824/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788530336.349446:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37374700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875409555869824:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1788530336.349516:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530336.349659:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555869824 00000100:00100000:2.0:1788530336.349764:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555869824 00000100:00100000:2.0:1788530336.349881:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1788530336.349890:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1875409555869824:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:2.0:1788530336.349908:0:6528:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788530336.359001:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1875409555869824:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 9107us (9481us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788530336.359014:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00080000:1.0:1788530336.359127:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9f3bd66000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788530336.359132:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788530336.359136:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37374700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875409555869824:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1788530336.832830:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788530336.832853:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d25ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555869952:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788530336.832922:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530336.832996:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555869952 00000100:00100000:3.0:1788530336.833003:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555869952 00000100:00100000:3.0:1788530336.833056:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1788530336.833065:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d258e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555869952:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788530336.833107:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788530336.833153:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d258e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555869952:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530336.833160:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00080000:3.0:1788530336.833185:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788530336.833225:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d25ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555869952:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788530336.834041:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788530336.834054:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d25ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555870080:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788530336.834103:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530336.834332:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555870080 00000100:00100000:3.0:1788530336.834338:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555870080 00000100:00100000:3.0:1788530336.834416:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1788530336.834424:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555870080:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788530336.834447:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788530336.834483:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555870080:12345-0@lo:13:osp-pre-1-1.0 Request processed in 60us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530336.834490:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1788530336.834603:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d25ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555870080:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1788530336.834686:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788530336.835360:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37375500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875409555870336:0@lo:400:kworker.0 00000100:00100000:2.0:1788530336.835413:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530336.835443:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03691880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875409555870848:0@lo:400:kworker.0 00000100:00100000:2.0:1788530336.835463:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530336.835480:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788530336.835485:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875409555870464:0@lo:400:kworker.0 00000100:00100000:2.0:1788530336.835506:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530336.835581:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37374700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3648:1875409555870208:0@lo:400:kworker.0 00000100:00100000:1.0:1788530336.835623:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530336.835670:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875409555870720:0@lo:400:kworker.0 00000100:00100000:1.0:1788530336.835692:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530336.835708:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788530336.835713:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875409555870592:0@lo:400:kworker.0 00000100:00100000:1.0:1788530336.835733:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530336.835968:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555870208 00000100:00100000:2.0:1788530336.835974:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555870208 00000100:00100000:2.0:1788530336.836027:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 460 00000100:00100000:2.0:1788530336.836035:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0a7ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+23:3648:x1875409555870208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530336.836075:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0a7ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b+23:3648:x1875409555870208:12345-0@lo:400:kworker.0 Request processed in 41us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530336.836103:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 460 00000100:00100000:1.0:1788530336.836240:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37374700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3648:1875409555870208:0@lo:400:kworker.0 00000100:00100000:0.0:1788530336.836316:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555870336 00000100:00100000:0.0:1788530336.836320:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555870336 00000100:00100000:0.0:1788530336.836367:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555870848 00000100:00100000:0.0:1788530336.836370:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555870848 00000100:00100000:0.0:1788530336.836411:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555870464 00000100:00100000:0.0:1788530336.836414:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555870464 00000100:00100000:0.0:1788530336.836424:0:10719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 447 00000100:00100000:0.0:1788530336.836430:0:10719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03692a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875409555870848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530336.836475:0:10719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03692a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875409555870848:12345-0@lo:400:kworker.0 Request processed in 45us (1011us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530336.836480:0:10719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 447 00000100:00100000:0.0:1788530336.836491:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555870720 00000100:00100000:0.0:1788530336.836494:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555870720 00000100:00100000:0.0:1788530336.836503:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555870592 00000100:00100000:0.0:1788530336.836506:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555870592 00000100:00100000:0.0:1788530336.836520:0:10719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 448 00000100:00100000:0.0:1788530336.836525:0:10719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875409555870592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530336.836557:0:10719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875409555870592:12345-0@lo:400:kworker.0 Request processed in 32us (823us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530336.836590:0:10719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 448 00000100:00100000:0.0:1788530336.836605:0:10719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1788530336.836609:0:10719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03690700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1875409555870336:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788530336.836615:0:10719:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00080000:1.0:1788530336.836770:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788530336.836808:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1788530336.836813:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03692680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1875409555870464:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788530336.836818:0:6523:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788530336.836865:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1788530336.836871:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3648:x1875409555870720:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788530336.836876:0:6524:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00010000:00080000:3.0:1788530336.836978:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e03691880 x1875409555870848/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530352 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530336.836990:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03691880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875409555870848:0@lo:400:kworker.0 00010000:00080000:3.0:1788530336.837016:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e027d9880 x1875409555870592/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530352 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530336.837024:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875409555870592:0@lo:400:kworker.0 00000100:00100000:1.0:1788530336.843290:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03692680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1875409555870464:12345-0@lo:400:kworker.0 Request processed in 6461us (7769us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788530336.843309:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00080000:3.0:1788530336.843459:0:3649:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788530336.843465:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9a9e02239000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788530336.843468:0:3649:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:0.0:1788530336.844941:0:10719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03690700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3649:x1875409555870336:12345-0@lo:400:kworker.0 Request processed in 8323us (9521us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788530336.844975:0:10719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788530336.845190:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3648:x1875409555870720:12345-0@lo:400:kworker.0 Request processed in 8316us (9495us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788530336.845199:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00080000:1.0:1788530336.845302:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788530336.845308:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9a9e0223a800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788530336.845312:0:3648:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788530336.845318:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9a9e0223a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788530336.845322:0:3648:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 311 00000100:00080000:1.0:1788530336.845330:0:3648:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9a9e0223a800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:1.0:1788530336.845361:0:3648:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9e037e5180 x1875409555870976/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788530336.845391:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875409555870720:0@lo:400:kworker.0 00000100:00100000:0.0:1788530336.846393:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1875409555870976:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1788530336.847575:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530336.855377:0:10720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555870976 00000100:00100000:1.0:1788530336.855421:0:10720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555870976 00000100:00100000:1.0:1788530336.855492:0:10720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1788530336.855502:0:10720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3646:x1875409555870976:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:1.0:1788530336.855525:0:10720:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:3.0:1788530336.864308:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9a9e02239000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788530336.864319:0:3649:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 281 00000100:00080000:3.0:1788530336.864329:0:3649:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9a9e02239000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:3.0:1788530336.864372:0:3649:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9f3d25ad80 x1875409555871104/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788530336.864468:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d25ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1875409555871104:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1788530336.864546:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530336.864676:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555871104 00000100:00100000:2.0:1788530336.864686:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555871104 00000100:00100000:2.0:1788530336.864738:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1788530336.864747:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1875409555871104:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:2.0:1788530336.864766:0:6525:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788530336.865063:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875409555870464:0@lo:400:kworker.0 00000100:00080000:3.0:1788530336.865110:0:3649:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788530336.865114:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9a9f33b6d800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788530336.865135:0:3649:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788530336.865139:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9a9f33b6d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788530336.865142:0:3649:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 257 00000100:00080000:3.0:1788530336.865146:0:3649:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9a9f33b6d800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:3.0:1788530336.865166:0:3649:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9e027d8700 x1875409555871232/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788530336.866648:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875409555871232:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1788530336.867353:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530336.867865:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1875409555871104:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 3116us (3316us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788530336.867878:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1788530336.867916:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555871232 00000100:00100000:2.0:1788530336.867928:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555871232 00000100:00100000:2.0:1788530336.867967:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1788530336.867976:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1875409555871232:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:2.0:1788530336.867998:0:6525:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788530336.868059:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1875409555871232:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 83us (707us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788530336.868065:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:0.0:1788530336.872983:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9e02239000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788530336.872998:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788530336.873004:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d25ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1875409555871104:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:0.0:1788530336.873044:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9f33b6d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788530336.873048:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788530336.873051:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875409555871232:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1788530336.874922:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37375500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875409555870336:0@lo:400:kworker.0 00000100:00100000:1.0:1788530336.898699:0:10720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3646:x1875409555870976:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 43187us (51131us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788530336.898714:0:10720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00080000:0.0:1788530336.899380:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9e0223a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788530336.899386:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788530336.899391:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1875409555870976:0@lo:38:ptlrpcd_00_01.0 00010000:00010000:0.0:1788530336.961948:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530337.984895:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788530338.887819:0:6502:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788530338.887838:0:6502:0:(genops.c:885:class_export_put()) final put ffff9a9f33b5b000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788530338.895512:0:476:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f33b5b000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:2.0:1788530338.895712:0:476:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a9f33b5a000 for lustre-MDT0000 00010000:00010000:0.0:1788530339.009144:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1788530339.777094:0:15169:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a9e034dd2a0 - data ffff9a9f2beac948/ffff9a9f33d7fc00 00000020:01000000:1.0:1788530339.777386:0:15169:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a9f32901c00 - data ffff9a9f2bd321b0/ffff9a9f32aec800 00000001:00000004:1.0:1788530339.784197:0:15169:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967529 00000100:00080000:2.0:1788530339.852390:0:15169:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788530339.852400:0:15169:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:2.0:1788530339.852436:0:15169:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9a9e037e4a80 x1875409555869312/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788530343 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530339.852468:0:15169:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1788530339.854661:0:15169:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788530339.854669:0:15169:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:2.0:1788530339.854680:0:15169:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788530339.854683:0:15169:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788530339.855054:0:8750:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788530339.855060:0:8750:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:0.0:1788530339.855070:0:8750:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1788530339.856122:0:15169:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788530339.856128:0:15169:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967326 gen 4 00000004:00080000:2.0:1788530339.856157:0:15169:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788530339.856159:0:15169:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788530339.856791:0:9905:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788530339.856796:0:9905:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:3.0:1788530339.856804:0:9905:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1788530339.858357:0:15169:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e12575002e 00000020:00000080:2.0:1788530339.858377:0:15169:0:(genops.c:885:class_export_put()) final put ffff9a9f2b9bc000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788530339.858751:0:12493:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f2b9bc000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788530339.865837:0:15169:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e125750043 00000020:00000080:2.0:1788530339.865857:0:15169:0:(genops.c:885:class_export_put()) final put ffff9a9f2b9bb800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788530339.865877:0:15169:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1788530339.865883:0:15169:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788530339.865894:0:15169:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788530339.865899:0:15169:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9a9f39651988) has no exports 00000004:01000000:2.0:1788530339.866078:0:15169:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1788530339.866087:0:15169:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e1257504e9 00000020:00000080:2.0:1788530339.866091:0:15169:0:(genops.c:885:class_export_put()) final put ffff9a9f373f4000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788530339.866095:0:15169:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1788530339.866099:0:15169:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788530339.866108:0:15169:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788530339.866110:0:15169:0:(genops.c:1558:class_disconnect_exports()) OBD device 28 (ffff9a9f33d91988) has no exports 00000020:00000080:2.0:1788530339.866116:0:15169:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e1257504e2 00000020:00000080:2.0:1788530339.866120:0:15169:0:(genops.c:885:class_export_put()) final put ffff9a9e010c4800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788530339.866595:0:12493:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f2b9bb800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:3.0:1788530339.866604:0:12493:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f373f4000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788530339.866609:0:12493:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9e010c4800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1788530339.867046:0:15169:0:(obd_class.h:688:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1788530339.867051:0:15169:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788530339.867055:0:15169:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967326 gen 5 00000004:00080000:2.0:1788530339.867062:0:15169:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788530339.867074:0:15169:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788530339.867155:0:15169:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788530339.867166:0:15169:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788530339.867172:0:15169:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e125750361 00000020:00000080:2.0:1788530339.867178:0:15169:0:(genops.c:885:class_export_put()) final put ffff9a9e0223b000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788530339.869038:0:12493:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a9e010c4000 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788530339.869057:0:12493:0:(genops.c:885:class_export_put()) final put ffff9a9f373f0000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788530339.869061:0:12493:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f373f0000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1788530339.869069:0:12493:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788530339.870000:0:15169:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1788530339.870014:0:15169:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788530339.870030:0:15169:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788530339.870036:0:15169:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff9a9f2c104c98) has no exports 00000020:00000080:2.0:1788530339.870048:0:15169:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e12575035a 00000020:00000080:2.0:1788530339.870057:0:15169:0:(genops.c:885:class_export_put()) final put ffff9a9e0258e800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788530339.874731:0:12493:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9e0223b000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788530339.875878:0:12493:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9e0258e800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1788530339.878621:0:15169:0:(obd_class.h:688:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1788530339.878640:0:15169:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788530339.878645:0:15169:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:2.0:1788530339.878653:0:15169:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788530339.878656:0:15169:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788530339.878702:0:15169:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788530339.878716:0:15169:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:2.0:1788530339.878733:0:15169:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1788530339.878740:0:15169:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e1257501e7 00000020:00000080:2.0:1788530339.878750:0:15169:0:(genops.c:885:class_export_put()) final put ffff9a9f3d0c1800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788530339.878756:0:15169:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:2.0:1788530339.878763:0:15169:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788530339.878768:0:15169:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788530339.878772:0:15169:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9a9f3d213310) has no exports 00000020:00000080:2.0:1788530339.878779:0:15169:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e1257501e0 00000020:00000080:2.0:1788530339.878783:0:15169:0:(genops.c:885:class_export_put()) final put ffff9a9f396b5800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788530339.880756:0:12493:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a9e02588000 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788530339.880769:0:12493:0:(genops.c:885:class_export_put()) final put ffff9a9e02238000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788530339.880783:0:12493:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9e02238000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1788530339.880791:0:12493:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788530339.880874:0:12493:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f3d0c1800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1788530339.880892:0:12493:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f396b5800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1788530339.908663:0:15169:0:(obd_class.h:688:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:3.0:1788530339.908674:0:15169:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788530339.908680:0:15169:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:3.0:1788530339.908690:0:15169:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788530339.908749:0:15169:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788530339.908763:0:15169:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788530339.908814:0:15169:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788530339.908818:0:15169:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788530339.908823:0:15169:0:(genops.c:885:class_export_put()) final put ffff9a9f2b9bf000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788530339.908828:0:15169:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f2b9bf000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1788530339.908839:0:15169:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788530339.908969:0:15169:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e12575004a 00000020:00000080:3.0:1788530339.908977:0:15169:0:(genops.c:885:class_export_put()) final put ffff9a9f2b9be000/lustre-MDD0000_UUID 00000020:01000000:3.0:1788530339.908984:0:15169:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1788530339.908989:0:15169:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788530339.908996:0:15169:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788530339.909000:0:15169:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9a9f39654c98) has no exports 00000020:00000080:3.0:1788530339.909024:0:15169:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788530339.909027:0:15169:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1788530339.909032:0:15169:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e125750051 00000020:00000080:3.0:1788530339.909037:0:15169:0:(genops.c:885:class_export_put()) final put ffff9a9f2b9bd000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1788530339.909049:0:15169:0:(tgt_mount.c:201:server_put_mount()) put mount ffff9a9f0aaed800 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1788530339.909053:0:15169:0:(obd_mount.c:712:lustre_put_lsi()) put ffff9a9f0aaed800 3 00000020:01000004:3.0:1788530339.909056:0:15169:0:(tgt_mount.c:134:server_deregister_mount()) deregister mount ffff9a9f0aaed800 from lustre-MDT0000 00000020:00000080:3.0:1788530339.909078:0:15169:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788530339.909082:0:15169:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1788530339.909085:0:15169:0:(genops.c:885:class_export_put()) final put ffff9a9f2b9ba000/lustre-MDT0000_UUID 00000020:00000080:3.0:1788530339.909087:0:15169:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f2b9ba000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1788530339.909095:0:15169:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1788530339.909126:0:15169:0:(obd_mount.c:580:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:3.0:1788530339.909155:0:15169:0:(tgt_mount.c:284:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1788530339.909158:0:15169:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1788530339.909161:0:15169:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788530339.909163:0:15169:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788530339.909171:0:15169:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9a9f1f5fe000 9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b 0@lo 22 (0 0 17) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788530339.909178:0:15169:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9a9f39650000) has exports, disconnecting them 00000020:00080000:3.0:1788530339.909183:0:15169:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9a9f1f5fe000), last request at 1788530025 00000020:00000080:3.0:1788530339.909201:0:15169:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e12574ffef 00000020:00010000:3.0:1788530339.909206:0:15169:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9a9f1f5fe000: total 2 00000100:00080000:3.0:1788530339.909210:0:15169:0:(import.c:65:import_set_state_nolock()) ffff9a9f1f5fb800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788530339.909232:0:15169:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a9f1f5fe000): rc 0 00000020:00080000:3.0:1788530339.909237:0:15169:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9a9f39650000) has no exports 00000020:00010000:0.0:1788530339.909769:0:6511:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9a9f1f5fe000: total 2 00010000:00010000:0.0:1788530339.909897:0:6511:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9a9f1f5fe000, canceled 0 locks, left on hash table 17. 00010000:00010000:0.0:1788530339.909939:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f3d101e00/0xb28d70e12575041e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb28d70e125750417 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530339.909962:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9e025dc200/0xb28d70e1257505de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb28d70e1257505d7 expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530339.909974:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f3d36a000/0xb28d70e12575056e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb28d70e125750567 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530339.909984:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f0c91d200/0xb28d70e12575057c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb28d70e125750575 expref: 15 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530339.909996:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f3d36a800/0xb28d70e12575058a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb28d70e125750583 expref: 14 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530339.910006:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f3d36ba00/0xb28d70e125750598 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb28d70e125750591 expref: 13 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530339.910015:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9e025dd400/0xb28d70e12575043a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb28d70e125750433 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530339.910025:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9e025dd800/0xb28d70e1257505b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb28d70e1257505ad expref: 11 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530339.910035:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f42167a00/0xb28d70e1257500eb lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb28d70e1257500e4 expref: 10 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530339.910052:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f3d20c600/0xb28d70e125750831 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb28d70e12575082a expref: 9 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530339.910077:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9e025dda00/0xb28d70e1257505a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb28d70e12575059f expref: 8 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530339.910089:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f42166600/0xb28d70e12575084d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb28d70e125750846 expref: 7 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530339.910099:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f18141000/0xb28d70e125750472 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb28d70e12575046b expref: 6 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530339.910109:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f0c91d400/0xb28d70e1257505c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb28d70e1257505bb expref: 5 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530339.910119:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f00030a00/0xb28d70e1257500f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb28d70e1257500f2 expref: 4 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530339.910522:0:6516:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9a9f2c0ea800:6516] 0 exiting: rc = 1 00010000:00010000:0.0:1788530339.910853:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f3d20de00/0xb28d70e12575083f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb28d70e125750838 expref: 3 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530339.910879:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f0c91c800/0xb28d70e1257505d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb28d70e1257505c9 expref: 2 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530339.910893:0:6511:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9a9f1f5fe000, canceled 17 locks, left on hash table 0. 00000020:00000080:0.0:1788530339.910919:0:6511:0:(genops.c:885:class_export_put()) final put ffff9a9f1f5fe000/9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b 00010000:00010000:0.0:1788530339.910932:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530339.910934:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530339.910937:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788530339.910979:0:6517:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9a9f2c0f4200:6517] 1 exiting: rc = 0 00000020:00000080:0.0:1788530339.911034:0:12493:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a9f339ed000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1788530339.911044:0:12493:0:(genops.c:885:class_export_put()) final put ffff9a9f32a99000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788530339.911059:0:12493:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f32a99000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:0.0:1788530339.911066:0:12493:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788530339.911124:0:12493:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f2b9be000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1788530339.911128:0:12493:0:(genops.c:885:class_export_put()) final put ffff9a9f2b9b9000/lustre-MDD0000_UUID 00000020:00000080:0.0:1788530339.911130:0:12493:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f2b9b9000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1788530339.912305:0:12493:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1788530339.912497:0:12493:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f2b9bd000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788530339.912505:0:12493:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f1f5fe000/9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b for MGS 00000020:00000080:0.0:1788530339.912575:0:12493:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a9f1f5fb800 for MGS 00000100:00100000:0.0:1788530339.912675:0:6518:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9a9f2c0f4800:6518] 2 exiting: rc = 0 00000100:00100000:3.0:1788530339.915613:0:15169:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530339.915629:0:15169:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530339.915648:0:15169:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530339.915655:0:15169:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530339.915661:0:15169:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530339.915666:0:15169:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530339.915672:0:15169:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530339.915677:0:15169:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530339.915681:0:15169:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530339.915687:0:15169:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530339.915693:0:15169:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530339.915699:0:15169:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530339.915704:0:15169:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530339.915710:0:15169:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530339.915717:0:15169:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530339.915724:0:15169:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530339.915731:0:15169:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530339.915737:0:15169:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530339.915744:0:15169:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530339.915750:0:15169:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530339.915757:0:15169:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530339.915797:0:15169:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530339.915804:0:15169:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530339.915809:0:15169:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530339.915816:0:15169:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530339.915821:0:15169:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530339.915827:0:15169:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530339.915835:0:15169:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530339.915842:0:15169:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530339.915849:0:15169:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530339.915855:0:15169:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530339.915860:0:15169:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530339.915866:0:15169:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530339.915875:0:15169:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530339.915883:0:15169:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530339.915889:0:15169:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530339.915896:0:15169:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530339.915901:0:15169:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530339.915908:0:15169:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530339.915915:0:15169:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530339.915921:0:15169:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530339.915931:0:15169:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530339.915938:0:15169:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530339.915944:0:15169:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530339.915950:0:15169:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530339.915956:0:15169:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530339.915962:0:15169:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530339.915968:0:15169:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530339.915976:0:15169:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530339.915982:0:15169:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530339.915988:0:15169:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530339.915993:0:15169:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530339.916000:0:15169:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530339.916006:0:15169:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530339.916013:0:15169:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530339.916019:0:15169:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530339.916034:0:15169:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530339.916040:0:15169:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530339.916046:0:15169:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530339.916052:0:15169:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530339.916058:0:15169:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530339.916063:0:15169:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530339.916069:0:15169:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530339.916076:0:15169:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:3.0:1788530339.924656:0:15169:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a9e022f1300 - data ffff9a9f2beeaa20/ffff9a9e03647c00 00000020:01000000:3.0:1788530339.924823:0:15169:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a9f1805ad20 - data ffff9a9f2bc2bd80/ffff9a9f08cd1c00 00000020:00000080:3.0:1788530339.926500:0:15169:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e12574ffd3 00000020:00000080:3.0:1788530339.926513:0:15169:0:(genops.c:885:class_export_put()) final put ffff9a9f02c41800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1788530339.926540:0:15169:0:(tgt_mount.c:201:server_put_mount()) put mount ffff9a9f0aaed800 from MGS, refs=2 00000020:01000004:3.0:1788530339.926544:0:15169:0:(obd_mount.c:712:lustre_put_lsi()) put ffff9a9f0aaed800 2 00000020:01000004:3.0:1788530339.926546:0:15169:0:(tgt_mount.c:134:server_deregister_mount()) deregister mount ffff9a9f0aaed800 from MGS 00000020:00000080:3.0:1788530339.926592:0:15169:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788530339.926600:0:15169:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1788530339.926602:0:15169:0:(genops.c:885:class_export_put()) final put ffff9a9f02c28800/MGS 00000020:00000080:3.0:1788530339.926605:0:15169:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f02c28800/MGS for MGS 00000020:01000000:3.0:1788530339.926615:0:15169:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:00000080:0.0:1788530339.926948:0:476:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f02c41800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1788530339.927442:0:15169:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1788530339.927448:0:15169:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788530339.927456:0:15169:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788530339.927463:0:15169:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9a9f2b95d800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788530339.927470:0:15169:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff9a9f2c148000) has exports, disconnecting them 00000020:00080000:3.0:1788530339.927474:0:15169:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9a9f2b95d800), last request at 1788530026 00000020:00000080:3.0:1788530339.927479:0:15169:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e12575009e 00000020:00080000:3.0:1788530339.927494:0:15169:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a9f2b95d800): rc 0 00000020:00000080:3.0:1788530339.927498:0:15169:0:(genops.c:885:class_export_put()) final put ffff9a9f2b95d800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788530339.931787:0:476:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f2b95d800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1788530339.943402:0:15169:0:(obd_class.h:688:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1788530339.943412:0:15169:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788530339.943416:0:15169:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788530339.943423:0:15169:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788530339.943454:0:476:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a9f32879800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788530339.943652:0:15169:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788530339.943661:0:15169:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1788530339.943667:0:15169:0:(genops.c:885:class_export_put()) final put ffff9a9f2b95c800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1788530339.943671:0:15169:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f2b95c800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1788530339.943677:0:15169:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1788530339.943751:0:15169:0:(obd_mount.c:712:lustre_put_lsi()) put ffff9a9f0aaed800 1 00000020:00000080:0.0:1788530339.943757:0:15169:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e12574ffc5 00000020:00000080:0.0:1788530339.943764:0:15169:0:(genops.c:885:class_export_put()) final put ffff9a9f0aa1f000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1788530339.943771:0:15169:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1788530339.943780:0:476:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f0aa1f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788530339.943858:0:15169:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788530339.943873:0:15169:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788530339.943877:0:15169:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9a9f39656620) has no exports 00010000:00010000:0.0:1788530340.035886:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788530340.224812:0:15169:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788530340.224827:0:15169:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1788530340.224832:0:15169:0:(genops.c:885:class_export_put()) final put ffff9a9f0aa18800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788530340.224837:0:15169:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f0aa18800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1788530340.224845:0:15169:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1788530340.225941:0:15169:0:(obd_mount.c:670:lustre_free_lsi()) Freeing lsi ffff9a9f0aaec000 00000020:02000400:0.0:1788530340.226007:0:15169:0:(tgt_mount.c:2258:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1788530341.056754:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788530341.953033:0:476:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788530341.953042:0:476:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788530341.953046:0:476:0:(import.c:65:import_set_state_nolock()) ffff9a9f3bd66000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788530341.953057:0:476:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 544 00000100:00080000:2.0:1788530341.953092:0:476:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788530341.953102:0:476:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9a9f3bd66000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:2.0:1788530341.953138:0:476:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9e03691880 x1875409555871488/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788530341.953209:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03690a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3650:1875409555871360:0@lo:400:kworker.0 00000400:00000100:3.0:1788530341.953291:0:3650:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875409555871360 offset 0 length 224: 4 00000100:00100000:1.0:1788530341.953725:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555871616:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788530341.953766:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530341.953803:0:9912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555871616 00000100:00100000:1.0:1788530341.953811:0:9912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555871616 00000100:00100000:1.0:1788530341.953872:0:9912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1788530341.953885:0:9912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555871616:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788530341.953931:0:9912:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788530341.953983:0:9912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555871616:12345-0@lo:13:osp-pre-0-1.0 Request processed in 102us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530341.953992:0:9912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00080000:1.0:1788530341.954015:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788530341.954056:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555871616:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788530341.954762:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555871744:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788530341.954805:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530341.954887:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555871744 00000100:00100000:3.0:1788530341.954894:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555871744 00000100:00100000:3.0:1788530341.954951:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1788530341.954959:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555871744:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788530341.954981:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788530341.955022:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555871744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 63us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530341.955028:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00080000:1.0:1788530341.955087:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788530341.955121:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555871744:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788530341.961208:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03691880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875409555871488:0@lo:38:kworker.0 00000100:00100000:0.0:1788530341.961303:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530341.961430:0:14186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555871488 00000100:00100000:1.0:1788530341.961440:0:14186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555871488 00000100:00100000:1.0:1788530341.961480:0:14186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1788530341.961488:0:14186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3646:x1875409555871488:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788530341.961510:0:14186:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788530341.961580:0:14186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3646:x1875409555871488:12345-0@lo:38:kworker.0 Request processed in 72us (258us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788530341.961588:0:14186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00080000:1.0:1788530341.961654:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9f3bd66000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788530341.961660:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788530341.961664:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03691880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875409555871488:0@lo:38:kworker.0 00000100:00080000:2.0:1788530341.962406:0:476:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788530341.962412:0:476:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788530341.962415:0:476:0:(import.c:65:import_set_state_nolock()) ffff9a9f33b6d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788530341.962420:0:476:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 544 00000100:00080000:2.0:1788530341.962425:0:476:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788530341.962430:0:476:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9a9f33b6d800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:2.0:1788530341.962463:0:476:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9e03691880 x1875409555871872/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788530341.962522:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03691880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875409555871872:0@lo:38:kworker.0 00000100:00100000:1.0:1788530341.962592:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788530341.964174:0:476:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788530341.964183:0:476:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788530341.964186:0:476:0:(import.c:65:import_set_state_nolock()) ffff9a9e02239000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788530341.964192:0:476:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 544 00000100:00080000:2.0:1788530341.964198:0:476:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788530341.964205:0:476:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9a9e02239000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:2.0:1788530341.964241:0:476:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9e03d3ed80 x1875409555872000/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788530341.968023:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1875409555872000:0@lo:38:kworker.0 00000100:00100000:1.0:1788530341.968130:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530341.968227:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555871872 00000100:00100000:1.0:1788530341.968237:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555871872 00000100:00100000:1.0:1788530341.968437:0:8678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555872000 00000100:00100000:1.0:1788530341.968441:0:8678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555872000 00000100:00080000:2.0:1788530341.968597:0:476:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788530341.968602:0:476:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788530341.968605:0:476:0:(import.c:65:import_set_state_nolock()) ffff9a9e0223a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788530341.968610:0:476:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 544 00000100:00080000:2.0:1788530341.968633:0:476:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788530341.968639:0:476:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9a9e0223a800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:2.0:1788530341.968665:0:476:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9e03d3ea00 x1875409555872256/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788530341.969119:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1788530341.969128:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1875409555871872:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788530341.969152:0:6525:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788530341.969229:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1875409555871872:12345-0@lo:38:kworker.0 Request processed in 99us (6634us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788530341.969237:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1788530341.969262:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1788530341.969280:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1875409555872000:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788530341.969290:0:6525:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788530341.969314:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1875409555872000:12345-0@lo:38:kworker.0 Request processed in 46us (1186us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788530341.969320:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1788530341.969343:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875409555872128:0@lo:400:kworker.0 00000100:00100000:3.0:1788530341.969386:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530341.969411:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788530341.969417:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875409555872384:0@lo:400:kworker.0 00000100:00100000:3.0:1788530341.969438:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530341.969481:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555872128 00000100:00100000:3.0:1788530341.969488:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555872128 00000100:00100000:3.0:1788530341.969550:0:10719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555872384 00000100:00100000:3.0:1788530341.969554:0:10719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555872384 00000100:00100000:3.0:1788530341.969592:0:10719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 449 00000100:00100000:3.0:1788530341.969599:0:10719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875409555872128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530341.969916:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 450 00000100:00100000:2.0:1788530341.969929:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875409555872384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530341.969975:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875409555872384:12345-0@lo:400:kworker.0 Request processed in 50us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530341.969981:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 450 00000100:00100000:3.0:1788530341.970060:0:10719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875409555872128:12345-0@lo:400:kworker.0 Request processed in 461us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530341.970067:0:10719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 449 00000100:00080000:3.0:1788530341.970086:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1788530341.970120:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9a9e03d3df80 x1875409555872384/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530341.970135:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875409555872384:0@lo:400:kworker.0 00010000:00080000:3.0:1788530341.970146:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9a9e03d3f480 x1875409555872128/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530341.970155:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875409555872128:0@lo:400:kworker.0 00000100:00100000:1.0:1788530341.970748:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1875409555872256:0@lo:38:kworker.0 00000100:00100000:1.0:1788530341.970786:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788530341.970821:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9e02239000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788530341.970827:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788530341.970831:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1875409555872000:0@lo:38:kworker.0 00000100:00080000:1.0:1788530341.970842:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9f33b6d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788530341.970857:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788530341.970860:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03691880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875409555871872:0@lo:38:kworker.0 00000100:00100000:2.0:1788530341.970968:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555872256 00000100:00100000:2.0:1788530341.970977:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555872256 00000100:00100000:2.0:1788530341.971016:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1788530341.971022:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1875409555872256:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788530341.971039:0:6523:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788530341.971075:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1875409555872256:12345-0@lo:38:kworker.0 Request processed in 52us (287us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788530341.971082:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00080000:1.0:1788530341.971143:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9e0223a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788530341.971147:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788530341.971150:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1875409555872256:0@lo:38:kworker.0 00010000:00010000:0.0:1788530342.086540:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530343.107701:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530344.128872:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788530344.871387:0:15370:0:(tgt_mount.c:2269:server_umount_begin()) umount -f 00000020:01000004:2.0:1788530344.900636:0:15370:0:(tgt_mount.c:2125:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:2.0:1788530344.900707:0:15370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91cc00/0xb28d70e1257505bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257505c2 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530344.900724:0:15370:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91cc00/0xb28d70e1257505bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e1257505c2 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530344.900731:0:15370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91cc00/0xb28d70e1257505bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xb28d70e1257505c2 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530344.900758:0:15370:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91cc00/0xb28d70e1257505bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xb28d70e1257505c2 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530344.900783:0:15370:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788530344.900812:0:15370:0:(mgc_request_server.c:165:mgc_fs_clear()) MGC192.168.202.141@tcp: clear lustre-client 10000000:01000000:2.0:1788530344.900818:0:15370:0:(mgc_request.c:651:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788530344.900855:0:15370:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788530344.900860:0:15370:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788530344.900867:0:15370:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788530344.900873:0:15370:0:(import.c:65:import_set_state_nolock()) ffff9a9f33b6d800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1788530344.900880:0:15370:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788530344.900882:0:15370:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788530344.900886:0:15370:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788530344.901375:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788530344.901384:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91cc00/0xb28d70e1257505bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xb28d70e1257505c2 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530344.901394:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f0c91cc00 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:1.0:1788530344.901399:0:6511:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91cc00/0xb28d70e1257505bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xb28d70e1257505c2 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530344.901410:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91cc00/0xb28d70e1257505bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xb28d70e1257505c2 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788530344.901418:0:6511:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91cc00/0xb28d70e1257505bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xb28d70e1257505c2 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788530344.901424:0:6511:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788530344.901427:0:6511:0:(mgc_request.c:1235:mgc_blocking_ast()) log lustre-client: stale lock, won't requeue 10000000:01000000:1.0:1788530344.901430:0:6511:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788530344.901504:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91cc00/0xb28d70e1257505bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xb28d70e1257505c2 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530344.901512:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788530344.901543:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91cc00/0xb28d70e1257505bb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xb28d70e1257505c2 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530344.901583:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91cc00/0xb28d70e1257505bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xb28d70e1257505c2 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530344.901596:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530344.901598:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530344.901600:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788530344.901655:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3647:1875409555872512:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788530344.901738:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530344.902201:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555872512 00000100:00100000:1.0:1788530344.902209:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555872512 00000100:00100000:1.0:1788530344.902365:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788530344.902373:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2a1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3647:x1875409555872512:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788530344.902380:0:6510:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788530344 with bad export cookie 12866063822765752303 00010000:00010000:2.0:1788530344.906468:0:15370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9e025dc400/0xb28d70e1257505c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257505d0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530344.906488:0:15370:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9e025dc400/0xb28d70e1257505c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e1257505d0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530344.906496:0:15370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9e025dc400/0xb28d70e1257505c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xb28d70e1257505d0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530344.906504:0:15370:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.141@tcp lock: ffff9a9e025dc400/0xb28d70e1257505c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xb28d70e1257505d0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530344.906530:0:15370:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788530344.906557:0:15370:0:(mgc_request_server.c:165:mgc_fs_clear()) MGC192.168.202.141@tcp: clear lustre-MDT0001 00010000:00010000:2.0:1788530344.909366:0:15370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91ca00/0xb28d70e12575046b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125750472 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530344.909440:0:15370:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91ca00/0xb28d70e12575046b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e125750472 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530344.909449:0:15370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91ca00/0xb28d70e12575046b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xb28d70e125750472 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530344.909456:0:15370:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91ca00/0xb28d70e12575046b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xb28d70e125750472 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530344.909489:0:15370:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788530344.909501:0:15370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d100200/0xb28d70e125750846 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575084d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530344.909508:0:15370:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d100200/0xb28d70e125750846 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e12575084d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530344.909514:0:15370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d100200/0xb28d70e125750846 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xb28d70e12575084d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530344.909521:0:15370:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.141@tcp lock: ffff9a9f3d100200/0xb28d70e125750846 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xb28d70e12575084d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530344.909574:0:15370:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:2.0:1788530344.911489:0:15370:0:(mgc_request_server.c:165:mgc_fs_clear()) MGC192.168.202.141@tcp: clear params 00010000:00010000:2.0:1788530344.911516:0:15370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d800/0xb28d70e1257500f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257500f9 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530344.911532:0:15370:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d800/0xb28d70e1257500f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e1257500f9 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530344.911952:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788530344.911966:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9e025dc400/0xb28d70e1257505c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xb28d70e1257505d0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530344.911978:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9e025dc400 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:0.0:1788530344.911982:0:6512:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9e025dc400/0xb28d70e1257505c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xb28d70e1257505d0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530344.911994:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9e025dc400/0xb28d70e1257505c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xb28d70e1257505d0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788530344.912002:0:6512:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9e025dc400/0xb28d70e1257505c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xb28d70e1257505d0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788530344.912017:0:6512:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788530344.912021:0:6512:0:(mgc_request.c:1235:mgc_blocking_ast()) log lustre-MDT0001: stale lock, won't requeue 00010000:00010000:0.0:1788530344.912088:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9e025dc400/0xb28d70e1257505c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xb28d70e1257505d0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530344.912097:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788530344.912142:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9e025dc400/0xb28d70e1257505c9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xb28d70e1257505d0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530344.912151:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9e025dc400/0xb28d70e1257505c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xb28d70e1257505d0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530344.912171:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788530344.912175:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91ca00/0xb28d70e12575046b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xb28d70e125750472 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530344.912181:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f0c91ca00 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:0.0:1788530344.912184:0:6512:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91ca00/0xb28d70e12575046b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xb28d70e125750472 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530344.912192:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91ca00/0xb28d70e12575046b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xb28d70e125750472 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788530344.912199:0:6512:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91ca00/0xb28d70e12575046b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xb28d70e125750472 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788530344.912205:0:6512:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1788530344.912208:0:6512:0:(mgc_request.c:1235:mgc_blocking_ast()) log lustre-mdtir: stale lock, won't requeue 10000000:01000000:0.0:1788530344.912212:0:6512:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1788530344.912281:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91ca00/0xb28d70e12575046b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xb28d70e125750472 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530344.912288:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788530344.912308:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91ca00/0xb28d70e12575046b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xb28d70e125750472 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530344.912315:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91ca00/0xb28d70e12575046b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xb28d70e125750472 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530344.912336:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788530344.912340:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f3d100200/0xb28d70e125750846 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xb28d70e12575084d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530344.912347:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d100200 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:0.0:1788530344.912350:0:6512:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f3d100200/0xb28d70e125750846 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xb28d70e12575084d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530344.912359:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f3d100200/0xb28d70e125750846 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xb28d70e12575084d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788530344.912366:0:6512:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f3d100200/0xb28d70e125750846 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xb28d70e12575084d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788530344.912372:0:6512:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788530344.912374:0:6512:0:(mgc_request.c:1235:mgc_blocking_ast()) log params: stale lock, won't requeue 10000000:01000000:0.0:1788530344.912377:0:6512:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788530344.912433:0:6512:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9f3d100200/0xb28d70e125750846 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xb28d70e12575084d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530344.912440:0:6512:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788530344.912448:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f3d100200/0xb28d70e125750846 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xb28d70e12575084d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530344.912460:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f3d100200/0xb28d70e125750846 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xb28d70e12575084d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530344.912471:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530344.912473:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530344.912475:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530344.912484:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788530344.912504:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788530344.912528:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3647:1875409555872640:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788530344.912663:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788530344.913151:0:15370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d800/0xb28d70e1257500f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xb28d70e1257500f9 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530344.913160:0:15370:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d800/0xb28d70e1257500f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xb28d70e1257500f9 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530344.913186:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3650:1875409555872896:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788530344.913237:0:15370:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788530344.917718:0:15370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9e025dc000/0xb28d70e1257505d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257505de expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530344.917733:0:15370:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9e025dc000/0xb28d70e1257505d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e1257505de expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530344.917741:0:15370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9e025dc000/0xb28d70e1257505d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xb28d70e1257505de expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530344.917748:0:15370:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.141@tcp lock: ffff9a9e025dc000/0xb28d70e1257505d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xb28d70e1257505de expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530344.917799:0:15370:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1788530344.917878:0:15370:0:(mgc_request_server.c:165:mgc_fs_clear()) MGC192.168.202.141@tcp: clear lustre-sptlrpc 10000000:01000000:2.0:1788530344.917883:0:15370:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:2.0:1788530344.917933:0:15370:0:(mgc_request.c:651:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:2.0:1788530344.917989:0:15370:0:(tgt_mount.c:2175:server_put_super()) stopping lustre-MDT0001 00000020:01000000:2.0:1788530344.917995:0:15370:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:2.0:1788530344.918001:0:15370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788530344.918008:0:15370:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1788530344.918036:0:15370:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9a9f3d650800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788530344.918054:0:15370:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9a9f3d27c800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788530344.918060:0:15370:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff9a9f32884c98) has exports, disconnecting them 00000020:00080000:2.0:1788530344.918065:0:15370:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9a9f3d650800), last request at 1788530341 00000020:00000080:2.0:1788530344.918073:0:15370:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e125750409 00000100:00080000:2.0:1788530344.918093:0:15370:0:(import.c:65:import_set_state_nolock()) ffff9a9f3d655000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788530344.918163:0:15370:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a9f3d650800): rc 0 00000020:00000080:2.0:1788530344.918166:0:15370:0:(genops.c:885:class_export_put()) final put ffff9a9f3d650800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:2.0:1788530344.918182:0:15370:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9a9f3d27c800), last request at 1788530341 00000020:00000080:2.0:1788530344.918185:0:15370:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e1257502b9 00000100:00080000:2.0:1788530344.918191:0:15370:0:(import.c:65:import_set_state_nolock()) ffff9a9f3d27e000 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1788530344.918202:0:476:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f3d650800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:2.0:1788530344.919304:0:476:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a9f3d655000 for lustre-MDT0001 00000020:00080000:2.0:1788530344.919351:0:15370:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a9f3d27c800): rc 0 00000020:00000080:2.0:1788530344.919355:0:15370:0:(genops.c:885:class_export_put()) final put ffff9a9f3d27c800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:2.0:1788530344.919378:0:15370:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffb37801be7ae0 00000020:00000080:2.0:1788530344.919393:0:476:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f3d27c800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:2.0:1788530344.919428:0:476:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a9f3d27e000 for lustre-MDT0001 00000100:00080000:2.0:1788530344.919457:0:15370:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788530344.919474:0:15370:0:(client.c:3603:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff9a9e03d83b80 x1875409555869696/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788530352 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530344.919494:0:15370:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00000100:00080000:2.0:1788530344.920585:0:15370:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788530344.920598:0:15370:0:(import.c:65:import_set_state_nolock()) ffff9a9f3bd66000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00010000:00010000:0.0:1788530344.921311:0:10348:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788530344.921334:0:10348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d800/0xb28d70e1257500f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xb28d70e1257500f9 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530344.921348:0:10348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f0c91d800 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:0.0:1788530344.921353:0:10348:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d800/0xb28d70e1257500f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xb28d70e1257500f9 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530344.921368:0:10348:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d800/0xb28d70e1257500f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xb28d70e1257500f9 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788530344.921377:0:10348:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d800/0xb28d70e1257500f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xb28d70e1257500f9 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788530344.921383:0:10348:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1788530344.921387:0:10348:0:(mgc_request.c:1235:mgc_blocking_ast()) log lustre-barrier: stale lock, won't requeue 10000000:01000000:0.0:1788530344.921393:0:10348:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1788530344.921516:0:10348:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d800/0xb28d70e1257500f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xb28d70e1257500f9 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530344.921552:0:10348:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788530344.921595:0:10348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d800/0xb28d70e1257500f2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xb28d70e1257500f9 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530344.921604:0:10348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d800/0xb28d70e1257500f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xb28d70e1257500f9 expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530344.921629:0:10348:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788530344.921633:0:10348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9e025dc000/0xb28d70e1257505d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xb28d70e1257505de expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530344.921638:0:10348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9e025dc000 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:0.0:1788530344.921641:0:10348:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9e025dc000/0xb28d70e1257505d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xb28d70e1257505de expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530344.921648:0:10348:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9e025dc000/0xb28d70e1257505d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xb28d70e1257505de expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788530344.921654:0:10348:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9e025dc000/0xb28d70e1257505d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xb28d70e1257505de expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788530344.921659:0:10348:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788530344.921662:0:10348:0:(mgc_request.c:1235:mgc_blocking_ast()) log lustre-sptlrpc: stale lock, won't requeue 10000000:01000000:0.0:1788530344.921664:0:10348:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1788530344.921704:0:10348:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9e025dc000/0xb28d70e1257505d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xb28d70e1257505de expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530344.921711:0:10348:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788530344.921717:0:10348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9e025dc000/0xb28d70e1257505d7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xb28d70e1257505de expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530344.921735:0:10348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9e025dc000/0xb28d70e1257505d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xb28d70e1257505de expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530344.921745:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530344.921747:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530344.921749:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530344.921869:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788530344.921928:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03735c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3647:1875409555873024:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788530344.922026:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788530344.925913:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788530344.926094:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2a1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3647:x1875409555872512:12345-0@lo:103:ldlm_bl.0 Request processed in 23712us (24348us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788530344.926114:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788530344.926557:0:10347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555872640 00000100:00100000:3.0:1788530344.926605:0:10347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555872640 00000100:00100000:3.0:1788530344.926634:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03736a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3648:1875409555873152:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788530344.926692:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3649:1875409555872768:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788530344.930909:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788530344.930927:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d25ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3647:x1875409555872640:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788530344.930938:0:6508:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788530344 with bad export cookie 12866063822765752303 00000100:00100000:3.0:1788530344.931221:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d25ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3647:x1875409555872640:12345-0@lo:103:ldlm_bl.0 Request processed in 296us (18557us total) trans 0 rc -107/-107 00000100:00080000:0.0:1788530344.931479:0:3647:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.141@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788530344.931487:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9a9f1768a800 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1788530344.931491:0:3647:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.141@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00100000:3.0:1788530344.933192:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788530344.933228:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555873024 00000100:00100000:3.0:1788530344.933237:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555873024 00000100:00100000:3.0:1788530344.933277:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788530344.933284:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03735500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3647:x1875409555873024:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788530344.933290:0:6508:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788530344 with bad export cookie 12866063822765752303 00000100:00100000:3.0:1788530344.933374:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03735500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3647:x1875409555873024:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (11348us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788530344.933380:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788530344.933410:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530344.933462:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530344.933482:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555872768 00000100:00100000:3.0:1788530344.933485:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555872768 00000100:00100000:3.0:1788530344.933496:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555873152 00000100:00100000:3.0:1788530344.933498:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555873152 00000100:00100000:3.0:1788530344.933507:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788530344.933511:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3649:x1875409555872768:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788530344.933516:0:6508:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788530344 with bad export cookie 12866063822765752303 00000100:00100000:3.0:1788530344.933547:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3649:x1875409555872768:12345-0@lo:103:ldlm_bl.0 Request processed in 34us (136us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788530344.933553:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788530344.933581:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788530344.933861:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f328e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3648:x1875409555873152:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788530344.933868:0:6508:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788530344 with bad export cookie 12866063822765752303 00000100:00100000:3.0:1788530344.933902:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f328e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3648:x1875409555873152:12345-0@lo:103:ldlm_bl.0 Request processed in 315us (439us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788530344.933910:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:3.0:1788530344.933965:0:3649:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.141@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00100000:2.0:1788530344.938879:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530344.938950:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555869696:0@lo:41:osp-pre-0-1.0 00000100:00080000:2.0:1788530344.939081:0:15370:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788530344.939098:0:15370:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 3 00000004:00080000:2.0:1788530344.939113:0:15370:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788530344.939182:0:15370:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1788530344.939204:0:15370:0:(import.c:65:import_set_state_nolock()) ffff9a9e0242c000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1788530344.939220:0:15370:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788530344.939222:0:15370:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967299 gen 3 00000004:00080000:2.0:1788530344.939231:0:15370:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788530344.940198:0:15370:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1788530344.940222:0:15370:0:(import.c:65:import_set_state_nolock()) ffff9a9f373f5000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1788530344.940341:0:15370:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9a9f32884c98) has no exports 00000100:00100000:1.0:1788530344.940801:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875409555873280:0@lo:9:umount.0 00000100:00100000:1.0:1788530344.940910:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530344.940969:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875409555873408:0@lo:9:umount.0 00000100:00100000:1.0:1788530344.940995:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530344.941042:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555873280 00000100:00100000:1.0:1788530344.941053:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555873280 00000100:00100000:1.0:1788530344.941127:0:8752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555873408 00000100:00100000:1.0:1788530344.941130:0:8752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555873408 00000100:00100000:1.0:1788530344.941154:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788530344.941166:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03691880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875409555873280:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788530344.941195:0:8752:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e125750314 00000100:00080000:1.0:1788530344.941219:0:8752:0:(import.c:65:import_set_state_nolock()) ffff9a9e02429800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788530344.943915:0:8752:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:1.0:1788530344.944138:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03691880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3646:x1875409555873280:12345-0@lo:9:umount.0 Request processed in 2970us (3224us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530344.944150:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788530344.944176:0:8752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788530344.944188:0:8752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37375500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875409555873408:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788530344.944210:0:8752:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e12575049c 00000100:00080000:1.0:1788530344.944220:0:8752:0:(import.c:65:import_set_state_nolock()) ffff9a9e027af800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788530344.944423:0:8752:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967326 00000100:00100000:1.0:1788530344.944502:0:8752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37375500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3646:x1875409555873408:12345-0@lo:9:umount.0 Request processed in 317us (3504us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530344.944508:0:8752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788530344.944647:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555872896 00000100:00100000:2.0:1788530344.944655:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555872896 00000100:00100000:2.0:1788530344.944696:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788530344.944704:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d3e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3650:x1875409555872896:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788530344.944711:0:6508:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788530344 with bad export cookie 12866063822765752303 00000100:00100000:2.0:1788530344.944762:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d3e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3650:x1875409555872896:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (5893us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788530344.944769:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:2.0:1788530344.944805:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.141@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788530344.945003:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9e0242c000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788530344.945020:0:3646:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788530344.945023:0:3646:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788530344.945029:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875409555873280:0@lo:9:umount.0 00000100:00080000:1.0:1788530344.945051:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9f373f5000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788530344.945063:0:3646:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788530344.945064:0:3646:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788530344.945079:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875409555873408:0@lo:9:umount.0 00010000:00010000:1.0:1788530344.945131:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530344.945154:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788530344.949182:0:3647:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.141@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1788530344.949189:0:3647:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1788530344.949199:0:3647:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a9e03690a80 x1875409555871360/t0(0) o400->MGC192.168.202.141@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788530357 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530344.949215:0:3647:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a9e037e6a00 x1875409555872512/t0(0) o103->MGC192.168.202.141@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788530360 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530344.949224:0:3647:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a9f3d2a2680 x1875409555872640/t0(0) o103->MGC192.168.202.141@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788530360 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530344.949231:0:3647:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a9f3d2a0a80 x1875409555872896/t0(0) o103->MGC192.168.202.141@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788530360 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530344.949240:0:3647:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a9e03735c00 x1875409555873024/t0(0) o103->MGC192.168.202.141@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788530360 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530344.951455:0:3647:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a9e03736a00 x1875409555873152/t0(0) o103->MGC192.168.202.141@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788530360 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530344.951499:0:3647:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a9f3d2a0000 x1875409555872768/t0(0) o103->MGC192.168.202.141@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788530360 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1788530344.951512:0:3647:0:(mgc_request.c:1469:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1788530344.951514:0:3647:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788530344.951516:0:3647:0:(mgc_request.c:1469:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788530344.952178:0:3649:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9a9f1768a800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:3.0:1788530344.952214:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3649:1875409555872768:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1788530344.952543:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788530344.952548:0:6519:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788530344.956947:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3650:1875409555872896:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788530344.956974:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03690a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3650:1875409555871360:0@lo:400:kworker.0 00000100:00080000:2.0:1788530344.957116:0:3648:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9a9f1768a800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:2.0:1788530344.957133:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03736a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3648:1875409555873152:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1788530344.957620:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9a9f1768a800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788530344.957628:0:3647:0:(import.c:545:import_select_connection()) MGC192.168.202.141@tcp: connect to NID 0@lo last attempt 233 00000100:00080000:0.0:1788530344.957637:0:3647:0:(import.c:665:import_select_connection()) MGC192.168.202.141@tcp: import ffff9a9f1768a800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:3.0:1788530344.958065:0:3647:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9f328e4380 x1875409555873536/t0(0) o250->MGC192.168.202.141@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788530344.958128:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3647:1875409555872512:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788530344.958151:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03735c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3647:1875409555873024:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788530344.958157:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3647:1875409555872640:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788530344.958977:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3646:1875409555873536:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:0.0:1788530344.959061:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875409555873536 offset 0 length 520: 4 00000020:00080000:0.0:1788530344.989203:0:15370:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9a9f32884c98) has no exports 00000020:01000000:2.0:1788530345.083750:0:15370:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a9e034ddf60 - data ffff9a9e01c26798/ffff9a9f33d7d000 00000020:01000000:2.0:1788530345.084002:0:15370:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a9f3d1cccc0 - data ffff9a9f2bda5af8/ffff9a9f33b44c00 00000001:00000004:2.0:1788530345.104825:0:15370:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00010000:00010000:1.0:1788530345.156728:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788530345.185336:0:15370:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788530345.185347:0:15370:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:1.0:1788530345.185357:0:15370:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1788530345.189389:0:15370:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788530345.189409:0:15370:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 4 00000004:00080000:1.0:1788530345.189434:0:15370:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788530345.189437:0:15370:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788530345.190006:0:8746:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788530345.190147:0:8746:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:0.0:1788530345.190159:0:8746:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1788530345.193081:0:15370:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788530345.193090:0:15370:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967299 gen 4 00000004:00080000:3.0:1788530345.193110:0:15370:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788530345.193112:0:15370:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788530345.193481:0:9896:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788530345.193496:0:9896:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:1.0:1788530345.193511:0:9896:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1788530345.196291:0:15370:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e125750115 00000020:00000080:2.0:1788530345.196309:0:15370:0:(genops.c:885:class_export_put()) final put ffff9a9f3bd65800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788530345.197377:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f3bd65800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1788530345.202420:0:15370:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e12575012a 00000020:00000080:2.0:1788530345.202452:0:15370:0:(genops.c:885:class_export_put()) final put ffff9a9f3bd63000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1788530345.202473:0:15370:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:2.0:1788530345.202479:0:15370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788530345.202488:0:15370:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788530345.202492:0:15370:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9a9f32883310) has no exports 00000020:00000080:1.0:1788530345.204659:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f3bd63000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000004:01000000:2.0:1788530345.207214:0:15370:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1788530345.207239:0:15370:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e125750495 00000020:00000080:2.0:1788530345.207255:0:15370:0:(genops.c:885:class_export_put()) final put ffff9a9f373f6800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1788530345.207286:0:15370:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:2.0:1788530345.207296:0:15370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788530345.207315:0:15370:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788530345.207330:0:15370:0:(genops.c:1558:class_disconnect_exports()) OBD device 27 (ffff9a9f33d90000) has no exports 00000020:00000080:2.0:1788530345.207345:0:15370:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e12575048e 00000020:00000080:2.0:1788530345.207351:0:15370:0:(genops.c:885:class_export_put()) final put ffff9a9f373f0800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788530345.209656:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f373f6800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1788530345.209681:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f373f0800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1788530345.212824:0:15370:0:(obd_class.h:688:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:2.0:1788530345.212835:0:15370:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788530345.212840:0:15370:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967299 gen 5 00000004:00080000:2.0:1788530345.212848:0:15370:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788530345.212850:0:15370:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788530345.212914:0:15370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788530345.212929:0:15370:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788530345.212939:0:15370:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e12575030d 00000020:00000080:2.0:1788530345.212951:0:15370:0:(genops.c:885:class_export_put()) final put ffff9a9e0242f800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1788530345.212958:0:15370:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:2.0:1788530345.212968:0:15370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788530345.212973:0:15370:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788530345.212977:0:15370:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff9a9f33d96620) has no exports 00000020:00000080:2.0:1788530345.212988:0:15370:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e125750306 00000020:00000080:2.0:1788530345.212992:0:15370:0:(genops.c:885:class_export_put()) final put ffff9a9e0242a000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788530345.214857:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a9f373f5000 for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1788530345.214871:0:36:0:(genops.c:885:class_export_put()) final put ffff9a9e0242e000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788530345.214875:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9e0242e000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:1.0:1788530345.214882:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788530345.214963:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9e0242f800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1788530345.214969:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9e0242a000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1788530345.216161:0:15370:0:(obd_class.h:688:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:2.0:1788530345.216170:0:15370:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788530345.216174:0:15370:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 5 00000004:00080000:2.0:1788530345.216196:0:15370:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788530345.216199:0:15370:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788530345.216253:0:15370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788530345.216268:0:15370:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:2.0:1788530345.216286:0:15370:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1788530345.216293:0:15370:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e12575014d 00000020:00000080:2.0:1788530345.216303:0:15370:0:(genops.c:885:class_export_put()) final put ffff9a9f339e9000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1788530345.216310:0:15370:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:2.0:1788530345.216315:0:15370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788530345.216329:0:15370:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788530345.216333:0:15370:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9a9f32880000) has no exports 00000020:00000080:1.0:1788530345.216338:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a9e0242c000 for lustre-OST0000-osc-MDT0001 00000020:00000080:2.0:1788530345.216341:0:15370:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e125750146 00000020:00000080:2.0:1788530345.216345:0:15370:0:(genops.c:885:class_export_put()) final put ffff9a9f339eb800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788530345.216347:0:36:0:(genops.c:885:class_export_put()) final put ffff9a9e010c7800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788530345.216349:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9e010c7800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:1.0:1788530345.216356:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788530345.216424:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f339e9000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1788530345.216429:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f339eb800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1788530345.221614:0:15370:0:(obd_class.h:688:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:3.0:1788530345.221623:0:15370:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788530345.221627:0:15370:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:3.0:1788530345.221637:0:15370:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788530345.221689:0:15370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788530345.221701:0:15370:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788530345.221736:0:15370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788530345.221739:0:15370:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788530345.221746:0:15370:0:(genops.c:885:class_export_put()) final put ffff9a9f32889800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788530345.221761:0:15370:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f32889800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:3.0:1788530345.221774:0:15370:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788530345.221995:0:15370:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e125750131 00000020:00000080:3.0:1788530345.222003:0:15370:0:(genops.c:885:class_export_put()) final put ffff9a9f3bd60000/lustre-MDD0001_UUID 00000020:01000000:3.0:1788530345.222009:0:15370:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:3.0:1788530345.222073:0:15370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788530345.222079:0:15370:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788530345.222083:0:15370:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff9a9f32886620) has no exports 00000020:00000080:3.0:1788530345.222101:0:15370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788530345.222104:0:15370:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:3.0:1788530345.222108:0:15370:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e125750138 00000020:00000080:3.0:1788530345.222112:0:15370:0:(genops.c:885:class_export_put()) final put ffff9a9f3bd66800/lustre-MDT0001-osd_UUID 00000020:01000004:3.0:1788530345.222121:0:15370:0:(tgt_mount.c:201:server_put_mount()) put mount ffff9a9f32bea000 from lustre-MDT0001, refs=2 00000020:01000004:3.0:1788530345.222124:0:15370:0:(obd_mount.c:712:lustre_put_lsi()) put ffff9a9f32bea000 2 00000020:01000004:3.0:1788530345.222127:0:15370:0:(tgt_mount.c:134:server_deregister_mount()) deregister mount ffff9a9f32bea000 from lustre-MDT0001 00000020:00000080:3.0:1788530345.222152:0:15370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788530345.222155:0:15370:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:3.0:1788530345.222158:0:15370:0:(genops.c:885:class_export_put()) final put ffff9a9f3bd67800/lustre-MDT0001_UUID 00000020:00000080:3.0:1788530345.222161:0:15370:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f3bd67800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:3.0:1788530345.222168:0:15370:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:3.0:1788530345.222201:0:15370:0:(obd_mount.c:580:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:3.0:1788530345.222205:0:15370:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:3.0:1788530345.222208:0:15370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788530345.222211:0:15370:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788530345.222217:0:15370:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff9a9f33b68800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788530345.222222:0:15370:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff9a9f2c100000) has exports, disconnecting them 00000020:00080000:3.0:1788530345.222226:0:15370:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff9a9f33b68800), last request at 1788530049 00000020:00000080:3.0:1788530345.222230:0:15370:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e12575018c 00000020:00080000:3.0:1788530345.222304:0:15370:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a9f33b68800): rc 0 00000020:00000080:3.0:1788530345.222309:0:15370:0:(genops.c:885:class_export_put()) final put ffff9a9f33b68800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1788530345.222915:0:476:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a9f3bd66000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1788530345.222928:0:476:0:(genops.c:885:class_export_put()) final put ffff9a9f339ec800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788530345.222931:0:476:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f339ec800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:1.0:1788530345.222937:0:476:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788530345.223064:0:476:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f3bd60000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:1.0:1788530345.223075:0:476:0:(genops.c:885:class_export_put()) final put ffff9a9f3bd63800/lustre-MDD0001_UUID 00000020:00000080:1.0:1788530345.223077:0:476:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f3bd63800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:1.0:1788530345.223081:0:476:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:1.0:1788530345.223237:0:476:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f3bd66800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788530345.223251:0:476:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f33b68800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:1.0:1788530345.258629:0:15370:0:(obd_class.h:688:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:1.0:1788530345.258638:0:15370:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788530345.258642:0:15370:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788530345.258649:0:15370:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788530345.258680:0:476:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a9f33b6d800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1788530345.258928:0:15370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788530345.258937:0:15370:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:1.0:1788530345.258943:0:15370:0:(genops.c:885:class_export_put()) final put ffff9a9f33b6b000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:1.0:1788530345.258947:0:15370:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f33b6b000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:1.0:1788530345.258963:0:15370:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:1.0:1788530345.259063:0:15370:0:(obd_mount.c:712:lustre_put_lsi()) put ffff9a9f32bea000 1 00000020:00000080:1.0:1788530345.259071:0:15370:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e1257500c8 00000020:00000080:1.0:1788530345.259080:0:15370:0:(genops.c:885:class_export_put()) final put ffff9a9f32888000/lustre-MDT0001-osd_UUID 00000020:01000000:1.0:1788530345.259089:0:15370:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:1.0:1788530345.259098:0:476:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f32888000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788530345.259108:0:15370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788530345.259113:0:15370:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788530345.259118:0:15370:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9a9f2c106620) has no exports 00000020:00000080:1.0:1788530345.511093:0:15370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788530345.511113:0:15370:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:1.0:1788530345.511121:0:15370:0:(genops.c:885:class_export_put()) final put ffff9a9f32bef800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788530345.511126:0:15370:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f32bef800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:1.0:1788530345.511147:0:15370:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:1.0:1788530345.511291:0:15370:0:(obd_mount.c:670:lustre_free_lsi()) Freeing lsi ffff9a9f32be9000 00000020:01000000:1.0:1788530345.511340:0:15370:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1788530345.511346:0:15370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788530345.511351:0:15370:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788530345.511356:0:15370:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9a9f2c14e620) has no exports 00000100:00100000:2.0:1788530345.512761:0:6524:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9a9f08c87600:6524] 1 exiting: rc = 0 00000100:00100000:2.0:1788530345.512889:0:6523:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9a9f08c87800:6523] 0 exiting: rc = 1 00000100:00100000:3.0:1788530345.513226:0:10719:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff9a9e02744000:10719] 4 exiting: rc = 0 00000100:00100000:0.0:1788530345.513447:0:8678:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9a9e02241200:8678] 3 exiting: rc = 0 00000100:00100000:0.0:1788530345.513604:0:6525:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9a9f08cc9400:6525] 2 exiting: rc = 0 00000100:00100000:1.0:1788530345.513965:0:10720:0:(service.c:3183:ptlrpc_main()) mdt00_005: service thread [ffff9a9e023c5600:10720] 5 exiting: rc = 0 00000100:00100000:0.0:1788530345.514242:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788530345.514251:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788530345.514256:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788530345.514262:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788530345.514268:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788530345.514273:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788530345.514279:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788530345.514285:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788530345.514291:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788530345.514296:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788530345.514301:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788530345.514306:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788530345.514311:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788530345.516865:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788530345.516907:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788530345.516913:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788530345.516919:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788530345.516926:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788530345.516931:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788530345.516937:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788530345.516943:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788530345.516949:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788530345.516955:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788530345.516960:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788530345.516966:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788530345.516972:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788530345.516978:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788530345.516984:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788530345.516989:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788530345.516995:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788530345.517001:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788530345.517006:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788530345.517024:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788530345.517031:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788530345.517036:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788530345.517041:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788530345.517046:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788530345.517189:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788530345.517195:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788530345.517201:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788530345.517207:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788530345.517215:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788530345.517221:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788530345.517227:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788530345.517233:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788530345.517239:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788530345.517245:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788530345.517253:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788530345.517259:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788530345.517277:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788530345.517286:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788530345.517293:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788530345.517299:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788530345.517305:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788530345.517312:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788530345.517327:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788530345.517333:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788530345.517340:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788530345.517345:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788530345.517351:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788530345.517358:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788530345.517363:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788530345.517370:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788530345.517392:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.529071:0:6526:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9a9f08cc9000:6526] 0 exiting: rc = 1 00000100:00100000:2.0:1788530345.529358:0:6527:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9a9f08cc9800:6527] 1 exiting: rc = 0 00000100:00100000:3.0:1788530345.531283:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.531294:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.531299:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.531305:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.531312:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.531330:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.531338:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.531344:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.531350:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.531359:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.531364:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.531372:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.531379:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.531384:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.531390:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.531395:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.531402:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.531407:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.531412:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.531417:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.531423:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.531428:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.531433:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.531438:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.531443:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.531448:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.531453:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.531458:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.531462:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.531468:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.531475:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.531480:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.531484:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.531490:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.531510:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.531516:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.531522:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.531528:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.531534:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.531540:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.531545:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.531550:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.531556:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.531854:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.531862:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.531868:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.531874:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.531880:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.531885:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.531891:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.531899:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.531905:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.531911:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.531918:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.531925:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.531930:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.531936:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.531942:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.531947:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.531953:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.531959:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.531964:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.531971:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.531977:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530345.535807:0:6529:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9a9f08e2f600:6529] 1 exiting: rc = 0 00000100:00100000:1.0:1788530345.535919:0:6528:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9a9f3958ae00:6528] 0 exiting: rc = 1 00000100:00100000:0.0:1788530345.536242:0:14186:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff9a9e02473000:14186] 2 exiting: rc = 0 00000100:00100000:1.0:1788530345.536391:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530345.536410:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530345.536418:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530345.536424:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530345.536440:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530345.536447:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530345.536452:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530345.536459:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530345.536465:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530345.536470:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530345.536476:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530345.536481:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530345.536490:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530345.536497:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530345.536503:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530345.536509:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530345.536527:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530345.536533:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530345.536539:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530345.536545:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530345.536551:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530345.536557:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530345.536799:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530345.536808:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530345.536815:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530345.536821:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530345.536826:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530345.536832:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530345.536866:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530345.536872:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530345.536877:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530345.536883:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530345.536889:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530345.536895:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530345.536900:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530345.536904:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530345.536910:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530345.536914:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530345.536920:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530345.536925:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530345.536946:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530345.536952:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530345.536957:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530345.536962:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530345.536968:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530345.536975:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530345.536980:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530345.536986:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530345.536993:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530345.536998:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530345.537003:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530345.537020:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530345.537040:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530345.537046:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530345.537052:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530345.537057:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530345.537065:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530345.537071:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530345.537077:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530345.537083:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530345.537089:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530345.537094:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530345.537100:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530345.537113:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788530345.557939:0:6531:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9a9f08e2f400:6531] 1 exiting: rc = 0 00000100:00100000:3.0:1788530345.558279:0:6530:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9a9f08e2f800:6530] 0 exiting: rc = 1 00000100:00100000:2.0:1788530345.558430:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.558438:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.558443:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.558448:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.558453:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.558459:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.558464:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.558469:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.558475:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.558480:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.558484:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.558489:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.558494:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.558499:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.558504:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.558509:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.558513:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.558519:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.558540:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.558545:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.558550:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.558555:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.558594:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.558600:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.558606:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.558611:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.558617:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.558623:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.558628:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.558633:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.558638:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.558643:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.558648:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.558653:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.558658:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.558664:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.558669:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.558673:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.558678:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.558683:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.558688:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.558693:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.558698:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.558702:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.558707:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.558712:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.558717:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.558722:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.558727:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.558732:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.558736:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.558741:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.558746:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.558757:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.558762:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.558767:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.558772:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.558777:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.558782:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.558787:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.558792:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.558796:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.558801:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.558807:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.563042:0:6532:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9a9f08d4ec00:6532] 0 exiting: rc = 1 00000100:00100000:0.0:1788530345.563272:0:6533:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9a9f08d4e000:6533] 1 exiting: rc = 0 00000100:00100000:2.0:1788530345.564481:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.564489:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.564495:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.564500:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.564505:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.564510:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.564515:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.564520:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.564525:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.564531:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.564536:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.564541:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.564545:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.564550:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.564555:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.564799:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.564806:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.564811:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.564816:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.564820:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.564825:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.564829:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.564834:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.564838:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.564854:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.564858:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.564863:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.564868:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.564873:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.564878:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.564884:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.564889:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.564894:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.564899:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.564904:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.564908:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.564913:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.564917:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.564922:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.564927:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.564931:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.564936:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.564941:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.565061:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.565068:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.565072:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.565077:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.565082:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.565087:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.565091:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.565095:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.565100:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.565104:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.565109:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.565114:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.565118:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.565122:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.565127:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.565190:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.565201:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.565206:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.565211:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.565216:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.565221:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.566821:0:6535:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9a9f08d4e400:6535] 1 exiting: rc = 0 00000100:00100000:2.0:1788530345.566963:0:6534:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9a9f08d4f600:6534] 0 exiting: rc = 1 00000100:00100000:3.0:1788530345.567152:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.567159:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.567172:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.567177:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.567183:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.567188:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.567193:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.567198:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.567203:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.567208:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.567212:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.567217:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.567223:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.567228:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.567233:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.567246:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.567251:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.567256:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.567261:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.567266:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.567271:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.567276:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.567281:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.567286:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.567291:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.567296:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.567301:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.567306:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.567311:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.567323:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.567330:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.567335:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.567339:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.567344:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.567349:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.567353:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.567358:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.567368:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.567374:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.567378:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.567384:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.567388:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.567394:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.567400:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.567405:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.567410:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.567416:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.567421:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.567426:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.567431:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.567435:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.567440:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.567445:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.567449:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.567455:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.567459:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.567464:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.567468:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.567473:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.567478:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.567483:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.567488:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.567493:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.567497:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530345.568552:0:6536:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9a9f1f4e4e00:6536] 0 exiting: rc = 1 00000100:00100000:0.0:1788530345.569118:0:6537:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9a9f1f4e5e00:6537] 1 exiting: rc = 0 00000100:00100000:0.0:1788530345.569515:0:6538:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9a9f1f4e5000:6538] 2 exiting: rc = 0 00000100:00100000:3.0:1788530345.570466:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.570478:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.570486:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.570492:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.570500:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.570506:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.570512:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.570517:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.570539:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.570545:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.570552:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.571454:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.571466:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.571472:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.571479:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.571485:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.571492:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.571498:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.571504:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.571512:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.571517:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.571523:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.571530:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.571537:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.571587:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.571595:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.571601:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.571607:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.571613:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.571619:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.571625:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.571631:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.571636:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.571642:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.571647:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.571653:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.571658:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.571663:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.571668:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.571673:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.571679:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.571685:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.571691:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.571706:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.571713:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.571720:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.571726:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.571732:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.571750:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.571757:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.571763:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.571769:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.571776:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.571782:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.571788:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.571794:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.571801:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.571809:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.571816:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.571823:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.571829:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.571837:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.571845:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788530345.571851:0:15370:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788530345.582427:0:15370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788530345.582442:0:15370:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1788530345.582449:0:15370:0:(genops.c:885:class_export_put()) final put ffff9a9f1768f000/MDS_uuid 00000020:00000080:2.0:1788530345.582455:0:15370:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f1768f000/MDS_uuid for MDS 00000020:01000000:2.0:1788530345.582460:0:15370:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1788530345.584803:0:15370:0:(tgt_mount.c:2258:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:2.0:1788530346.179619:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788530347.074240:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788530347.074252:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788530347.074256:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788530347.074260:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788530347.074264:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a9e02239000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788530347.074275:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 549 00000100:00080000:0.0:1788530347.074282:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788530347.074289:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9a9e02239000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:0.0:1788530347.074342:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9e03737800 x1875409555873664/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788530347.074437:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03737800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1875409555873664:0@lo:38:kworker.0 00000400:00000100:1.0:1788530347.074505:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875409555873664 offset 0 length 520: 4 00000100:00080000:0.0:1788530347.074671:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788530347.074675:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788530347.074677:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a9e0223a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788530347.074681:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 549 00000100:00080000:0.0:1788530347.074684:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788530347.074687:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9a9e0223a800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:0.0:1788530347.074698:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9e03734380 x1875409555873920/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788530347.074744:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788530347.074759:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03734a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875409555873792:0@lo:400:kworker.0 00000400:00000100:2.0:1788530347.074782:0:3650:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875409555873792 offset 0 length 224: 4 00000100:00100000:1.0:1788530347.074880:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03734380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1875409555873920:0@lo:38:kworker.0 00000400:00000100:1.0:1788530347.074900:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875409555873920 offset 0 length 520: 4 00000100:00100000:2.0:1788530347.075034:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03734e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875409555874048:0@lo:400:kworker.0 00000400:00000100:2.0:1788530347.075054:0:3650:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875409555874048 offset 0 length 224: 4 00010000:00010000:1.0:1788530347.207808:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530348.224951:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530349.249831:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788530350.080905:0:476:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788530350.080923:0:476:0:(pinger.c:247:ptlrpc_pinger_process_import()) 9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788530350.080928:0:476:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788530350.080932:0:476:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788530350.081024:0:476:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788530350.081029:0:476:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788530350.081095:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03737b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875409555874304:0@lo:400:kworker.0 00000400:00000100:0.0:1788530350.081199:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875409555874304 offset 0 length 224: 4 00000100:00100000:0.0:1788530350.081293:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788530350.081300:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03737100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875409555874176:0@lo:400:kworker.0 00000400:00000100:0.0:1788530350.081324:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875409555874176 offset 0 length 224: 4 00000020:01000004:2.0:1788530350.270413:0:15571:0:(tgt_mount.c:2269:server_umount_begin()) umount -f 00000020:01000004:1.0:1788530350.279784:0:15571:0:(tgt_mount.c:2125:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1788530350.279859:0:15571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b600/0xb28d70e125750591 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125750598 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530350.279877:0:15571:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b600/0xb28d70e125750591 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e125750598 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530350.279885:0:15571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b600/0xb28d70e125750591 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xb28d70e125750598 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530350.279893:0:15571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b600/0xb28d70e125750591 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xb28d70e125750598 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530350.279918:0:15571:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788530350.279937:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:1.0:1788530350.279943:0:15571:0:(mgc_request_server.c:165:mgc_fs_clear()) MGC192.168.202.141@tcp: clear lustre-client 00010000:00010000:2.0:1788530350.279946:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b600/0xb28d70e125750591 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xb28d70e125750598 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788530350.279949:0:15571:0:(mgc_request.c:651:config_log_end()) end config log lustre-client (0) 00010000:00010000:2.0:1788530350.279954:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d36b600 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:2.0:1788530350.279966:0:6512:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b600/0xb28d70e125750591 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xb28d70e125750598 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530350.279977:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b600/0xb28d70e125750591 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xb28d70e125750598 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788530350.280049:0:15571:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788530350.280065:0:15571:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a9e03737800 x1875409555873664/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788530367 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530350.280083:0:15571:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 10000000:00010000:2.0:1788530350.280124:0:6512:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b600/0xb28d70e125750591 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xb28d70e125750598 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788530350.280124:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9e02239000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788530350.280129:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-5) 10000000:01000000:2.0:1788530350.280131:0:6512:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788530350.280134:0:6512:0:(mgc_request.c:1235:mgc_blocking_ast()) log lustre-client: stale lock, won't requeue 10000000:01000000:2.0:1788530350.280137:0:6512:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00100000:1.0:1788530350.280139:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03737800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1875409555873664:0@lo:38:kworker.0 00000100:00080000:1.0:1788530350.280172:0:15571:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00010000:00010000:2.0:1788530350.280174:0:6512:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a9f1768a800 00010000:00010000:2.0:1788530350.280178:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b600/0xb28d70e125750591 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000000 nid: local remote: 0xb28d70e125750598 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788530350.280178:0:15571:0:(import.c:65:import_set_state_nolock()) ffff9a9e02239000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00010000:00010000:2.0:1788530350.280185:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b600/0xb28d70e125750591 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000000 nid: local remote: 0xb28d70e125750598 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530350.280197:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530350.280199:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530350.280202:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788530350.280813:0:15571:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788530350.280816:0:15571:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788530350.280820:0:15571:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788530350.284400:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788530350.284440:0:15571:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788530350.284459:0:15571:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a9e03734a80 x1875409555873792/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530363 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530350.284488:0:15571:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a9e03737100 x1875409555874176/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530366 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530350.284506:0:15571:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788530350.284515:0:15571:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1788530350.284661:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03734a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875409555873792:0@lo:400:kworker.0 00000100:00100000:0.0:1788530350.284675:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03737100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875409555874176:0@lo:400:kworker.0 00000100:00080000:1.0:1788530350.284737:0:15571:0:(import.c:65:import_set_state_nolock()) ffff9a9e010c7000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788530350.284786:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37374700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3646:1875409555874432:0@lo:39:umount.0 00000400:00000100:2.0:1788530350.284844:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875409555874432 offset 0 length 224: 4 00000001:00100000:1.0:1788530351.174889:0:8431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788530351.174908:0:8431:0:(genops.c:885:class_export_put()) final put ffff9a9e0242f000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788530351.175506:0:476:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9e0242f000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000001:00100000:1.0:1788530351.175666:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788530351.175671:0:9518:0:(genops.c:885:class_export_put()) final put ffff9a9e027ab800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788530351.178673:0:476:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a9e02429800 for lustre-OST0000 00000020:00000080:0.0:1788530351.178704:0:476:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9e027ab800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1788530351.178752:0:476:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a9e027af800 for lustre-OST0001 00010000:00010000:1.0:1788530351.308069:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788530352.135338:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788530352.135352:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788530352.135356:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788530352.135360:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788530352.135510:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788530352.135538:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875409555874560:0@lo:400:kworker.0 00000400:00000100:1.0:1788530352.135632:0:3650:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875409555874560 offset 0 length 224: 4 00010000:00010000:2.0:1788530352.325078:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530353.345724:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788530354.369484:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788530344/real 1788530344] req@ffff9a9f328e4380 x1875409555873536/t0(0) o250->MGC192.168.202.141@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788530354 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788530354.369488:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788530354.369518:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a9f328e4380 x1875409555873536/t0(0) o250->MGC192.168.202.141@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788530354 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788530354.369620:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9f1768a800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788530354.369728:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1788530354.369733:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3646:1875409555873536:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:2.0:1788530354.377386:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788530354.377396:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788530354.377400:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a9f1768a800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788530354.377409:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.141@tcp: connect to NID 0@lo last attempt 552 00000100:00080000:2.0:1788530354.377415:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.141@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788530354.377423:0:36:0:(import.c:665:import_select_connection()) MGC192.168.202.141@tcp: import ffff9a9f1768a800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:2.0:1788530354.377462:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9e03d3f480 x1875409555874688/t0(0) o250->MGC192.168.202.141@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788530354.377554:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3646:1875409555874688:0@lo:250:kworker.0 00000400:00000100:1.0:1788530354.377623:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875409555874688 offset 0 length 520: 4 00000100:00080000:2.0:1788530354.377793:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788530354.377798:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788530354.377886:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875409555874816:0@lo:400:kworker.0 00000400:00000100:3.0:1788530354.377913:0:3650:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875409555874816 offset 0 length 224: 4 00010000:00010000:2.0:1788530355.392953:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530356.416840:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530357.440789:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530358.475154:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530359.488927:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788530359.874557:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788530359.874610:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788530359.874614:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788530359.874618:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788530359.874752:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37377100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875409555874944:0@lo:400:kworker.0 00000400:00000100:3.0:1788530359.874825:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875409555874944 offset 0 length 224: 4 00000100:00100000:1.0:1788530360.512725:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788530350/real 1788530350] req@ffff9a9f37374700 x1875409555874432/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788530360 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530360.512769:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a9f37374700 x1875409555874432/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788530360 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788530360.512792:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9e010c7000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788530360.512820:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37374700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3646:1875409555874432:0@lo:39:umount.0 00000100:00080000:2.0:1788530360.512940:0:15571:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788530360.512946:0:15571:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788530360.512952:0:15571:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788530360.513993:0:15571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f18140400/0xb28d70e12575059f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257505a6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530360.514009:0:15571:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f18140400/0xb28d70e12575059f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e1257505a6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530360.514018:0:15571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f18140400/0xb28d70e12575059f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xb28d70e1257505a6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530360.514026:0:15571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.141@tcp lock: ffff9a9f18140400/0xb28d70e12575059f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xb28d70e1257505a6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530360.514073:0:15571:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788530360.514092:0:15571:0:(mgc_request_server.c:165:mgc_fs_clear()) MGC192.168.202.141@tcp: clear lustre-OST0000 00010000:00010000:2.0:1788530360.514098:0:15571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d101200/0xb28d70e125750433 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575043a expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530360.514106:0:15571:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d101200/0xb28d70e125750433 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e12575043a expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530360.514112:0:15571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d101200/0xb28d70e125750433 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xb28d70e12575043a expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530360.514118:0:15571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.141@tcp lock: ffff9a9f3d101200/0xb28d70e125750433 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xb28d70e12575043a expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530360.514134:0:15571:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788530360.514141:0:15571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f42167200/0xb28d70e125750838 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575083f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530360.514148:0:15571:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f42167200/0xb28d70e125750838 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e12575083f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530360.514155:0:15571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f42167200/0xb28d70e125750838 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xb28d70e12575083f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530360.514162:0:15571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.141@tcp lock: ffff9a9f42167200/0xb28d70e125750838 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xb28d70e12575083f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530360.514184:0:15571:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:2.0:1788530360.514198:0:15571:0:(mgc_request_server.c:165:mgc_fs_clear()) MGC192.168.202.141@tcp: clear params 00010000:00010000:2.0:1788530360.514205:0:15571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f18140600/0xb28d70e1257505ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257505b4 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530360.514213:0:15571:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f18140600/0xb28d70e1257505ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e1257505b4 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530360.514219:0:15571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f18140600/0xb28d70e1257505ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xb28d70e1257505b4 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530360.514225:0:15571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.141@tcp lock: ffff9a9f18140600/0xb28d70e1257505ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xb28d70e1257505b4 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530360.514232:0:15571:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:2.0:1788530360.514278:0:15571:0:(mgc_request_server.c:165:mgc_fs_clear()) MGC192.168.202.141@tcp: clear lustre-sptlrpc 10000000:01000000:2.0:1788530360.514282:0:15571:0:(mgc_request.c:651:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1788530360.514307:0:15571:0:(tgt_mount.c:2175:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1788530360.514311:0:15571:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1788530360.514315:0:15571:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788530360.514321:0:15571:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788530360.514325:0:15571:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff9a9f2c149988) has no exports 00000020:00080000:2.0:1788530360.514347:0:15571:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff9a9f2c149988) has no exports 00000020:01000000:2.0:1788530360.516058:0:15571:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a9e034dd420 - data ffff9a9f2beded80/ffff9a9f33d7f400 00010000:00010000:1.0:1788530360.516417:0:10348:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788530360.516428:0:10348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f18140400/0xb28d70e12575059f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xb28d70e1257505a6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530360.516440:0:10348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f18140400 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:1.0:1788530360.516445:0:10348:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f18140400/0xb28d70e12575059f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xb28d70e1257505a6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530360.516479:0:10348:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f18140400/0xb28d70e12575059f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xb28d70e1257505a6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788530360.516487:0:10348:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f18140400/0xb28d70e12575059f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xb28d70e1257505a6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788530360.516492:0:10348:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788530360.516495:0:10348:0:(mgc_request.c:1235:mgc_blocking_ast()) log lustre-OST0000: stale lock, won't requeue 10000000:01000000:1.0:1788530360.516498:0:10348:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1788530360.516606:0:10348:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a9f1768a800 00010000:00010000:1.0:1788530360.516611:0:10348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f18140400/0xb28d70e12575059f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xb28d70e1257505a6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530360.516619:0:10348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f18140400/0xb28d70e12575059f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xb28d70e1257505a6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530360.516633:0:10348:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788530360.516637:0:10348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f3d101200/0xb28d70e125750433 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xb28d70e12575043a expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530360.516644:0:10348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d101200 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:1.0:1788530360.516647:0:10348:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f3d101200/0xb28d70e125750433 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xb28d70e12575043a expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530360.516655:0:10348:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f3d101200/0xb28d70e125750433 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xb28d70e12575043a expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788530360.516661:0:10348:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f3d101200/0xb28d70e125750433 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xb28d70e12575043a expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788530360.516677:0:10348:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1788530360.516679:0:10348:0:(mgc_request.c:1235:mgc_blocking_ast()) log lustre-mdtir: stale lock, won't requeue 10000000:01000000:1.0:1788530360.516682:0:10348:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1788530360.516705:0:10348:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a9f1768a800 00010000:00010000:1.0:1788530360.516709:0:10348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f3d101200/0xb28d70e125750433 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xb28d70e12575043a expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530360.516715:0:10348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f3d101200/0xb28d70e125750433 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xb28d70e12575043a expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530360.516724:0:10348:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788530360.516728:0:10348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f42167200/0xb28d70e125750838 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xb28d70e12575083f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530360.516734:0:10348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f42167200 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:1.0:1788530360.516737:0:10348:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f42167200/0xb28d70e125750838 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xb28d70e12575083f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530360.516743:0:10348:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f42167200/0xb28d70e125750838 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xb28d70e12575083f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788530360.516749:0:10348:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f42167200/0xb28d70e125750838 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xb28d70e12575083f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788530360.516754:0:10348:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788530360.516757:0:10348:0:(mgc_request.c:1235:mgc_blocking_ast()) log params: stale lock, won't requeue 10000000:01000000:1.0:1788530360.516759:0:10348:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788530360.516774:0:10348:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a9f1768a800 00010000:00010000:1.0:1788530360.516777:0:10348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f42167200/0xb28d70e125750838 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xb28d70e12575083f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530360.516788:0:10348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f42167200/0xb28d70e125750838 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xb28d70e12575083f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530360.516796:0:10348:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788530360.516799:0:10348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f18140600/0xb28d70e1257505ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xb28d70e1257505b4 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530360.516805:0:10348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f18140600 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:1.0:1788530360.516808:0:10348:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f18140600/0xb28d70e1257505ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xb28d70e1257505b4 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530360.516815:0:10348:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f18140600/0xb28d70e1257505ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xb28d70e1257505b4 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788530360.516821:0:10348:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f18140600/0xb28d70e1257505ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xb28d70e1257505b4 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788530360.516826:0:10348:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788530360.516829:0:10348:0:(mgc_request.c:1235:mgc_blocking_ast()) log lustre-sptlrpc: stale lock, won't requeue 10000000:01000000:1.0:1788530360.516831:0:10348:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1788530360.516866:0:10348:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a9f1768a800 00010000:00010000:1.0:1788530360.516870:0:10348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f18140600/0xb28d70e1257505ad lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xb28d70e1257505b4 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530360.516875:0:10348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f18140600/0xb28d70e1257505ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xb28d70e1257505b4 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530360.516883:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530360.516885:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530360.516890:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530360.517053:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530360.517372:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530360.517494:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1788530360.523272:0:15571:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a9e022f13c0 - data ffff9a9f2be73af8/ffff9a9e02537400 00100000:10000000:2.0:1788530360.534641:0:15571:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1788530360.545987:0:15571:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e125750265 00000020:00000080:1.0:1788530360.546011:0:15571:0:(genops.c:885:class_export_put()) final put ffff9a9e01aa6800/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1788530360.546273:0:15571:0:(tgt_mount.c:201:server_put_mount()) put mount ffff9a9f33b6f800 from lustre-OST0000, refs=2 00000020:01000004:1.0:1788530360.546278:0:15571:0:(obd_mount.c:712:lustre_put_lsi()) put ffff9a9f33b6f800 2 00000020:01000004:1.0:1788530360.546281:0:15571:0:(tgt_mount.c:134:server_deregister_mount()) deregister mount ffff9a9f33b6f800 from lustre-OST0000 00000020:00000080:1.0:1788530360.546307:0:15571:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788530360.546318:0:15571:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1788530360.546321:0:15571:0:(genops.c:885:class_export_put()) final put ffff9a9e01aa2800/lustre-OST0000_UUID 00000020:00000080:1.0:1788530360.546325:0:15571:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9e01aa2800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1788530360.546334:0:15571:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1788530360.546391:0:15571:0:(obd_mount.c:580:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1788530360.546395:0:15571:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1788530360.546399:0:15571:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788530360.546404:0:15571:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788530360.546412:0:15571:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9a9e010c5000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788530360.546419:0:15571:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff9a9f2c103310) has exports, disconnecting them 00000020:00080000:1.0:1788530360.546424:0:15571:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9a9e010c5000), last request at 1788530073 00000020:00000080:1.0:1788530360.546429:0:15571:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e12575029d 00000020:00080000:1.0:1788530360.546449:0:15571:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a9e010c5000): rc 0 00000020:00000080:1.0:1788530360.546454:0:15571:0:(genops.c:885:class_export_put()) final put ffff9a9e010c5000/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1788530360.546528:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9e01aa6800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1788530360.548005:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9e010c5000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1788530360.548801:0:15571:0:(obd_class.h:688:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1788530360.548811:0:15571:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788530360.548815:0:15571:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788530360.548825:0:15571:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788530360.549058:0:15571:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788530360.549070:0:15571:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:0.0:1788530360.549077:0:15571:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1788530360.549084:0:15571:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788530360.549088:0:15571:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788530360.549096:0:15571:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff9a9e010c1800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788530360.549103:0:15571:0:(genops.c:1553:class_disconnect_exports()) OBD device 20 (ffff9a9f33d94c98) has exports, disconnecting them 00000020:00080000:0.0:1788530360.549119:0:15571:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff9a9e010c1800), last request at 1788530073 00000020:00000080:0.0:1788530360.549125:0:15571:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e1257502b2 00000020:00080000:0.0:1788530360.549143:0:15571:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a9e010c1800): rc 0 00000020:00000080:0.0:1788530360.549150:0:15571:0:(genops.c:885:class_export_put()) final put ffff9a9e010c1800/lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1788530360.550320:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a9e02239000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1788530360.550333:0:36:0:(genops.c:885:class_export_put()) final put ffff9a9e0223e800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1788530360.550336:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9e0223e800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1788530360.550355:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1788530360.550421:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9e010c1800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:2.0:1788530360.550760:0:15571:0:(obd_class.h:688:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:2.0:1788530360.550766:0:15571:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788530360.550770:0:15571:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788530360.550776:0:15571:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788530360.550796:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a9e010c7000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1788530360.550977:0:15571:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788530360.550986:0:15571:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:2.0:1788530360.550989:0:15571:0:(genops.c:885:class_export_put()) final put ffff9a9e010c0800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:2.0:1788530360.550992:0:15571:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9e010c0800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:2.0:1788530360.550996:0:15571:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:2.0:1788530360.551032:0:15571:0:(obd_mount.c:712:lustre_put_lsi()) put ffff9a9f33b6f800 1 00000020:00000080:2.0:1788530360.551039:0:15571:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e12575022d 00000020:00000080:2.0:1788530360.551047:0:15571:0:(genops.c:885:class_export_put()) final put ffff9a9f3d0c3800/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1788530360.551056:0:15571:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1788530360.551064:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f3d0c3800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1788530360.551074:0:15571:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788530360.551080:0:15571:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788530360.551084:0:15571:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff9a9f2c101988) has no exports 00000020:00000080:2.0:1788530360.602877:0:15571:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788530360.602898:0:15571:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1788530360.602906:0:15571:0:(genops.c:885:class_export_put()) final put ffff9a9f33b6b800/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1788530360.603030:0:15571:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f33b6b800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1788530360.603045:0:15571:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1788530360.603261:0:15571:0:(obd_mount.c:670:lustre_free_lsi()) Freeing lsi ffff9a9f33b68000 00000020:02000400:2.0:1788530360.603317:0:15571:0:(tgt_mount.c:2258:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1788530361.540133:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530362.561101:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:0.0:1788530363.520710:0:3650:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788530347/real 1788530347] req@ffff9a9e03734e00 x1875409555874048/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788530363 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530363.543673:0:3650:0:(client.c:2548:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9a9e03734e00 x1875409555874048/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788530363 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788530363.543689:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9a9e0223d000 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788530363.543708:0:3650:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788530363.560669:0:3650:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00100000:0.0:1788530363.565870:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03734e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875409555874048:0@lo:400:kworker.0 00000100:00080000:1.0:1788530363.569057:0:12493:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788530363.569159:0:12493:0:(pinger.c:247:ptlrpc_pinger_process_import()) 9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788530363.569163:0:12493:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788530363.569167:0:12493:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788530363.569169:0:12493:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788530363.569173:0:12493:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788530363.569184:0:12493:0:(import.c:65:import_set_state_nolock()) ffff9a9e0223d000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788530363.569195:0:12493:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 311 00000100:00080000:1.0:1788530363.569209:0:12493:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9a9e0223d000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:1.0:1788530363.569253:0:12493:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9f37374700 x1875409555875072/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788530363.570664:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37374700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3646:1875409555875072:0@lo:38:kworker.0 00000400:00000100:3.0:1788530363.570747:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875409555875072 offset 0 length 520: 4 00010000:00010000:3.0:1788530363.586167:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530364.616115:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788530365.161800:0:15773:0:(tgt_mount.c:2269:server_umount_begin()) umount -f 00000020:01000004:0.0:1788530365.180837:0:15773:0:(tgt_mount.c:2125:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1788530365.180925:0:15773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d000/0xb28d70e125750567 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575056e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530365.180942:0:15773:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d000/0xb28d70e125750567 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e12575056e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530365.180949:0:15773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d000/0xb28d70e125750567 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xb28d70e12575056e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530365.180956:0:15773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d000/0xb28d70e125750567 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xb28d70e12575056e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530365.180973:0:15773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788530365.180990:0:15773:0:(mgc_request_server.c:165:mgc_fs_clear()) MGC192.168.202.141@tcp: clear lustre-client 10000000:01000000:0.0:1788530365.180995:0:15773:0:(mgc_request.c:651:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788530365.181018:0:15773:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788530365.181029:0:15773:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a9e03734380 x1875409555873920/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788530367 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530365.181046:0:15773:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788530365.181052:0:15773:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788530365.181057:0:15773:0:(import.c:65:import_set_state_nolock()) ffff9a9e0223a800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1788530365.181062:0:15773:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788530365.181065:0:15773:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a9e03734380 x1875409555873920/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788530367 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530365.181086:0:15773:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788530365.181089:0:15773:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 2s for inflight to error out 00010000:00010000:1.0:1788530365.186615:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788530365.186630:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d000/0xb28d70e125750567 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xb28d70e12575056e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530365.186643:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f0c91d000 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:1.0:1788530365.186647:0:6512:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d000/0xb28d70e125750567 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xb28d70e12575056e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530365.186662:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d000/0xb28d70e125750567 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xb28d70e12575056e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788530365.186670:0:6512:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d000/0xb28d70e125750567 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xb28d70e12575056e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788530365.186675:0:6512:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788530365.186678:0:6512:0:(mgc_request.c:1235:mgc_blocking_ast()) log lustre-client: stale lock, won't requeue 10000000:01000000:1.0:1788530365.186681:0:6512:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788530365.186732:0:6512:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a9f1768a800 00010000:00010000:1.0:1788530365.186735:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d000/0xb28d70e125750567 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xb28d70e12575056e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530365.186742:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d000/0xb28d70e125750567 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xb28d70e12575056e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530365.186755:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530365.186775:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530365.186776:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788530365.187016:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03734380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1875409555873920:0@lo:38:kworker.0 00000100:00080000:1.0:1788530365.188529:0:15773:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788530365.188555:0:15773:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a9e03737b80 x1875409555874304/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530366 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530365.188627:0:15773:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a9e03d3ed80 x1875409555874560/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530368 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530365.188646:0:15773:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a9e03d3df80 x1875409555874816/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530370 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530365.188655:0:15773:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a9f37377100 x1875409555874944/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530375 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530365.188667:0:15773:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a9f37374700 x1875409555875072/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788530373 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530365.188678:0:15773:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788530365.188686:0:15773:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1788530365.188695:0:15773:0:(import.c:65:import_set_state_nolock()) ffff9a9e0223d000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1788530365.188702:0:15773:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788530365.188706:0:15773:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a9e03737b80 x1875409555874304/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530366 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530365.188713:0:15773:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a9e03d3ed80 x1875409555874560/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530368 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530365.188720:0:15773:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a9e03d3df80 x1875409555874816/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530370 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530365.188727:0:15773:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a9f37377100 x1875409555874944/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530375 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530365.188734:0:15773:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a9f37374700 x1875409555875072/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788530373 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530365.188764:0:15773:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788530365.188769:0:15773:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 13s for inflight to error out 00000100:00100000:3.0:1788530365.188775:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875409555874816:0@lo:400:kworker.0 00000100:00100000:3.0:1788530365.188808:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875409555874560:0@lo:400:kworker.0 00000100:00100000:3.0:1788530365.188864:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37377100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875409555874944:0@lo:400:kworker.0 00000100:00100000:2.0:1788530365.188962:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03737b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875409555874304:0@lo:400:kworker.0 00000100:00100000:2.0:1788530365.188987:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37374700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3646:1875409555875072:0@lo:38:kworker.0 00010000:00010000:1.0:1788530365.192523:0:15773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36bc00/0xb28d70e125750575 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575057c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530365.192550:0:15773:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36bc00/0xb28d70e125750575 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e12575057c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530365.192624:0:15773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36bc00/0xb28d70e125750575 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xb28d70e12575057c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530365.192633:0:15773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36bc00/0xb28d70e125750575 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xb28d70e12575057c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530365.192659:0:15773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788530365.192682:0:15773:0:(mgc_request_server.c:165:mgc_fs_clear()) MGC192.168.202.141@tcp: clear lustre-OST0001 00010000:00010000:1.0:1788530365.192688:0:15773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f18141200/0xb28d70e125750417 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575041e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530365.192696:0:15773:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f18141200/0xb28d70e125750417 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e12575041e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530365.192702:0:15773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f18141200/0xb28d70e125750417 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xb28d70e12575041e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530365.192708:0:15773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.141@tcp lock: ffff9a9f18141200/0xb28d70e125750417 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xb28d70e12575041e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530365.192725:0:15773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788530365.192747:0:15773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d100a00/0xb28d70e12575082a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125750831 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530365.192754:0:15773:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d100a00/0xb28d70e12575082a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e125750831 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530365.192760:0:15773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d100a00/0xb28d70e12575082a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xb28d70e125750831 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530365.192767:0:15773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.141@tcp lock: ffff9a9f3d100a00/0xb28d70e12575082a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xb28d70e125750831 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530365.192830:0:15773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:1.0:1788530365.192841:0:15773:0:(mgc_request_server.c:165:mgc_fs_clear()) MGC192.168.202.141@tcp: clear params 00010000:00010000:1.0:1788530365.192846:0:15773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36a600/0xb28d70e125750583 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575058a expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530365.192853:0:15773:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36a600/0xb28d70e125750583 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e12575058a expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530365.192859:0:15773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36a600/0xb28d70e125750583 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xb28d70e12575058a expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530365.192865:0:15773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36a600/0xb28d70e125750583 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xb28d70e12575058a expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530365.196299:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788530365.196366:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36bc00/0xb28d70e125750575 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xb28d70e12575057c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530365.196380:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d36bc00 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:0.0:1788530365.196385:0:6512:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36bc00/0xb28d70e125750575 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xb28d70e12575057c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530365.196395:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36bc00/0xb28d70e125750575 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xb28d70e12575057c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788530365.196402:0:6512:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36bc00/0xb28d70e125750575 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xb28d70e12575057c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788530365.196407:0:6512:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788530365.196409:0:6512:0:(mgc_request.c:1235:mgc_blocking_ast()) log lustre-OST0001: stale lock, won't requeue 00010000:00010000:0.0:1788530365.196425:0:6512:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a9f1768a800 00010000:00010000:0.0:1788530365.196429:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36bc00/0xb28d70e125750575 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xb28d70e12575057c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530365.196434:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36bc00/0xb28d70e125750575 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xb28d70e12575057c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530365.196454:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788530365.196458:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f18141200/0xb28d70e125750417 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xb28d70e12575041e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530365.196463:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f18141200 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:0.0:1788530365.196485:0:6512:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f18141200/0xb28d70e125750417 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xb28d70e12575041e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530365.196492:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f18141200/0xb28d70e125750417 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xb28d70e12575041e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788530365.196498:0:6512:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f18141200/0xb28d70e125750417 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xb28d70e12575041e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788530365.196503:0:6512:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1788530365.196506:0:6512:0:(mgc_request.c:1235:mgc_blocking_ast()) log lustre-mdtir: stale lock, won't requeue 10000000:01000000:0.0:1788530365.196508:0:6512:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1788530365.196581:0:6512:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a9f1768a800 00010000:00010000:0.0:1788530365.196585:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f18141200/0xb28d70e125750417 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xb28d70e12575041e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530365.196591:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f18141200/0xb28d70e125750417 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xb28d70e12575041e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530365.196609:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788530365.196613:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f3d100a00/0xb28d70e12575082a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xb28d70e125750831 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530365.196619:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d100a00 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:0.0:1788530365.196621:0:6512:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f3d100a00/0xb28d70e12575082a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xb28d70e125750831 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530365.196629:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f3d100a00/0xb28d70e12575082a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xb28d70e125750831 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530365.196679:0:15773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788530365.196738:0:15773:0:(mgc_request_server.c:165:mgc_fs_clear()) MGC192.168.202.141@tcp: clear lustre-sptlrpc 10000000:01000000:1.0:1788530365.196742:0:15773:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:1.0:1788530365.196761:0:15773:0:(mgc_request.c:651:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1788530365.196785:0:15773:0:(tgt_mount.c:2175:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1788530365.196796:0:15773:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1788530365.196801:0:15773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788530365.196807:0:15773:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788530365.196812:0:15773:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff9a9e027be620) has no exports 00000020:00080000:1.0:1788530365.196835:0:15773:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff9a9e027be620) has no exports 10000000:00010000:0.0:1788530365.197391:0:6512:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f3d100a00/0xb28d70e12575082a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xb28d70e125750831 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788530365.197409:0:6512:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788530365.197412:0:6512:0:(mgc_request.c:1235:mgc_blocking_ast()) log params: stale lock, won't requeue 10000000:01000000:0.0:1788530365.197415:0:6512:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788530365.197439:0:6512:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a9f1768a800 00010000:00010000:0.0:1788530365.197443:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f3d100a00/0xb28d70e12575082a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xb28d70e125750831 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530365.197450:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f3d100a00/0xb28d70e12575082a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xb28d70e125750831 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530365.197465:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788530365.197469:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36a600/0xb28d70e125750583 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xb28d70e12575058a expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530365.197475:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d36a600 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:0.0:1788530365.197479:0:6512:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36a600/0xb28d70e125750583 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xb28d70e12575058a expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530365.197487:0:6512:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36a600/0xb28d70e125750583 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xb28d70e12575058a expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788530365.197493:0:6512:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36a600/0xb28d70e125750583 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xb28d70e12575058a expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788530365.197498:0:6512:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788530365.197500:0:6512:0:(mgc_request.c:1235:mgc_blocking_ast()) log lustre-sptlrpc: stale lock, won't requeue 10000000:01000000:0.0:1788530365.197502:0:6512:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1788530365.197530:0:6512:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a9f1768a800 00010000:00010000:0.0:1788530365.197533:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36a600/0xb28d70e125750583 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xb28d70e12575058a expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530365.197546:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36a600/0xb28d70e125750583 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xb28d70e12575058a expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530365.197557:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530365.197581:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530365.197584:0:6512:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1788530365.201211:0:15773:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a9e034ddc60 - data ffff9a9f2bedf948/ffff9a9f33d7e800 00000020:01000000:1.0:1788530365.202739:0:15773:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a9e030d5c60 - data ffff9a9f2befe948/ffff9a9e03229800 00010000:00010000:2.0:1788530365.203264:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530365.203542:0:10348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:0.0:1788530365.223394:0:15773:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788530365.243800:0:15773:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e1257503b5 00000020:00000080:2.0:1788530365.243821:0:15773:0:(genops.c:885:class_export_put()) final put ffff9a9e027af000/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1788530365.243853:0:15773:0:(tgt_mount.c:201:server_put_mount()) put mount ffff9a9e01aa6000 from lustre-OST0001, refs=2 00000020:01000004:2.0:1788530365.243858:0:15773:0:(obd_mount.c:712:lustre_put_lsi()) put ffff9a9e01aa6000 2 00000020:01000004:2.0:1788530365.243863:0:15773:0:(tgt_mount.c:134:server_deregister_mount()) deregister mount ffff9a9e01aa6000 from lustre-OST0001 00000020:00000080:2.0:1788530365.243903:0:15773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788530365.243915:0:15773:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1788530365.243919:0:15773:0:(genops.c:885:class_export_put()) final put ffff9a9e027ae000/lustre-OST0001_UUID 00000020:00000080:2.0:1788530365.243923:0:15773:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9e027ae000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1788530365.243933:0:15773:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1788530365.244096:0:15773:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b->MGS 00010000:00010000:2.0:1788530365.244118:0:15773:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f00030c00/0xb28d70e1257500e4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xb28d70e1257500eb expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788530365.244139:0:15773:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f00030c00/0xb28d70e1257500e4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xb28d70e1257500eb expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788530365.244147:0:15773:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1788530365.244149:0:15773:0:(mgc_request.c:1252:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1788530365.244152:0:15773:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1788530365.244197:0:15773:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a9f1768a800 00010000:00010000:2.0:1788530365.244202:0:15773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f00030c00/0xb28d70e1257500e4 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xb28d70e1257500eb expref: -99 pid: 7453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788530365.244230:0:15773:0:(import.c:65:import_set_state_nolock()) ffff9a9f1768a800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1788530365.244234:0:15773:0:(mgc_request.c:1469:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788530365.244247:0:15773:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788530365.244249:0:15773:0:(mgc_request.c:1469:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788530365.244256:0:15773:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788530365.244272:0:15773:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a9e03d3f480 x1875409555874688/t0(0) o250->MGC192.168.202.141@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788530369 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788530365.244414:0:15773:0:(mgc_request.c:1469:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788530365.244418:0:15773:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 5s for inflight to error out 00000020:00000080:1.0:1788530365.244470:0:476:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9e027af000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:3.0:1788530365.246517:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b:3646:1875409555874688:0@lo:250:kworker.0 10000000:01000000:2.0:1788530365.246900:0:15773:0:(mgc_request.c:1469:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788530365.246914:0:15773:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e12574ffe1 00000020:00000080:2.0:1788530365.246924:0:15773:0:(genops.c:885:class_export_put()) final put ffff9a9f1768b800/9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b 00000020:01000000:2.0:1788530365.246947:0:15773:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGC192.168.202.141@tcp (flags='') 00000020:00000080:2.0:1788530365.246955:0:15773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788530365.246966:0:15773:0:(obd_config.c:956:class_cleanup()) MGC192.168.202.141@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788530365.246971:0:15773:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9a9f2c14cc98) has no exports 00000020:00000080:1.0:1788530365.247418:0:476:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f1768b800/9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b for MGC192.168.202.141@tcp 10000000:01000000:3.0:1788530365.248475:0:6521:0:(mgc_request.c:982:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1788530365.248755:0:15773:0:(obd_class.h:688:obd_cleanup_client_import()) MGC192.168.202.141@tcp: client import never connected 00000100:00080000:2.0:1788530365.248762:0:15773:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1788530365.248768:0:15773:0:(mgc_request.c:1469:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788530365.248772:0:15773:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1788530365.248775:0:15773:0:(mgc_request.c:1469:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788530365.248872:0:15773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788530365.248885:0:15773:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.141@tcp (uuid 9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b) 00000020:01000000:2.0:1788530365.248898:0:15773:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1788530365.248908:0:15773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788530365.248914:0:15773:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788530365.248923:0:15773:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9a9e0223a000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788530365.248929:0:15773:0:(genops.c:1553:class_disconnect_exports()) OBD device 25 (ffff9a9f3d214c98) has exports, disconnecting them 00000020:00080000:2.0:1788530365.248935:0:15773:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9a9e0223a000), last request at 1788530103 00000020:00000080:2.0:1788530365.248941:0:15773:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e1257503ed 00000020:00080000:2.0:1788530365.248959:0:15773:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a9e0223a000): rc 0 00000020:00000080:2.0:1788530365.248965:0:15773:0:(genops.c:885:class_export_put()) final put ffff9a9e0223a000/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1788530365.249418:0:476:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a9f1768a800 for MGC192.168.202.141@tcp 00000020:00000080:1.0:1788530365.249429:0:476:0:(genops.c:885:class_export_put()) final put ffff9a9f1768e000/9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b 00000020:00000080:1.0:1788530365.249431:0:476:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f1768e000/9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b for MGC192.168.202.141@tcp 00000020:01000000:1.0:1788530365.249440:0:476:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.141@tcp (9dd54f94-f895-4b7a-a2d0-3122f3f4ac2b) 00000020:00000080:1.0:1788530365.249835:0:476:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9e0223a000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:3.0:1788530365.250694:0:15773:0:(obd_class.h:688:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:3.0:1788530365.250705:0:15773:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788530365.250711:0:15773:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788530365.250721:0:15773:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788530365.250912:0:15773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788530365.250920:0:15773:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:3.0:1788530365.250927:0:15773:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1788530365.250932:0:15773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788530365.250936:0:15773:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788530365.250943:0:15773:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff9a9f3d655800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788530365.250949:0:15773:0:(genops.c:1553:class_disconnect_exports()) OBD device 26 (ffff9a9f3d216620) has exports, disconnecting them 00000020:00080000:3.0:1788530365.250954:0:15773:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff9a9f3d655800), last request at 1788530103 00000020:00000080:3.0:1788530365.250958:0:15773:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e125750402 00000020:00080000:3.0:1788530365.250972:0:15773:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a9f3d655800): rc 0 00000020:00000080:3.0:1788530365.250977:0:15773:0:(genops.c:885:class_export_put()) final put ffff9a9f3d655800/lustre-MDT0001-lwp-OST0001 00000020:00000080:1.0:1788530365.251411:0:476:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a9e0223a800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1788530365.251420:0:476:0:(genops.c:885:class_export_put()) final put ffff9a9e025cf800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1788530365.251423:0:476:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9e025cf800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1788530365.251431:0:476:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1788530365.251515:0:476:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f3d655800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:3.0:1788530365.251957:0:15773:0:(obd_class.h:688:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:3.0:1788530365.251962:0:15773:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788530365.251966:0:15773:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788530365.251969:0:15773:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788530365.256732:0:476:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a9e0223d000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:1.0:1788530365.257640:0:6512:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1788530365.391773:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:3.0:1788530365.392145:0:10348:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:2.0:1788530365.392375:0:6507:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9a9f04d97600:6507] 1 exiting: rc = 0 00000100:00100000:3.0:1788530365.392519:0:10346:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_003: service thread [ffff9a9f177b4800:10346] 3 exiting: rc = 0 00000100:00100000:3.0:1788530365.392641:0:9537:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff9a9f2029f800:9537] 2 exiting: rc = 0 00000100:00100000:3.0:1788530365.392719:0:6506:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9a9f04d97a00:6506] 0 exiting: rc = 1 00000100:00100000:1.0:1788530365.392891:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530365.393326:0:6508:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9a9f12474a00:6508] 0 exiting: rc = 1 00000100:00100000:2.0:1788530365.393464:0:6510:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9a9f2c0ebc00:6510] 2 exiting: rc = 0 00000100:00100000:3.0:1788530365.393605:0:6509:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9a9f2c0eb800:6509] 1 exiting: rc = 0 00000100:00100000:3.0:1788530365.393672:0:10347:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9a9f08fbe800:10347] 3 exiting: rc = 0 00000100:00100000:1.0:1788530365.393799:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530365.393809:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530365.393816:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530365.393822:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530365.393830:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530365.393837:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530365.393855:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530365.393863:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530365.393870:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530365.393876:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530365.393884:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530365.393890:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530365.393896:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530365.393903:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530365.393909:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530365.393916:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530365.393922:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530365.393930:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530365.393937:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530365.393943:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530365.393950:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530365.393958:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530365.393964:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530365.393970:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530365.393976:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530365.394062:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530365.394068:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530365.394073:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530365.394079:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530365.394085:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530365.394090:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530365.394095:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530365.394101:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530365.394107:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530365.394112:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530365.394117:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530365.394123:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530365.394139:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530365.394146:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530365.394151:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530365.394157:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530365.394171:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530365.394176:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530365.394182:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530365.394189:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530365.394194:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530365.394200:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530365.394205:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530365.394211:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530365.394216:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530365.394221:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530365.394227:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530365.394233:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530365.394237:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530365.394244:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530365.394250:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530365.394255:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530365.394261:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530365.394267:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530365.394273:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530365.394279:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530365.394284:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530365.394290:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530365.394296:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788530365.397350:0:15773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788530365.397367:0:15773:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:1.0:1788530365.397377:0:15773:0:(genops.c:885:class_export_put()) final put ffff9a9e025ca000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:1.0:1788530365.397383:0:15773:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9e025ca000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:1.0:1788530365.397390:0:15773:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:1.0:1788530365.397471:0:15773:0:(obd_mount.c:712:lustre_put_lsi()) put ffff9a9e01aa6000 1 00000020:00000080:1.0:1788530365.397481:0:15773:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb28d70e125750384 00000020:00000080:1.0:1788530365.397490:0:15773:0:(genops.c:885:class_export_put()) final put ffff9a9e0262e800/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1788530365.397519:0:15773:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1788530365.397524:0:15773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788530365.397530:0:15773:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788530365.397546:0:15773:0:(genops.c:1558:class_disconnect_exports()) OBD device 23 (ffff9a9f2c14b310) has no exports 00000020:00000080:2.0:1788530365.398100:0:476:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9e0262e800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1788530365.457318:0:15773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788530365.457341:0:15773:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1788530365.457349:0:15773:0:(genops.c:885:class_export_put()) final put ffff9a9e01aa7800/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1788530365.457354:0:15773:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9e01aa7800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1788530365.457362:0:15773:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1788530365.461044:0:15773:0:(obd_mount.c:670:lustre_free_lsi()) Freeing lsi ffff9a9e01aa4800 00000020:01000000:2.0:1788530365.461083:0:15773:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1788530365.461092:0:15773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788530365.461098:0:15773:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788530365.461103:0:15773:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9a9f33d93310) has no exports 00000020:00000080:2.0:1788530365.461146:0:15773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788530365.461159:0:15773:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1788530365.461164:0:15773:0:(genops.c:885:class_export_put()) final put ffff9a9f3d0c2800/OSS_uuid 00000020:00000080:2.0:1788530365.461168:0:15773:0:(genops.c:844:class_export_destroy()) destroying export ffff9a9f3d0c2800/OSS_uuid for OSS 00000020:01000000:2.0:1788530365.461176:0:15773:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:0.0:1788530365.461411:0:8752:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9a9e02427200:8752] 3 exiting: rc = 0 00000100:00100000:0.0:1788530365.461558:0:8439:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9a9f32aa9600:8439] 2 exiting: rc = 0 00000100:00100000:1.0:1788530365.462331:0:8438:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9a9f3d0ca400:8438] 1 exiting: rc = 0 00000100:00100000:2.0:1788530365.466901:0:8436:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9a9f3d0b3600:8436] 0 exiting: rc = 1 00000100:00100000:2.0:1788530365.467038:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.467048:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.467064:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.467073:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.467081:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.467086:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.467091:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.467096:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.467102:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.467107:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.467117:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.467125:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.467143:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.467148:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.467154:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.467177:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.467183:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.467189:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.467195:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.467200:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.467206:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.467210:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.467215:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.467220:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.467226:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.467230:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.467236:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.467242:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.467248:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.467254:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.467259:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.467270:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.467277:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.467282:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.467289:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.467296:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.467305:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.467312:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.467318:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.467323:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.467328:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.467334:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.467338:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.467343:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.467348:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.467355:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.467359:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.467363:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.467369:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.467374:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.467386:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.467393:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.467399:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.467404:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.467410:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.467415:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.467421:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.467435:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.467441:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.467447:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.467452:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.467457:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.467462:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.467472:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.468413:0:8440:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9a9f3d0c9000:8440] 0 exiting: rc = 1 00000100:00080000:3.0:1788530365.471226:0:6519:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1788530365.471408:0:8441:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9a9f3d10e400:8441] 1 exiting: rc = 0 00000100:00100000:1.0:1788530365.472222:0:9912:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9a9f177b5000:9912] 2 exiting: rc = 0 00000100:00100000:2.0:1788530365.482873:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.482893:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.482901:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.482906:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.482912:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.482917:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.482923:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.482928:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.482933:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.482938:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.482943:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.482949:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.482954:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.482958:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.482963:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.482967:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.482972:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.482977:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.482983:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.482988:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.483004:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.483009:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.483014:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.483077:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.483085:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.483090:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.483095:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.483100:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.483105:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.483109:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.483114:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.483121:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.483137:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.483143:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.483148:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.483153:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.483163:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.483169:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.483174:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.483179:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.483184:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.483189:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.483194:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.483199:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.483204:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.483209:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.483214:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.483218:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.483224:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.483229:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.483234:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.483239:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.483244:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.483249:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.483253:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.483270:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.483275:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.483280:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.483285:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.483290:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.483295:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.483306:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.483312:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.483320:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530365.484587:0:8443:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9a9f2b97be00:8443] 1 exiting: rc = 0 00000100:00100000:0.0:1788530365.484978:0:8442:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9a9f3d0cda00:8442] 0 exiting: rc = 1 00000100:00100000:2.0:1788530365.485218:0:8444:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9a9f2b97a400:8444] 2 exiting: rc = 0 00000100:00100000:2.0:1788530365.485283:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.485292:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.485298:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.485305:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.485319:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.485327:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.485334:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.485342:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.485349:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.485355:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.485361:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.485368:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.485374:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.485388:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.485396:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.485402:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.485408:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.485414:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.485420:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.485454:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.485463:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.485469:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.485476:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.485482:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.485488:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.485507:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.485514:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.485519:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.485525:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.485529:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.485535:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.485539:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.485545:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.485550:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.485556:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.485731:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.485740:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.485762:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.485769:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.485774:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.485781:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.485787:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.485794:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.485800:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.485806:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.485813:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.485820:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.485826:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.485833:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.485840:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.485847:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.485855:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.485861:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.485869:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.485876:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.485882:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.485890:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.485896:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.485903:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.485910:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.485924:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.485932:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.485938:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.485953:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788530365.508278:0:8445:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9a9f2b97a000:8445] 0 exiting: rc = 1 00000100:00100000:0.0:1788530365.510683:0:8446:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9a9f33b65600:8446] 1 exiting: rc = 0 00000100:00100000:2.0:1788530365.514358:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.514370:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.514376:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.514381:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.514386:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.514391:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.514397:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.514412:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.514420:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.514425:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.514430:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.514435:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.514441:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.514458:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.514463:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.514469:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.514474:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.514479:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.514485:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.514491:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.514496:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.514501:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.514506:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.514511:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.514516:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.514521:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.514525:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.514530:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.514535:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.514540:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.514545:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.514595:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.514600:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.514605:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.514610:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.514615:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.514621:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.514626:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.514632:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.514637:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.514644:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.514650:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.514656:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.514662:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.514666:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.514671:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.514677:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.514682:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.514688:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.514693:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.514698:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.514703:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.514709:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.514715:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.514721:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.514726:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.514732:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.514738:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.514744:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.514749:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.514755:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.514760:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.514765:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.514771:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788530365.517406:0:8448:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9a9f33e08c00:8448] 1 exiting: rc = 0 00000100:00100000:1.0:1788530365.517691:0:8447:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9a9f33e08000:8447] 0 exiting: rc = 1 00000100:00100000:2.0:1788530365.518533:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.518541:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.518593:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.518620:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.518627:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.518633:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.518639:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.518645:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.518652:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.518657:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.518663:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.518670:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.518676:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.518682:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.518688:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.518706:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.518712:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.518718:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.518724:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.518730:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.518737:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.518743:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.518750:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.518756:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.518761:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.518769:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.518776:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.518798:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.518806:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.518812:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.518819:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.518826:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.518833:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.518839:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.518847:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.518854:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.518861:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.518879:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.518886:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.518907:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.518915:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.518921:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.518927:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.518934:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.518939:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.518946:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.518953:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.518961:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.518967:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.518973:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.518979:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.519000:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.519007:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.519013:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.519019:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.519026:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.519031:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.519038:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.519045:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.519051:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.519058:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.519065:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.519072:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788530365.519089:0:15773:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1788530365.545172:0:15773:0:(tgt_mount.c:2258:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1788530391.685171:0:16538:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg241-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1788530406.241378:0:17138:0:(obd_mount.c:925:lmd_print()) mount data: 00000020:01000004:3.0:1788530406.241385:0:17138:0:(obd_mount.c:928:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1788530406.241387:0:17138:0:(obd_mount.c:931:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1788530406.244074:0:17138:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9a9f202a8800 00000020:01000004:2.0:1788530406.244110:0:17138:0:(tgt_mount.c:2585:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1788530406.244122:0:17138:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788530406.244144:0:17138:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9a9f33d94c98) 00000020:00000080:2.0:1788530406.244165:0:17138:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788530406.339320:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1788530406.346427:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1788530406.353539:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:1.0:1788530406.354260:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1788530406.355623:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1788530406.356595:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:1.0:1788530406.357443:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1788530406.357985:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:1.0:1788530406.358259:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1788530406.358454:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:1.0:1788530406.358917:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:1.0:1788530406.359353:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1788530406.359624:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:1.0:1788530406.359880:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1788530406.366053:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:1.0:1788530406.366930:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1788530406.367147:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:1.0:1788530406.367553:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:0.0:1788530406.371683:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1788530406.372604:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1788530406.373627:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1788530406.374832:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:0.0:1788530406.380442:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1788530406.381389:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:0.0:1788530406.381815:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:0.0:1788530406.382106:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1788530406.382371:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1788530406.383343:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1788530406.383940:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:0.0:1788530406.384319:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1788530406.384625:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1788530406.384835:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1788530406.385047:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:0.0:1788530406.386452:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:0.0:1788530406.393792:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1788530406.395018:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1788530406.396185:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1788530406.396739:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1788530406.397290:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:0.0:1788530406.397770:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:0.0:1788530406.397981:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1788530406.398246:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:0.0:1788530406.398447:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1788530406.401384:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:1.0:1788530406.404347:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1788530406.405231:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1788530406.405641:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:1.0:1788530406.409398:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:2.0:1788530406.412106:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:2.0:1788530406.415586:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:2.0:1788530406.416933:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:2.0:1788530406.417552:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:2.0:1788530406.417897:0:17138:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:01000000:2.0:1788530406.419311:0:17138:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788530406.419552:0:17138:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788530406.419605:0:17138:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788530406.419618:0:17138:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb28d70e12575163f 00000020:01000004:2.0:1788530406.419627:0:17138:0:(tgt_mount.c:2670:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1788530406.419634:0:17138:0:(tgt_mount.c:234:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788530406.419640:0:17138:0:(tgt_mount.c:115:server_register_mount()) register mount ffff9a9f202a8800 from MGS 00000020:01000004:2.0:1788530406.419644:0:17138:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788530406.419657:0:17138:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9a9f33d93310) 00000020:00000080:2.0:1788530406.419670:0:17138:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788530406.420653:0:17138:0:(tgt_mount.c:167:server_get_mount()) get mount ffff9a9f202a8800 from MGS, refs=2 00080000:01000000:3.0:1788530406.420665:0:17138:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788530406.420673:0:17138:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb28d70e12575164d 00000100:00100000:3.0:1788530406.420831:0:17138:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788530406.420991:0:17138:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788530406.421000:0:17138:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1788530406.422339:0:17138:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1788530406.422352:0:17138:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1788530406.423375:0:17138:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788530406.423555:0:17138:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1788530406.424122:0:17138:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788530406.426111:0:17138:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1788530406.426131:0:17138:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1788530406.426910:0:17138:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1788530406.426917:0:17138:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1788530406.428417:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530406.428422:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530406.428424:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530406.428857:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530406.428860:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530406.428861:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530406.429476:0:17138:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1788530406.435711:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1788530406.444775:0:17138:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1788530406.449702:0:17150:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788530406.449850:0:17138:0:(mgs_nids.c:684:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788530406.449910:0:17138:0:(mgs_llog.c:690:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788530406.452442:0:17138:0:(mgs_llog.c:690:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788530406.452855:0:17138:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788530406.454716:0:17138:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788530406.454725:0:17138:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1788530406.474757:0:17138:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1788530406.474781:0:17138:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1788530406.489966:0:17138:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1788530406.489984:0:17138:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1788530406.491118:0:17138:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788530406.491150:0:17138:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.141@tcp' 00000020:01000004:3.0:1788530406.491152:0:17138:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1788530406.491201:0:17138:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.141@tcp (typ=mgc) 00000020:00000080:3.0:1788530406.491217:0:17138:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.141@tcp (ffff9a9e027b8000) 00000020:00000080:3.0:1788530406.491235:0:17138:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1788530406.491323:0:17138:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a9f3d0c4000@MGC192.168.202.141@tcp: add connection 192.168.202.141@tcp at head 00010000:00010000:3.0:1788530406.491477:0:17138:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.141@tcp-0 is initialized 00000040:01000000:3.0:1788530406.491482:0:17138:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.141@tcp ctxt 1 is initialized 00000100:00080000:1.0:1788530406.496456:0:17155:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1788530406.497384:0:17156:0:(mgc_request.c:893:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1788530406.497491:0:17138:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.141@tcp (uuid 516d0d0a-8182-4c2b-8a3c-00c8cd0e9219) 00000020:00000080:2.0:1788530406.497525:0:17138:0:(genops.c:1385:class_connect()) connect: client 516d0d0a-8182-4c2b-8a3c-00c8cd0e9219, cookie 0xb28d70e12575165b 00000100:00080000:2.0:1788530406.497537:0:17138:0:(import.c:545:import_select_connection()) MGC192.168.202.141@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788530406.497545:0:17138:0:(import.c:665:import_select_connection()) MGC192.168.202.141@tcp: import ffff9a9f3d0c4000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:2.0:1788530406.497622:0:17138:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9e03d3c700 x1875409555875200/t0(0) o250->MGC192.168.202.141@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788530406.497660:0:17138:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 516d0d0a-8182-4c2b-8a3c-00c8cd0e9219->MGS 00000020:01000004:2.0:1788530406.497686:0:17138:0:(tgt_mount.c:1882:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1788530406.497692:0:17138:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1788530406.497708:0:17138:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9a9f33d96620) 00000020:00000080:2.0:1788530406.497719:0:17138:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1788530406.502296:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:3646:1875409555875200:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1788530406.502415:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530406.504094:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555875200 00000100:00100000:1.0:1788530406.504114:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555875200 00000100:00100000:1.0:1788530406.504159:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788530406.504169:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3646:x1875409555875200:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1788530406.504197:0:17151:0:(ldlm_lib.c:1458:target_handle_connect()) MGS: connection from 516d0d0a-8182-4c2b-8a3c-00c8cd0e9219@0@lo t0 exp 0000000000000000 cur 614 last 0 00000020:00000080:1.0:1788530406.504228:0:17151:0:(genops.c:1385:class_connect()) connect: client 516d0d0a-8182-4c2b-8a3c-00c8cd0e9219, cookie 0xb28d70e125751669 00000100:00080000:1.0:1788530406.504383:0:17151:0:(import.c:65:import_set_state_nolock()) ffff9a9e0441d000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788530406.504471:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+5:3646:x1875409555875200:12345-0@lo:250:mount.lustre.0 Request processed in 302us (2057us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530406.504480:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788530406.504691:0:3646:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.202.141@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1788530406.504700:0:3646:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.202.141@tcp: connect to target with instance 0 00000100:00080000:3.0:1788530406.504708:0:3646:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.202.141@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788530406.504713:0:3646:0:(mgc_request.c:1469:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788530406.504716:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9f3d0c4000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788530406.504719:0:3646:0:(mgc_request.c:1469:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788530406.504728:0:3646:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788530406.504734:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:3646:1875409555875200:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1788530406.517376:0:17138:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788530406.517698:0:17138:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1788530406.517705:0:17138:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1788530406.521713:0:17138:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1788530406.521730:0:17138:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1788530406.523545:0:17138:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1788530406.523843:0:17138:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1788530406.525990:0:17138:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788530406.526348:0:17138:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1788530406.526428:0:17138:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1788530406.527477:0:17138:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1788530406.527487:0:17138:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1788530406.566863:0:17138:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788530406.567220:0:17138:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1788530406.567228:0:17138:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1788530406.568633:0:17138:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1788530406.568644:0:17138:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1788530406.569280:0:17138:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788530406.569554:0:17138:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788530406.569689:0:17138:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1788530406.570253:0:17138:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788530406.570269:0:17138:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1788530406.570888:0:17138:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788530406.571191:0:17138:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788530406.571197:0:17138:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1788530406.571911:0:17138:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788530406.571918:0:17138:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1788530406.572861:0:17138:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788530406.573176:0:17138:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788530406.573182:0:17138:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1788530406.573818:0:17138:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788530406.573826:0:17138:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1788530406.599292:0:17138:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788530406.599550:0:17138:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788530406.599556:0:17138:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1788530406.601706:0:17138:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788530406.601718:0:17138:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788530406.603306:0:17138:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788530406.603318:0:17138:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1788530406.604788:0:17138:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1788530406.604834:0:17138:0:(tgt_mount.c:1482:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.141@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1788530406.604839:0:17138:0:(tgt_mount.c:1239:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788530406.604841:0:17138:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788530406.604843:0:17138:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788530406.604844:0:17138:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:1.0:1788530406.604845:0:17138:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:1.0:1788530406.604847:0:17138:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:1.0:1788530406.604848:0:17138:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788530406.604850:0:17138:0:(tgt_mount.c:1250:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788530406.604851:0:17138:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788530406.604853:0:17138:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788530406.604857:0:17138:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1788530406.604859:0:17138:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788530406.604864:0:17138:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788530406.604866:0:17138:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788530406.604867:0:17138:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:1.0:1788530406.604868:0:17138:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:1.0:1788530406.604869:0:17138:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:1.0:1788530406.604870:0:17138:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788530406.604871:0:17138:0:(tgt_mount.c:1250:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788530406.604872:0:17138:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788530406.604873:0:17138:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788530406.604904:0:17138:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788530406.604924:0:17138:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37376d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17138:1875409555875328:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788530406.605163:0:17138:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530406.605221:0:17138:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f32ae9f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788530406.606883:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555875328 00000100:00100000:2.0:1788530406.606901:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555875328 00000100:00100000:2.0:1788530406.606965:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788530406.606977:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+5:17138:x1875409555875328:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788530406.607044:0:17154:0:(mgs_llog.c:690:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788530406.607047:0:17154:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788530406.607051:0:17154:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1788530406.607504:0:17174:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1788530406.609466:0:17154:0:(mgs_nids.c:684:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:3.0:1788530406.615523:0:17175:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1788530406.615531:0:17175:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:3.0:1788530406.615535:0:17175:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1788530406.615537:0:17175:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1788530406.616711:0:17175:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:2.0:1788530406.617609:0:17154:0:(mgs_llog.c:690:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788530406.617626:0:17154:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1788530406.621905:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+5:17138:x1875409555875328:12345-0@lo:253:mount.lustre.0 Request processed in 14919us (16732us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530406.621920:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788530406.622054:0:17138:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37376d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17138:1875409555875328:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788530406.622070:0:17138:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788530406.622073:0:17138:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788530406.622075:0:17138:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788530406.622077:0:17138:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788530406.622078:0:17138:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:1.0:1788530406.622079:0:17138:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:1.0:1788530406.622081:0:17138:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:1.0:1788530406.622082:0:17138:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788530406.622084:0:17138:0:(tgt_mount.c:1250:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788530406.622086:0:17138:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788530406.622087:0:17138:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788530406.622113:0:17138:0:(tgt_mount.c:115:server_register_mount()) register mount ffff9a9f202a8800 from lustre-MDT0000 10000000:01000000:1.0:1788530406.622143:0:17138:0:(mgc_request.c:2342:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1788530406.622147:0:17138:0:(mgc_request.c:424:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788530406.622152:0:17138:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9a9f202a8800 10000000:01000000:1.0:1788530406.622158:0:17138:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788530406.622183:0:17138:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-sptlrpc-ffff9a9f202a8800 from 1 10000000:01000000:1.0:1788530406.622187:0:17138:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788530406.622235:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f012ea600/0xb28d70e125751670 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530406.622265:0:17138:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f012ea600/0xb28d70e125751670 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530406.623491:0:17138:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f012ea600/0xb28d70e125751670 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530406.623524:0:17138:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37376d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17138:1875409555875456:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788530406.623614:0:17138:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530406.623671:0:17138:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f32ae9c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788530406.624487:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555875456 00000100:00100000:2.0:1788530406.624499:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555875456 00000100:00100000:2.0:1788530406.624596:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788530406.624609:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+5:17138:x1875409555875456:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788530406.624626:0:17153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530406.624648:0:17153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f3d20ca00/0xb28d70e125751677 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e125751670 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530406.624690:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f3d20ca00/0xb28d70e125751677 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e125751670 expref: 6 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530406.624702:0:17153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f3d20ca00/0xb28d70e125751677 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125751670 expref: 6 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530406.624711:0:17153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d20ca00, rc 0) 00000100:00100000:2.0:1788530406.624781:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+6:17138:x1875409555875456:12345-0@lo:101:mount.lustre.0 Request processed in 174us (1165us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530406.624788:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788530406.625514:0:17138:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37376d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17138:1875409555875456:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788530406.625536:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f012ea600/0xb28d70e125751670 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751677 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530406.625548:0:17138:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f012ea600/0xb28d70e125751670 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e125751677 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530406.625630:0:17138:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17138:1875409555875584:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788530406.625671:0:17138:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530406.625704:0:17138:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f396d53c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788530406.625781:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555875584 00000100:00100000:1.0:1788530406.625787:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555875584 00000100:00100000:1.0:1788530406.625835:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788530406.625843:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+6:17138:x1875409555875584:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788530406.625940:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+6:17138:x1875409555875584:12345-0@lo:501:mount.lustre.0 Request processed in 97us (268us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788530406.625947:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788530406.626097:0:17138:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17138:1875409555875584:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788530406.626112:0:17138:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788530406.626133:0:17138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f012ea600/0xb28d70e125751670 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751677 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530406.626142:0:17138:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f012ea600/0xb28d70e125751670 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751677 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788530406.626153:0:17138:0:(mgc_request.c:206:do_config_log_add()) do adding config log params-ffff9a9f202a8800 10000000:01000000:3.0:1788530406.626160:0:17138:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788530406.626189:0:17138:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-barrier-ffff9a9f202a8800 10000000:01000000:3.0:1788530406.626193:0:17138:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788530406.626209:0:17138:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-barrier-ffff9a9f202a8800 from 1 10000000:01000000:3.0:1788530406.626212:0:17138:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788530406.626244:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36a400/0xb28d70e12575167e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530406.626253:0:17138:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36a400/0xb28d70e12575167e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530406.626264:0:17138:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36a400/0xb28d70e12575167e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530406.626277:0:17138:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17138:1875409555875712:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788530406.626318:0:17138:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530406.626330:0:17138:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f396d53c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788530406.626543:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555875712 00000100:00100000:2.0:1788530406.626548:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555875712 00000100:00100000:2.0:1788530406.626606:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788530406.626613:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+6:17138:x1875409555875712:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788530406.626621:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530406.626633:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f3d20d200/0xb28d70e125751685 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e12575167e expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530406.626651:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f3d20d200/0xb28d70e125751685 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e12575167e expref: 7 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530406.626660:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f3d20d200/0xb28d70e125751685 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e12575167e expref: 7 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530406.626667:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d20d200, rc 0) 00000100:00100000:2.0:1788530406.626706:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+7:17138:x1875409555875712:12345-0@lo:101:mount.lustre.0 Request processed in 94us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530406.626712:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788530406.626998:0:17138:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17138:1875409555875712:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788530406.627021:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36a400/0xb28d70e12575167e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751685 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530406.627035:0:17138:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36a400/0xb28d70e12575167e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e125751685 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788530406.627048:0:17138:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788530406.627060:0:17138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36a400/0xb28d70e12575167e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751685 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530406.627066:0:17138:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36a400/0xb28d70e12575167e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751685 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788530406.627071:0:17138:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788530406.627078:0:17138:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788530406.627114:0:17138:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-mdtir-ffff9a9f202a8800 10000000:01000000:0.0:1788530406.627118:0:17138:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788530406.627133:0:17138:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1788530406.627135:0:17138:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788530406.627158:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d100e00/0xb28d70e12575168c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530406.627165:0:17138:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f3d100e00/0xb28d70e12575168c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530406.627172:0:17138:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f3d100e00/0xb28d70e12575168c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530406.627185:0:17138:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03734e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17138:1875409555875840:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788530406.627215:0:17138:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530406.627244:0:17138:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f2c3bbe40 going to sleep for 11 seconds 00000100:00100000:2.0:1788530406.629398:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555875840 00000100:00100000:2.0:1788530406.629415:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555875840 00000100:00100000:2.0:1788530406.629485:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788530406.629497:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f04d59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+7:17138:x1875409555875840:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788530406.629517:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530406.629543:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f3d20c800/0xb28d70e125751693 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e12575168c expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530406.629629:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f3d20c800/0xb28d70e125751693 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e12575168c expref: 8 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530406.629642:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f3d20c800/0xb28d70e125751693 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e12575168c expref: 8 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530406.629650:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d20c800, rc 0) 00000100:00100000:2.0:1788530406.629733:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f04d59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+8:17138:x1875409555875840:12345-0@lo:101:mount.lustre.0 Request processed in 238us (2517us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530406.629751:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788530406.632342:0:17138:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03734e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17138:1875409555875840:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788530406.632390:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f3d100e00/0xb28d70e12575168c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751693 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530406.632403:0:17138:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f3d100e00/0xb28d70e12575168c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e125751693 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530406.632481:0:17138:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03734e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17138:1875409555875968:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788530406.632556:0:17138:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530406.632625:0:17138:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f2c3bbe40 going to sleep for 11 seconds 00000100:00100000:3.0:1788530406.632850:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555875968 00000100:00100000:3.0:1788530406.632856:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555875968 00000100:00100000:3.0:1788530406.632906:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788530406.632914:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f04d5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+8:17138:x1875409555875968:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788530406.633242:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f04d5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+9:17138:x1875409555875968:12345-0@lo:501:mount.lustre.0 Request processed in 326us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530406.633251:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788530406.633339:0:17138:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03734e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17138:1875409555875968:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788530406.633384:0:17138:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03734e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17138:1875409555876096:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788530406.633424:0:17138:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530406.633452:0:17138:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f2c3bbe40 going to sleep for 11 seconds 00000100:00100000:3.0:1788530406.633555:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555876096 00000100:00100000:3.0:1788530406.633579:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555876096 00000100:00100000:3.0:1788530406.633610:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788530406.633617:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f04d5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+9:17138:x1875409555876096:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788530406.635086:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f04d5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+9:17138:x1875409555876096:12345-0@lo:503:mount.lustre.0 Request processed in 1461us (1652us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530406.635102:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788530406.635221:0:17138:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03734e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17138:1875409555876096:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788530406.635841:0:17176:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03734e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17176:1875409555876224:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788530406.635898:0:17176:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530406.635989:0:17176:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f2c3bb6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788530406.636178:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555876224 00000100:00100000:3.0:1788530406.636188:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555876224 00000100:00100000:3.0:1788530406.636755:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788530406.636767:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03ccd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+9:17176:x1875409555876224:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788530406.637674:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03ccd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+9:17176:x1875409555876224:12345-0@lo:502:llog_process_th.0 Request processed in 906us (1773us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530406.637683:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788530406.637784:0:17176:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03734e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17176:1875409555876224:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788530406.637824:0:17176:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788530406.637836:0:17176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788530406.637839:0:17176:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788530406.637845:0:17176:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1788530406.637848:0:17176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788530406.637863:0:17176:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9a9f3d213310) 00000020:00000080:0.0:1788530406.637878:0:17176:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1788530406.637883:0:17176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788530406.637976:0:17176:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788530406.637983:0:17176:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb28d70e1257516a1 00000020:00000080:0.0:1788530406.638232:0:17176:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788530406.638237:0:17176:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788530406.638241:0:17176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788530406.638243:0:17176:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788530406.638245:0:17176:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788530406.638249:0:17176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788530406.638250:0:17176:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1788530406.638253:0:17176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788530406.638261:0:17176:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9a9f3d210000) 00000020:00000080:0.0:1788530406.638270:0:17176:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1788530406.638273:0:17176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788530406.638275:0:17176:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1788530406.638278:0:17176:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1788530406.638284:0:17176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788530406.638325:0:17176:0:(tgt_mount.c:167:server_get_mount()) get mount ffff9a9f202a8800 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1788530406.638337:0:17176:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9a9f3d211988) 00000020:00000080:0.0:1788530406.638353:0:17176:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1788530406.638409:0:17176:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788530406.638414:0:17176:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb28d70e1257516b6 00000020:00000080:0.0:1788530406.638510:0:17176:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1788530406.638516:0:17176:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788530406.638520:0:17176:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xb28d70e1257516bd 00080000:01000000:0.0:1788530406.638525:0:17176:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788530406.638529:0:17176:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb28d70e1257516c4 00010000:00010000:3.0:1788530406.790321:0:17176:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1788530406.792516:0:17176:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967529 00000001:00080000:3.0:1788530406.794522:0:17176:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788530406.802754:0:17176:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9a9e027b9988) 00000020:00000080:3.0:1788530406.802784:0:17176:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788530406.802892:0:17176:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788530406.802900:0:17176:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb28d70e1257516d2 00000020:00000080:2.0:1788530406.803539:0:17176:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788530406.818113:0:17176:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xb28d70e1257516d9 00000020:00000080:3.0:1788530406.820601:0:17176:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1788530406.820619:0:17176:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788530406.820626:0:17176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788530406.820629:0:17176:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1788530406.820633:0:17176:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788530406.820636:0:17176:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:3.0:1788530406.820638:0:17176:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788530406.820639:0:17176:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788530406.820641:0:17176:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788530406.820643:0:17176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788530406.820645:0:17176:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788530406.820647:0:17176:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788530406.820652:0:17176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788530406.820653:0:17176:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1788530406.820658:0:17176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788530406.820707:0:17176:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788530406.820726:0:17176:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788530406.820729:0:17176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788530406.820730:0:17176:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1788530406.820733:0:17176:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788530406.820747:0:17176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788530406.820748:0:17176:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1788530406.820752:0:17176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788530406.820758:0:17176:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.141@tcp to nid 0x20000c0a8ca8d (192.168.202.141@tcp) 00000020:00000080:3.0:1788530406.820793:0:17176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788530406.820814:0:17176:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9a9e027bb310) 00000020:00000080:3.0:1788530406.820839:0:17176:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1788530406.820845:0:17176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788530406.820926:0:17176:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1788530406.820933:0:17176:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788530406.820940:0:17176:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb28d70e1257516e7 00010000:00080000:3.0:1788530406.820975:0:17176:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a9e0258b800@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.141@tcp at head 00010000:00010000:3.0:1788530406.822633:0:17176:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:2.0:1788530406.825091:0:17176:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788530406.825111:0:17176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1788530406.825155:0:17176:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788530406.825179:0:17176:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb28d70e1257516ee 00000100:00080000:2.0:1788530406.825194:0:17176:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788530406.825200:0:17176:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9a9e0258b800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:2.0:1788530406.825246:0:17176:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9e03d3dc00 x1875409555876352/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788530406.825280:0:17176:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:2.0:1788530406.825352:0:17176:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788530406.825362:0:17176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788530406.825364:0:17176:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1788530406.825368:0:17176:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788530406.825370:0:17176:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:2.0:1788530406.825372:0:17176:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788530406.825373:0:17176:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788530406.825375:0:17176:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788530406.825377:0:17176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788530406.825379:0:17176:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788530406.825381:0:17176:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788530406.825386:0:17176:0:(obd_mount.c:963:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1788530406.825389:0:17176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788530406.825391:0:17176:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788530406.825394:0:17176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788530406.825398:0:17176:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.141@tcp to nid 0x20000c0a8ca8d (192.168.202.141@tcp) 00000020:01000000:2.0:1788530406.825423:0:17176:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788530406.825425:0:17176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788530406.825438:0:17176:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9a9f33d90000) 00000020:00000080:2.0:1788530406.825449:0:17176:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1788530406.825454:0:17176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788530406.825513:0:17176:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788530406.825519:0:17176:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:2.0:1788530406.825526:0:17176:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb28d70e1257516fc 00010000:00080000:2.0:1788530406.825604:0:17176:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a9e024dd000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.141@tcp at head 00010000:00010000:2.0:1788530406.825828:0:17176:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:0.0:1788530406.826677:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875409555876352:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788530406.826778:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530406.826988:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555876352 00000100:00100000:2.0:1788530406.826998:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555876352 00000100:00100000:2.0:1788530406.827077:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788530406.827086:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03734e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1875409555876352:12345-0@lo:38:llog_process_th.0 00010000:00020000:2.0:1788530406.827105:0:17163:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:01000000:0.0:1788530406.833831:0:17176:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788530406.834113:0:17176:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788530406.836118:0:17176:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788530406.838061:0:17176:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1788530406.851978:0:17176:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1788530406.853056:0:17182:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788530406.853063:0:17182:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788530406.853781:0:17176:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788530406.853794:0:17176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788530406.853850:0:17176:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788530406.853877:0:17176:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb28d70e125751703 00000100:00080000:3.0:1788530406.853889:0:17176:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788530406.853897:0:17176:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9a9e024dd000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:3.0:1788530406.853938:0:17176:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9f328e4e00 x1875409555876480/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788530406.853962:0:17176:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788530406.854022:0:17176:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788530406.854027:0:17176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788530406.854029:0:17176:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788530406.854033:0:17176:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788530406.854036:0:17176:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:3.0:1788530406.854038:0:17176:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788530406.854039:0:17176:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788530406.854041:0:17176:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788530406.854044:0:17176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788530406.854045:0:17176:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788530406.854048:0:17176:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788530406.854052:0:17176:0:(obd_mount.c:963:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788530406.854056:0:17176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788530406.854058:0:17176:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788530406.854061:0:17176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788530406.854065:0:17176:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.141@tcp to nid 0x20000c0a8ca8d (192.168.202.141@tcp) 00000020:01000000:3.0:1788530406.854090:0:17176:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788530406.854099:0:17176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788530406.854111:0:17176:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9a9e027bcc98) 00000020:00000080:3.0:1788530406.854124:0:17176:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:3.0:1788530406.854130:0:17176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788530406.854200:0:17176:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788530406.854206:0:17176:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:3.0:1788530406.854212:0:17176:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb28d70e125751711 00010000:00080000:3.0:1788530406.854247:0:17176:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a9f37411800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.141@tcp at head 00010000:00010000:3.0:1788530406.854477:0:17176:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1788530406.854611:0:17176:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788530406.854631:0:17176:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:0.0:1788530406.854937:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875409555876480:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788530406.854994:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875409555876480 offset 0 length 520: 4 00000040:00080000:3.0:1788530406.860111:0:17176:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788530406.861499:0:17176:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1788530406.861831:0:17176:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00100000:3.0:1788530406.866936:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03734e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1875409555876352:12345-0@lo:38:llog_process_th.0 Request processed in 39839us (40147us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788530406.866958:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:00080000:1.0:1788530406.867753:0:17184:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788530406.867759:0:17184:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788530406.868517:0:17176:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788530406.868533:0:17176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788530406.868600:0:17176:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788530406.868624:0:17176:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb28d70e125751718 00000100:00080000:3.0:1788530406.868632:0:17176:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788530406.868632:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9e0258b800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788530406.868638:0:17176:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a9f37411800 using connection 192.168.202.141@tcp/0@lo 00000100:00080000:2.0:1788530406.868643:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788530406.868647:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875409555876352:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788530406.868672:0:17176:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9f328e5880 x1875409555876608/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788530406.868699:0:17176:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788530406.868781:0:17176:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788530406.868785:0:17176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788530406.868786:0:17176:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788530406.868789:0:17176:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788530406.868800:0:17176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788530406.868801:0:17176:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788530406.868805:0:17176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788530406.868807:0:17176:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788530406.868809:0:17176:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788530406.868811:0:17176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788530406.868813:0:17176:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788530406.868815:0:17176:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788530406.868817:0:17176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788530406.868818:0:17176:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788530406.868822:0:17176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788530406.868857:0:17176:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17176:1875409555876736:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788530406.868937:0:17176:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530406.868970:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555876736 00000100:00100000:3.0:1788530406.868976:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555876736 00000100:00100000:3.0:1788530406.869166:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788530406.869177:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03ccd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+9:17176:x1875409555876736:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788530406.869295:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03ccd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+9:17176:x1875409555876736:12345-0@lo:502:llog_process_th.0 Request processed in 119us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530406.869303:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788530406.869351:0:17176:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f2c3bb6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788530406.869366:0:17176:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17176:1875409555876736:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788530406.869386:0:17176:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788530406.869390:0:17176:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788530406.869391:0:17176:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788530406.869395:0:17176:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:3.0:1788530406.869456:0:17138:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:3.0:1788530406.869465:0:17138:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788530406.869481:0:17138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d100e00/0xb28d70e12575168c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751693 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530406.869502:0:17138:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f3d100e00/0xb28d70e12575168c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751693 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788530406.869510:0:17138:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-mdtir-ffff9a9f202a8800 from 1 10000000:01000000:3.0:1788530406.869514:0:17138:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788530406.869541:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36ac00/0xb28d70e12575171f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530406.869548:0:17138:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36ac00/0xb28d70e12575171f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530406.869585:0:17138:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36ac00/0xb28d70e12575171f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530406.869599:0:17138:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17138:1875409555876864:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788530406.869624:0:17138:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530406.869638:0:17138:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e03330f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788530406.869661:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555876864 00000100:00100000:3.0:1788530406.869664:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555876864 00000100:00100000:3.0:1788530406.869685:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788530406.869690:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03ccf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+9:17138:x1875409555876864:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788530406.869698:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788530406.869712:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f3d36b400/0xb28d70e125751726 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e12575171f expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530406.869733:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f3d36b400/0xb28d70e125751726 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e12575171f expref: 10 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530406.869765:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f3d36b400/0xb28d70e125751726 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e12575171f expref: 10 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530406.869773:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d36b400, rc 0) 00000100:00100000:3.0:1788530406.869798:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03ccf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+10:17138:x1875409555876864:12345-0@lo:101:mount.lustre.0 Request processed in 107us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530406.869803:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788530406.869830:0:17138:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17138:1875409555876864:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788530406.869841:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36ac00/0xb28d70e12575171f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751726 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530406.869849:0:17138:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36ac00/0xb28d70e12575171f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e125751726 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530406.870279:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875409555876608:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788530406.870377:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875409555876608 offset 0 length 520: 4 00000100:00100000:3.0:1788530406.871363:0:17138:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17138:1875409555876992:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1788530406.871435:0:17138:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530406.871540:0:17138:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e03330f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788530406.871921:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555876992 00000100:00100000:0.0:1788530406.871932:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555876992 00000100:00100000:0.0:1788530406.872017:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788530406.872037:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03ccfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+10:17138:x1875409555876992:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1788530406.872060:0:17151:0:(mgs_nids.c:1159:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788530406.872066:0:17151:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1788530406.872159:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03ccfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+10:17138:x1875409555876992:12345-0@lo:256:mount.lustre.0 Request processed in 133us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530406.872166:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788530406.872268:0:17138:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17138:1875409555876992:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1788530406.872820:0:17138:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788530406.872839:0:17138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36ac00/0xb28d70e12575171f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751726 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530406.872851:0:17138:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36ac00/0xb28d70e12575171f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751726 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788530406.872885:0:17138:0:(mgc_request.c:2194:mgc_process_log()) Process log params-ffff9a9f202a8800 from 1 10000000:01000000:3.0:1788530406.872890:0:17138:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788530406.872921:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b800/0xb28d70e12575172d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530406.872928:0:17138:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b800/0xb28d70e12575172d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530406.872937:0:17138:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b800/0xb28d70e12575172d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530406.872969:0:17138:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17138:1875409555877120:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788530406.873208:0:17138:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530406.873309:0:17138:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e03330cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788530406.873352:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555877120 00000100:00100000:0.0:1788530406.873359:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555877120 00000100:00100000:0.0:1788530406.873441:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788530406.873450:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03ccf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+10:17138:x1875409555877120:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788530406.873472:0:17151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530406.873494:0:17151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f3d100400/0xb28d70e125751734 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e12575172d expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530406.873523:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f3d100400/0xb28d70e125751734 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e12575172d expref: 11 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530406.873536:0:17151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f3d100400/0xb28d70e125751734 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e12575172d expref: 11 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530406.873547:0:17151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d100400, rc 0) 00000100:00100000:0.0:1788530406.873622:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03ccf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+11:17138:x1875409555877120:12345-0@lo:101:mount.lustre.0 Request processed in 173us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530406.873630:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788530406.873701:0:17138:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17138:1875409555877120:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788530406.873715:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b800/0xb28d70e12575172d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751734 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530406.873724:0:17138:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b800/0xb28d70e12575172d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e125751734 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530406.873778:0:17138:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17138:1875409555877248:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788530406.873803:0:17138:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530406.873913:0:17138:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e03330cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788530406.873986:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555877248 00000100:00100000:1.0:1788530406.873990:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555877248 00000100:00100000:1.0:1788530406.874019:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788530406.874034:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03ccdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+11:17138:x1875409555877248:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788530406.874189:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03ccdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+11:17138:x1875409555877248:12345-0@lo:501:mount.lustre.0 Request processed in 163us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530406.874216:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788530406.874601:0:17138:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17138:1875409555877248:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788530406.874636:0:17138:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17138:1875409555877376:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788530406.874674:0:17138:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530406.874701:0:17138:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e03330cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788530406.874968:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555877376 00000100:00100000:1.0:1788530406.874973:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555877376 00000100:00100000:1.0:1788530406.874996:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788530406.875014:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03cce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+11:17138:x1875409555877376:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788530406.875143:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03cce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+11:17138:x1875409555877376:12345-0@lo:503:mount.lustre.0 Request processed in 130us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530406.875151:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788530406.875295:0:17138:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17138:1875409555877376:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788530406.876165:0:17186:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17186:1875409555877504:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788530406.876219:0:17186:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530406.876289:0:17186:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e03330240 going to sleep for 11 seconds 00000100:00100000:1.0:1788530406.876327:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555877504 00000100:00100000:1.0:1788530406.876332:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555877504 00000100:00100000:1.0:1788530406.876402:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788530406.876411:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03ccf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+11:17186:x1875409555877504:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788530406.876938:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03ccf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+11:17186:x1875409555877504:12345-0@lo:502:llog_process_th.0 Request processed in 527us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530406.876946:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788530406.877049:0:17186:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17186:1875409555877504:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788530406.877080:0:17186:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788530406.877096:0:17186:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788530406.877099:0:17186:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788530406.877105:0:17186:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a9f202a8800 00000020:00000080:3.0:1788530406.877108:0:17186:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788530406.877116:0:17186:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788530406.877119:0:17186:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788530406.877121:0:17186:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788530406.877123:0:17186:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788530406.877126:0:17186:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788530406.877127:0:17186:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788530406.877130:0:17186:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a9f202a8800 00000020:00000080:3.0:1788530406.877133:0:17186:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788530406.877205:0:17186:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788530406.877209:0:17186:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788530406.877211:0:17186:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788530406.877213:0:17186:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788530406.877216:0:17186:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788530406.877217:0:17186:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788530406.877221:0:17186:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a9f202a8800 00000020:00000080:3.0:1788530406.877223:0:17186:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788530406.877243:0:17186:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788530406.877246:0:17186:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788530406.877247:0:17186:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788530406.877250:0:17186:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788530406.877252:0:17186:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788530406.877253:0:17186:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788530406.877256:0:17186:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a9f202a8800 00000020:00000080:3.0:1788530406.877259:0:17186:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788530406.877299:0:17186:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17186:1875409555877632:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788530406.877337:0:17186:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530406.889250:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555877632 00000100:00100000:0.0:1788530406.889268:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555877632 00000100:00100000:0.0:1788530406.889343:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788530406.889352:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03ccd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+11:17186:x1875409555877632:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788530406.889542:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03ccd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+11:17186:x1875409555877632:12345-0@lo:502:llog_process_th.0 Request processed in 190us (12204us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530406.889550:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788530406.898200:0:17186:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e03330240 going to sleep for 11 seconds 00000100:00100000:3.0:1788530406.898254:0:17186:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17186:1875409555877632:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788530406.898316:0:17186:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788530406.898325:0:17186:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788530406.898328:0:17186:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788530406.898333:0:17186:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1788530406.898543:0:17138:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1788530406.898552:0:17138:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788530406.898593:0:17138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b800/0xb28d70e12575172d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751734 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530406.898606:0:17138:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b800/0xb28d70e12575172d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751734 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788530406.898659:0:17138:0:(mgc_request.c:2342:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788530406.898662:0:17138:0:(mgc_request.c:424:config_log_add()) add config log lustre-client-ffff9a9f202a8800 10000000:01000000:1.0:1788530406.898665:0:17138:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-client-ffff9a9f202a8800 10000000:01000000:1.0:1788530406.898671:0:17138:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788530406.898703:0:17138:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-client-ffff9a9f202a8800 from 1 10000000:01000000:1.0:1788530406.898705:0:17138:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788530406.898752:0:17138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f012ea800/0xb28d70e12575173b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530406.898760:0:17138:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f012ea800/0xb28d70e12575173b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530406.898771:0:17138:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f012ea800/0xb28d70e12575173b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530406.898788:0:17138:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37376300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17138:1875409555877760:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788530406.898843:0:17138:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530406.898867:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555877760 00000100:00100000:1.0:1788530406.898870:0:17138:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f17715900 going to sleep for 11 seconds 00000100:00100000:0.0:1788530406.898873:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555877760 00000100:00100000:0.0:1788530406.898919:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788530406.898929:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03cccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+11:17138:x1875409555877760:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788530406.898942:0:17151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530406.898954:0:17151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f3d100c00/0xb28d70e125751742 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e12575173b expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530406.898986:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f3d100c00/0xb28d70e125751742 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e12575173b expref: 12 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530406.898997:0:17151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f3d100c00/0xb28d70e125751742 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e12575173b expref: 12 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530406.900130:0:17151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d100c00, rc 0) 00000100:00100000:0.0:1788530406.900424:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03cccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+12:17138:x1875409555877760:12345-0@lo:101:mount.lustre.0 Request processed in 1492us (1576us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530406.900433:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788530406.902207:0:17138:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37376300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17138:1875409555877760:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788530406.902257:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f012ea800/0xb28d70e12575173b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751742 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530406.902274:0:17138:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f012ea800/0xb28d70e12575173b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e125751742 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530406.902372:0:17138:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17138:1875409555877888:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788530406.902468:0:17138:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530406.902527:0:17138:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e03330240 going to sleep for 11 seconds 00000100:00100000:3.0:1788530406.902557:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555877888 00000100:00100000:3.0:1788530406.902583:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555877888 00000100:00100000:3.0:1788530406.902649:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788530406.902659:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+12:17138:x1875409555877888:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788530406.902832:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+12:17138:x1875409555877888:12345-0@lo:501:mount.lustre.0 Request processed in 173us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530406.902841:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788530406.902894:0:17138:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17138:1875409555877888:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788530406.902926:0:17138:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17138:1875409555878016:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788530406.906720:0:17138:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530406.906783:0:17138:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e03330240 going to sleep for 11 seconds 00000100:00100000:1.0:1788530406.907595:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555878016 00000100:00100000:1.0:1788530406.907606:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555878016 00000100:00100000:1.0:1788530406.907657:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788530406.907667:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+12:17138:x1875409555878016:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788530406.907837:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+12:17138:x1875409555878016:12345-0@lo:503:mount.lustre.0 Request processed in 171us (1123us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530406.907845:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788530406.907988:0:17138:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17138:1875409555878016:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788530406.908395:0:17191:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37377800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17191:1875409555878144:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788530406.908447:0:17191:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530406.908478:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f17715b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788530406.908520:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555878144 00000100:00100000:3.0:1788530406.908525:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555878144 00000100:00100000:3.0:1788530406.908615:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788530406.908625:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+12:17191:x1875409555878144:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788530406.908723:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+12:17191:x1875409555878144:12345-0@lo:502:llog_process_th.0 Request processed in 100us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530406.908731:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788530406.908841:0:17191:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37377800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17191:1875409555878144:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1788530406.908897:0:17191:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1788530406.908915:0:17191:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9a9f2c14cc98) 00000020:00000080:1.0:1788530406.908935:0:17191:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:1.0:1788530406.909046:0:17191:0:(tgt_mount.c:167:server_get_mount()) get mount ffff9a9f202a8800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788530406.909051:0:17191:0:(tgt_mount.c:201:server_put_mount()) put mount ffff9a9f202a8800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788530406.909053:0:17191:0:(obd_mount.c:712:lustre_put_lsi()) put ffff9a9f202a8800 4 00010000:00080000:1.0:1788530406.909084:0:17191:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a9e03636000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.141@tcp at head 00010000:00010000:0.0:1788530406.911021:0:17191:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:0.0:1788530406.911241:0:17191:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1788530406.911282:0:17191:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788530406.911296:0:17191:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xb28d70e125751750 00000100:00080000:0.0:1788530406.911306:0:17191:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788530406.911311:0:17191:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9a9e03636000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:0.0:1788530406.911359:0:17191:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9e03737100 x1875409555878272/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788530406.911382:0:17191:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788530406.913460:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03737100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875409555878272:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788530406.913530:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530406.913663:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555878272 00000100:00100000:2.0:1788530406.913670:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555878272 00000100:00100000:2.0:1788530406.913701:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788530406.913708:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1875409555878272:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788530406.913774:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1875409555878272:12345-0@lo:38:llog_process_th.0 Request processed in 64us (243us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788530406.913781:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788530406.913818:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788530406.913826:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9e03636000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788530406.913830:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788530406.913835:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03737100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875409555878272:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788530406.914987:0:17191:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03735180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17191:1875409555878400:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788530406.915075:0:17191:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530406.915114:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f329c3300 going to sleep for 11 seconds 00000100:00100000:1.0:1788530406.917613:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555878400 00000100:00100000:1.0:1788530406.917625:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555878400 00000100:00100000:1.0:1788530406.917679:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788530406.917689:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+12:17191:x1875409555878400:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788530406.917863:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+12:17191:x1875409555878400:12345-0@lo:502:llog_process_th.0 Request processed in 175us (2787us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530406.917870:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788530406.917879:0:17191:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03735180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17191:1875409555878400:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788530406.917941:0:17191:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03735180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17191:1875409555878528:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788530406.917982:0:17191:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530406.918027:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f329c3300 going to sleep for 11 seconds 00000100:00100000:1.0:1788530406.918169:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555878528 00000100:00100000:1.0:1788530406.918174:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555878528 00000100:00100000:1.0:1788530406.918199:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788530406.918206:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+12:17191:x1875409555878528:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788530406.918272:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+12:17191:x1875409555878528:12345-0@lo:502:llog_process_th.0 Request processed in 65us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530406.918279:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788530406.918433:0:17191:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03735180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17191:1875409555878528:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788530406.918452:0:17191:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1788530406.918865:0:17138:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1788530406.918879:0:17138:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788530406.918894:0:17138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f012ea800/0xb28d70e12575173b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751742 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530406.918906:0:17138:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f012ea800/0xb28d70e12575173b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751742 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788530406.918953:0:17138:0:(tgt_mount.c:1239:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788530406.918956:0:17138:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788530406.918957:0:17138:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788530406.918958:0:17138:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:3.0:1788530406.918959:0:17138:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:3.0:1788530406.918961:0:17138:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:3.0:1788530406.918962:0:17138:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788530406.918964:0:17138:0:(tgt_mount.c:1250:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788530406.918966:0:17138:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788530406.918968:0:17138:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788530406.918971:0:17138:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1788530406.918973:0:17138:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788530406.918975:0:17138:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788530406.918976:0:17138:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788530406.918977:0:17138:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:3.0:1788530406.918978:0:17138:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:3.0:1788530406.918979:0:17138:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:3.0:1788530406.918980:0:17138:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788530406.918985:0:17138:0:(tgt_mount.c:1250:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788530406.918986:0:17138:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788530406.918987:0:17138:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788530406.919004:0:17138:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788530406.919015:0:17138:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17138:1875409555878656:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788530406.919071:0:17138:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530406.919101:0:17138:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e03330240 going to sleep for 11 seconds 00000100:00100000:3.0:1788530406.919137:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555878656 00000100:00100000:3.0:1788530406.919142:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555878656 00000100:00100000:3.0:1788530406.919180:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788530406.919188:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+12:17138:x1875409555878656:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788530406.919209:0:17154:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788530406.919227:0:17154:0:(mgs_nids.c:468:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788530406.924403:0:17154:0:(mgs_nids.c:833:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788530406.924432:0:17154:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1788530406.924748:0:17174:0:(mgs_nids.c:730:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788530406.924756:0:17174:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788530406.924789:0:17174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a9f012eb800/0xb28d70e125751757 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530406.924813:0:17174:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a9f3d36b400/0xb28d70e125751726 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e12575171f expref: 12 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530406.924825:0:17174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a9f012eb800/0xb28d70e125751757 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530406.924899:0:17174:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a9f3d36b400/0xb28d70e125751726 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb28d70e12575171f expref: 12 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530406.924916:0:17174:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a9f3d36b400/0xb28d70e125751726 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb28d70e12575171f expref: 12 pid: 17154 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530406.924934:0:17174:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37377800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17174:1875409555878784:0@lo:104: 00000100:00100000:1.0:1788530406.925050:0:17174:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530406.925100:0:17174:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f17715600 going to sleep for 11 seconds 00000100:00100000:3.0:1788530406.925348:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555878784 00000100:00100000:3.0:1788530406.925359:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555878784 00000100:00100000:3.0:1788530406.925422:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788530406.925436:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37377480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+3:17174:x1875409555878784:12345-0@lo:104: 00010000:00010000:3.0:1788530406.925455:0:17142:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36ac00/0xb28d70e12575171f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e125751726 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530406.925530:0:17142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788530406.925537:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37377480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+3:17174:x1875409555878784:12345-0@lo:104: Request processed in 104us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530406.925544:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788530406.925634:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+12:17138:x1875409555878656:12345-0@lo:253:mount.lustre.0 Request processed in 6446us (6561us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530406.925642:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788530406.925702:0:17138:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17138:1875409555878656:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788530406.925721:0:17138:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788530406.925724:0:17138:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788530406.925726:0:17138:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788530406.925727:0:17138:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788530406.925728:0:17138:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:3.0:1788530406.925730:0:17138:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:3.0:1788530406.925731:0:17138:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:3.0:1788530406.925732:0:17138:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788530406.925734:0:17138:0:(tgt_mount.c:1250:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788530406.925745:0:17138:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788530406.925746:0:17138:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788530406.925761:0:17138:0:(tgt_mount.c:2823:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1788530406.927232:0:17174:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37377800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17174:1875409555878784:0@lo:104: 00010000:00010000:1.0:1788530406.927262:0:17174:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a9f012eb800/0xb28d70e125751757 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530406.927679:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788530406.927686:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36ac00/0xb28d70e12575171f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e125751726 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530406.927695:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d36ac00 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:1.0:1788530406.927699:0:17148:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36ac00/0xb28d70e12575171f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb28d70e125751726 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530406.927709:0:17148:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36ac00/0xb28d70e12575171f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb28d70e125751726 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788530406.927716:0:17148:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36ac00/0xb28d70e12575171f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb28d70e125751726 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788530406.927722:0:17148:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788530406.927800:0:17148:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36ac00/0xb28d70e12575171f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125751726 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530406.927807:0:17148:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788530406.927828:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36ac00/0xb28d70e12575171f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125751726 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530406.927835:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36ac00/0xb28d70e12575171f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125751726 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530406.927850:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530406.927852:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530406.927854:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788530406.927939:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37377800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:3648:1875409555878912:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788530406.927993:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530406.933229:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555878912 00000100:00100000:1.0:1788530406.933249:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555878912 00010000:00010000:1.0:1788530406.933296:0:17144:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a9f3d36b400/0xb28d70e125751726 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e12575171f expref: 12 pid: 17154 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530406.933347:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788530406.933359:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d3c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+12:3648:x1875409555878912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788530406.933376:0:17144:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788530406.933384:0:17144:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a9f3d36b400/0xb28d70e125751726 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e12575171f expref: 12 pid: 17154 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530406.933397:0:17144:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a9f3d36b400/0xb28d70e125751726 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb28d70e12575171f expref: 12 pid: 17154 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530406.933418:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f3d36b400/0xb28d70e125751726 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb28d70e12575171f expref: 12 pid: 17154 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530406.933439:0:17144:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a9f012eb800/0xb28d70e125751757 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530406.933458:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f012eb800/0xb28d70e125751757 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788530406.933481:0:17144:0:(mgs_nids.c:706:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008727116s 00010000:00010000:1.0:1788530406.933486:0:17144:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a9f012eb800/0xb28d70e125751757 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530406.933494:0:17144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a9f012eb800/0xb28d70e125751757 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530406.933501:0:17144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a9f012eb800/0xb28d70e125751757 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530406.933509:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a9f012eb800/0xb28d70e125751757 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530406.933516:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f012eb800 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:1.0:1788530406.933521:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a9f012eb800/0xb28d70e125751757 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530406.933529:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a9f012eb800/0xb28d70e125751757 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530406.933543:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a9f012eb800/0xb28d70e125751757 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530406.933552:0:17144:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788530406.933657:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d3c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+11:3648:x1875409555878912:12345-0@lo:103:ldlm_bl.0 Request processed in 300us (5663us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530406.933664:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1788530406.933692:0:17174:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a9f012eb800/0xb28d70e125751757 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530406.933700:0:17174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a9f012eb800/0xb28d70e125751757 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530406.933706:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f012eb800/0xb28d70e125751757 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530406.933881:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37377800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:3648:1875409555878912:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1788530406.943225:0:17138:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:3.0:1788530406.944212:0:17138:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1788530406.944410:0:17198:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:1.0:1788530406.944415:0:17198:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:1.0:1788530406.944715:0:17199:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788530406.945101:0:17138:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:1.0:1788530406.945317:0:17199:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:2.0:1788530406.948757:0:17138:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1788530406.948827:0:17138:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:3.0:1788530406.949243:0:17200:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9a9f328e6d80 x1875409555879040/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530406.949259:0:17200:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f09258000 going to sleep for 0 seconds 00000004:00000080:2.0:1788530406.950366:0:17138:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788530406.950387:0:17138:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1788530406.951656:0:17138:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788530406.954337:0:17199:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788530406.954447:0:17199:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:2.0:1788530406.957414:0:17138:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788530406.960206:0:17138:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788530406.960274:0:17138:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:0.0:1788530406.962306:0:17138:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:0.0:1788530406.969711:0:17138:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:0.0:1788530406.980284:0:17138:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788530406.980325:0:17138:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb3780148f9b8 00100000:10000000:0.0:1788530406.980333:0:17138:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1788530406.981489:0:17138:0:(tgt_mount.c:2543:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1788530406.981508:0:17138:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1788530406.986505:0:17138:0:(tgt_mount.c:2429:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788530406.986789:0:17138:0:(tgt_mount.c:2444:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788530407.490474:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788530407.946446:0:17192:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788530408.000673:0:17200:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f09258000 going to sleep for 0 seconds 10000000:01000000:2.0:1788530408.384661:0:17156:0:(mgc_request.c:715:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788530408.384670:0:17156:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-mdtir-ffff9a9f202a8800 from 7 10000000:01000000:2.0:1788530408.384675:0:17156:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788530408.384737:0:17156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d20de00/0xb28d70e12575175e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530408.384749:0:17156:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f3d20de00/0xb28d70e12575175e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530408.384761:0:17156:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f3d20de00/0xb28d70e12575175e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530408.384788:0:17156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d3c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17156:1875409555879168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788530408.384860:0:17156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530408.384936:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f10041e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788530408.387830:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555879168 00000100:00100000:3.0:1788530408.387851:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555879168 00000100:00100000:3.0:1788530408.387933:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788530408.387959:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+11:17156:x1875409555879168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788530408.387978:0:17153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788530408.388004:0:17153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f3d36b400/0xb28d70e125751765 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e12575175e expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530408.388035:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f3d36b400/0xb28d70e125751765 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e12575175e expref: 12 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530408.388049:0:17153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f3d36b400/0xb28d70e125751765 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e12575175e expref: 12 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530408.388084:0:17153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d36b400, rc 0) 00000100:00100000:3.0:1788530408.388191:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+12:17156:x1875409555879168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 248us (3332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530408.388198:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788530408.389315:0:17156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d3c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17156:1875409555879168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788530408.389342:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f3d20de00/0xb28d70e12575175e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751765 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530408.389355:0:17156:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f3d20de00/0xb28d70e12575175e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e125751765 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530408.389451:0:17156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d3c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17156:1875409555879296:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788530408.389513:0:17156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530408.389576:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f10041e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788530408.389613:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555879296 00000100:00100000:3.0:1788530408.389620:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555879296 00000100:00100000:3.0:1788530408.389667:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788530408.389677:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+12:17156:x1875409555879296:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788530408.389694:0:17154:0:(mgs_nids.c:1159:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788530408.389711:0:17154:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788530408.389715:0:17154:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1788530408.389807:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+12:17156:x1875409555879296:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 131us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530408.389815:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788530408.389849:0:17156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d3c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17156:1875409555879296:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788530408.389895:0:17156:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788530408.389902:0:17156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d20de00/0xb28d70e12575175e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751765 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530408.389911:0:17156:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f3d20de00/0xb28d70e12575175e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751765 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530408.512878:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788530408.961356:0:17192:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788530409.025346:0:17200:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f09258000 going to sleep for 0 seconds 00010000:00010000:0.0:1788530409.536863:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788530410.048656:0:17200:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f09258000 going to sleep for 0 seconds 00010000:00010000:2.0:1788530410.563183:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788530411.074597:0:17200:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f09258000 going to sleep for 0 seconds 00010000:00010000:0.0:1788530411.585127:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788530412.099893:0:17200:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f09258000 going to sleep for 0 seconds 00000100:00080000:0.0:1788530412.100095:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788530412.100101:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788530412.100105:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a9e0258b800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788530412.100115:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 614 00000100:00080000:0.0:1788530412.100128:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788530412.100135:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9a9e0258b800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:0.0:1788530412.100238:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9e03736d80 x1875409555879552/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788530412.100278:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788530412.100282:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788530412.100285:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788530412.100288:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788530412.100291:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788530412.100295:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788530412.100296:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a9e03636000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788530412.100302:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9a9e03636000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:0.0:1788530412.100315:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9e03735f80 x1875409555879680/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788530412.100372:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03735180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:3649:1875409555879424:0@lo:400:kworker.0 00000100:00100000:0.0:1788530412.100442:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530412.100525:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03736d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875409555879552:0@lo:38:kworker.0 00000100:00100000:0.0:1788530412.100554:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530412.100604:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03735f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875409555879680:0@lo:38:kworker.0 00000100:00100000:0.0:1788530412.102353:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530412.102451:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555879424 00000100:00100000:0.0:1788530412.102463:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555879424 00000100:00100000:0.0:1788530412.102525:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788530412.102537:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+12:3649:x1875409555879424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530412.103128:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555879680 00000100:00100000:2.0:1788530412.103136:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555879680 00000100:00100000:2.0:1788530412.103177:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788530412.103184:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03736680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1875409555879680:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788530412.103216:0:17160:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 620 last 0 00000020:00000080:2.0:1788530412.103259:0:17160:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xb28d70e12575176c 00000004:00100000:2.0:1788530412.103277:0:17160:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788530412.103438:0:17160:0:(import.c:65:import_set_state_nolock()) ffff9a9f0aaef000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788530412.103506:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03736680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875409555879680:12345-0@lo:38:kworker.0 Request processed in 322us (1163us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530412.103514:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788530412.103598:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a9e03735f80 x1875409555879680/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788530422 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530412.104752:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+12:3649:x1875409555879424:12345-0@lo:400:kworker.0 Request processed in 2213us (4304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530412.104764:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788530412.104857:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555879552 00000100:00100000:0.0:1788530412.104865:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555879552 00000100:00100000:0.0:1788530412.104889:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788530412.104895:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03734700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1875409555879552:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788530412.104913:0:17164:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:2.0:1788530412.105057:0:3646:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788530412.105068:0:3646:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788530412.105073:0:3646:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788530412.105077:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9e03636000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788530412.105085:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03735f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875409555879680:0@lo:38:kworker.0 00000100:00100000:2.0:1788530412.105327:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03735180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:3649:1875409555879424:0@lo:400:kworker.0 00000100:00100000:1.0:1788530412.134891:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03734700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1875409555879552:12345-0@lo:38:kworker.0 Request processed in 29979us (34320us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788530412.134916:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1788530412.138786:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9e0258b800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788530412.138801:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788530412.138818:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03736d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875409555879552:0@lo:38:kworker.0 00010000:00010000:2.0:1788530412.609679:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788530413.125051:0:17200:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f09258000 going to sleep for 0 seconds 00010000:00010000:1.0:1788530413.633079:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788530414.158835:0:17200:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f09258000 going to sleep for 0 seconds 00000001:02000400:0.0:1788530414.457917:0:17443:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg241-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788530414.659844:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788530415.168652:0:17200:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f09258000 going to sleep for 0 seconds 00010000:00010000:1.0:1788530415.692962:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788530415.698185:0:17495:0:(tgt_mount.c:2429:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788530415.698379:0:17495:0:(tgt_mount.c:2444:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788530416.195431:0:17200:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f09258000 going to sleep for 0 seconds 00000100:00100000:2.0:1788530416.200087:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788530406/real 1788530406] req@ffff9a9f328e5880 x1875409555876608/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788530416 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530416.200116:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a9f328e5880 x1875409555876608/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788530416 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530416.200126:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788530406/real 1788530406] req@ffff9a9f328e4e00 x1875409555876480/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788530416 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530416.200138:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a9f328e4e00 x1875409555876480/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788530416 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788530416.200158:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9f37411800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788530416.200181:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788530416.200185:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875409555876608:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788530416.200191:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9e024dd000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788530416.200206:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788530416.200208:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875409555876480:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788530416.200233:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788530416.200238:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788530416.200241:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a9e0258b800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788530416.200245:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 620 00000100:00080000:0.0:1788530416.200312:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788530416.200322:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9a9e0258b800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:0.0:1788530416.200348:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9e03735880 x1875409555879936/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788530416.200369:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788530416.200373:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788530416.200375:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a9e024dd000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788530416.200378:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 614 00000100:00080000:0.0:1788530416.200380:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788530416.200384:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9a9e024dd000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:2.0:1788530416.200394:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03735880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875409555879936:0@lo:38:kworker.0 00000100:00100000:0.0:1788530416.200396:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9e03735180 x1875409555880064/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788530416.200415:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788530416.200417:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788530416.200419:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a9f37411800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788530416.200421:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 614 00000100:00080000:0.0:1788530416.200424:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788530416.200427:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a9f37411800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:0.0:1788530416.200436:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9e03735f80 x1875409555880192/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788530416.200477:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03736d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:3650:1875409555879808:0@lo:400:kworker.0 00000100:00100000:0.0:1788530416.200518:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530416.205388:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530416.205460:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555879936 00000100:00100000:3.0:1788530416.205471:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555879936 00000100:00100000:2.0:1788530416.205484:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03735180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875409555880064:0@lo:8:kworker.0 00000100:00100000:3.0:1788530416.205517:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788530416.205544:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1875409555879936:12345-0@lo:38:kworker.0 00000400:00000100:2.0:1788530416.205548:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875409555880064 offset 0 length 520: 4 00000100:00100000:2.0:1788530416.205584:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03735f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875409555880192:0@lo:8:kworker.0 00010000:00020000:3.0:1788530416.205585:0:17163:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000400:00000100:2.0:1788530416.205601:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875409555880192 offset 0 length 520: 4 00000100:00100000:0.0:1788530416.211818:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03737100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875409555880320:0@lo:400:kworker.0 00000100:00100000:0.0:1788530416.211910:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530416.211980:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555879808 00000100:00100000:0.0:1788530416.211991:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555879808 00000100:00100000:0.0:1788530416.212052:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788530416.212063:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+12:3650:x1875409555879808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530416.212081:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555880320 00000100:00100000:2.0:1788530416.212085:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555880320 00000100:00100000:2.0:1788530416.212116:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788530416.212123:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03735500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875409555880320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530416.212127:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+12:3650:x1875409555879808:12345-0@lo:400:kworker.0 Request processed in 65us (11613us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530416.212134:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788530416.212161:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03735500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875409555880320:12345-0@lo:400:kworker.0 Request processed in 40us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530416.212168:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788530416.212188:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a9e03737100 x1875409555880320/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530432 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530416.212204:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03737100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875409555880320:0@lo:400:kworker.0 00000100:00100000:0.0:1788530416.212241:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03736d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:3650:1875409555879808:0@lo:400:kworker.0 00000100:00100000:3.0:1788530416.220913:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1875409555879936:12345-0@lo:38:kworker.0 Request processed in 15361us (15526us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788530416.220928:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1788530416.221106:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9e0258b800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788530416.221113:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788530416.221117:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03735880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875409555879936:0@lo:38:kworker.0 00010000:00010000:2.0:1788530416.704983:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788530416.793513:0:17545:0:(tgt_mount.c:2429:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788530416.793725:0:17545:0:(tgt_mount.c:2444:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788530417.216803:0:17200:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f09258000 going to sleep for 0 seconds 00010000:00010000:1.0:1788530417.740141:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788530418.178287:0:17192:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788530418.241042:0:17200:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f09258000 going to sleep for 0 seconds 00010000:00010000:2.0:1788530418.752726:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788530419.267554:0:17200:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f09258000 going to sleep for 0 seconds 00010000:00010000:0.0:1788530419.779110:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788530420.288636:0:17200:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f09258000 going to sleep for 0 seconds 00010000:00010000:2.0:1788530420.801067:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788530421.312857:0:476:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788530421.312864:0:476:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788530421.312868:0:476:0:(import.c:65:import_set_state_nolock()) ffff9a9e0258b800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788530421.312876:0:476:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 624 00000100:00080000:3.0:1788530421.312883:0:476:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788530421.312891:0:476:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9a9e0258b800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:3.0:1788530421.312919:0:476:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9f328e4a80 x1875409555880576/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788530421.312941:0:476:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788530421.312945:0:476:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788530421.312948:0:476:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788530421.312951:0:476:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788530421.313027:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875409555880704:0@lo:400:kworker.0 00000100:00100000:0.0:1788530421.313027:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:3648:1875409555880448:0@lo:400:kworker.0 00000100:00100000:2.0:1788530421.316894:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530421.316997:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555880704 00000100:00100000:2.0:1788530421.317008:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555880704 00000100:00100000:2.0:1788530421.317054:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788530421.317068:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875409555880704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530421.317151:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875409555880704:12345-0@lo:400:kworker.0 Request processed in 87us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530421.317525:0:17200:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f09258000 going to sleep for 0 seconds 00000100:00100000:3.0:1788530421.317773:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875409555880576:0@lo:38:kworker.0 00000100:00100000:3.0:1788530421.317830:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530421.317956:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788530421.317988:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555880576 00000100:00100000:2.0:1788530421.317994:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555880576 00000100:00100000:2.0:1788530421.318062:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788530421.318069:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f328e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1875409555880576:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788530421.318088:0:17164:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788530421.320283:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530421.320803:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555880448 00000100:00100000:0.0:1788530421.320814:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555880448 00000100:00100000:0.0:1788530421.320867:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788530421.320877:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+12:3648:x1875409555880448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530421.320943:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+12:3648:x1875409555880448:12345-0@lo:400:kworker.0 Request processed in 67us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530421.320950:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788530421.321694:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:3648:1875409555880448:0@lo:400:kworker.0 00010000:00080000:3.0:1788530421.340356:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a9f328e7b80 x1875409555880704/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530437 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530421.340394:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875409555880704:0@lo:400:kworker.0 00000100:00100000:2.0:1788530421.346536:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f328e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1875409555880576:12345-0@lo:38:kworker.0 Request processed in 28451us (28690us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788530421.346553:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1788530421.347768:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9e0258b800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788530421.347778:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788530421.347783:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875409555880576:0@lo:38:kworker.0 00010000:00010000:0.0:1788530421.828409:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788530422.340678:0:17200:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f09258000 going to sleep for 0 seconds 00010000:00010000:2.0:1788530422.848805:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788530423.365519:0:17200:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f09258000 going to sleep for 0 seconds 00010000:00010000:0.0:1788530423.873137:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788530424.384631:0:17200:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f09258000 going to sleep for 0 seconds 00010000:00010000:2.0:1788530424.900556:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788530424.998229:0:17890:0:(obd_mount.c:925:lmd_print()) mount data: 00000020:01000004:1.0:1788530424.998233:0:17890:0:(obd_mount.c:928:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:1.0:1788530424.998234:0:17890:0:(obd_mount.c:931:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1788530424.998422:0:17890:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9a9e03637800 00000020:01000004:1.0:1788530424.998446:0:17890:0:(tgt_mount.c:2585:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:1.0:1788530424.998458:0:17890:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788530424.998474:0:17890:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff9a9f2c149988) 00000020:00000080:1.0:1788530424.998491:0:17890:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1788530425.080262:0:17890:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1788530425.082608:0:17890:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:1.0:1788530425.085448:0:17890:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1788530425.086025:0:17890:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:1.0:1788530425.086379:0:17890:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:1.0:1788530425.086715:0:17890:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1788530425.087124:0:17890:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:1.0:1788530425.087319:0:17890:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1788530425.088253:0:17890:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1788530425.088449:0:17890:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1788530425.088731:0:17890:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1788530425.089397:0:17890:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1788530425.089722:0:17890:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:1.0:1788530425.090035:0:17890:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:1.0:1788530425.090316:0:17890:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1788530425.090473:0:17890:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1788530425.090797:0:17890:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:1.0:1788530425.091168:0:17890:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1788530425.091424:0:17890:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:1.0:1788530425.091667:0:17890:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1788530425.091974:0:17890:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1788530425.092187:0:17890:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1788530425.092391:0:17890:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1788530425.092541:0:17890:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:1.0:1788530425.093155:0:17890:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:1.0:1788530425.093399:0:17890:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1788530425.093746:0:17890:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1788530425.094191:0:17890:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1788530425.094405:0:17890:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1788530425.094756:0:17890:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1788530425.095216:0:17890:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:1.0:1788530425.095440:0:17890:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:1.0:1788530425.095720:0:17890:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1788530425.096022:0:17890:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:1.0:1788530425.098033:0:17890:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:2.0:1788530425.098828:0:17890:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788530425.099671:0:17890:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788530425.099981:0:17890:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1788530425.101270:0:17890:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1788530425.101525:0:17890:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1788530425.102173:0:17890:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:2.0:1788530425.103390:0:17890:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1788530425.104411:0:17890:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1788530425.106216:0:17890:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1788530425.107239:0:17890:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:2.0:1788530425.107535:0:17890:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:01000000:2.0:1788530425.108518:0:17890:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788530425.108810:0:17890:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1788530425.108823:0:17890:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788530425.110158:0:17890:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb28d70e12575177a 00000020:01000004:2.0:1788530425.110176:0:17890:0:(tgt_mount.c:2670:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1788530425.110318:0:17890:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.141@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788530425.110323:0:17890:0:(mgc_request.c:1372:mgc_set_info_async()) InitRecov MGC192.168.202.141@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788530425.110331:0:17890:0:(tgt_mount.c:1882:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1788530425.110377:0:17890:0:(tgt_mount.c:1482:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.202.141@tcp, index=0001, flags=0x20001 00000020:01000004:3.0:1788530425.110381:0:17890:0:(tgt_mount.c:1239:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788530425.110383:0:17890:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788530425.110384:0:17890:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788530425.110385:0:17890:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:3.0:1788530425.110386:0:17890:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:3.0:1788530425.110388:0:17890:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:3.0:1788530425.110389:0:17890:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788530425.110391:0:17890:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788530425.110392:0:17890:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788530425.110396:0:17890:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:3.0:1788530425.110398:0:17890:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788530425.110399:0:17890:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788530425.110400:0:17890:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788530425.110401:0:17890:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:3.0:1788530425.110402:0:17890:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:3.0:1788530425.110403:0:17890:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:3.0:1788530425.110404:0:17890:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788530425.110405:0:17890:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788530425.110406:0:17890:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788530425.110434:0:17890:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1788530425.111203:0:17890:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17890:1875409555880832:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788530425.111323:0:17890:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530425.111397:0:17890:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f06a06780 going to sleep for 11 seconds 00000100:00100000:0.0:1788530425.111497:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555880832 00000100:00100000:0.0:1788530425.111505:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555880832 00000100:00100000:0.0:1788530425.111600:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788530425.111612:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+12:17890:x1875409555880832:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788530425.111643:0:17154:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788530425.111647:0:17154:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:0.0:1788530425.111655:0:17154:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1788530425.112409:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+12:17890:x1875409555880832:12345-0@lo:253:mount.lustre.0 Request processed in 794us (1081us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530425.112436:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788530425.112550:0:17890:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17890:1875409555880832:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788530425.112599:0:17890:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1788530425.112613:0:17890:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788530425.112614:0:17890:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788530425.112622:0:17890:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788530425.112623:0:17890:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:3.0:1788530425.112624:0:17890:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:3.0:1788530425.112626:0:17890:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:3.0:1788530425.112627:0:17890:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788530425.112629:0:17890:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788530425.112630:0:17890:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788530425.112649:0:17890:0:(tgt_mount.c:115:server_register_mount()) register mount ffff9a9e03637800 from lustre-MDT0001 10000000:01000000:3.0:1788530425.112677:0:17890:0:(mgc_request.c:2342:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:3.0:1788530425.112680:0:17890:0:(mgc_request.c:424:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1788530425.112685:0:17890:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9a9e03637800 10000000:01000000:3.0:1788530425.112692:0:17890:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788530425.112710:0:17890:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.202.141@tcp: setup lustre-MDT0001-osd 00000040:01000000:3.0:1788530425.116321:0:17890:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.141@tcp ctxt 1 is initialized 00000040:01000000:3.0:1788530425.122322:0:17890:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.141@tcp ctxt 0 is initialized 10000000:01000000:3.0:1788530425.122343:0:17890:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-sptlrpc-ffff9a9e03637800 from 1 10000000:01000000:3.0:1788530425.122348:0:17890:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788530425.122389:0:17890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36be00/0xb28d70e125751781 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530425.122401:0:17890:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36be00/0xb28d70e125751781 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530425.122414:0:17890:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36be00/0xb28d70e125751781 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530425.122441:0:17890:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17890:1875409555880960:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788530425.122516:0:17890:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530425.122662:0:17890:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f32b9f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788530425.122723:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555880960 00000100:00100000:0.0:1788530425.122732:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555880960 00000100:00100000:0.0:1788530425.122789:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788530425.122800:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f22280450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+12:17890:x1875409555880960:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788530425.122815:0:17153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530425.122840:0:17153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f3d101400/0xb28d70e125751788 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e125751781 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530425.122866:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f3d101400/0xb28d70e125751788 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e125751781 expref: 13 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530425.122878:0:17153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f3d101400/0xb28d70e125751788 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125751781 expref: 13 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530425.122898:0:17153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d101400, rc 0) 00000100:00100000:0.0:1788530425.122948:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f22280450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+13:17890:x1875409555880960:12345-0@lo:101:mount.lustre.0 Request processed in 149us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530425.122954:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788530425.123231:0:17890:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17890:1875409555880960:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788530425.123247:0:17890:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36be00/0xb28d70e125751781 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751788 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530425.123273:0:17890:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36be00/0xb28d70e125751781 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e125751788 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530425.123349:0:17890:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17890:1875409555881088:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788530425.123375:0:17890:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530425.123400:0:17890:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f32b9f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788530425.123512:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555881088 00000100:00100000:2.0:1788530425.123517:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555881088 00000100:00100000:2.0:1788530425.123554:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788530425.123595:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f051ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+13:17890:x1875409555881088:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788530425.123810:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f051ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+13:17890:x1875409555881088:12345-0@lo:501:mount.lustre.0 Request processed in 248us (433us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788530425.123838:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788530425.125730:0:17890:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17890:1875409555881088:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788530425.125756:0:17890:0:(mgc_request_server.c:748:mgc_llog_local_copy()) MGC192.168.202.141@tcp: no remote llog for lustre-sptlrpc, check MGS config 00000100:00100000:1.0:1788530425.126170:0:17890:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37377800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17890:1875409555881216:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788530425.126229:0:17890:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530425.126311:0:17890:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f09214780 going to sleep for 11 seconds 00000100:00100000:3.0:1788530425.130196:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555881216 00000100:00100000:3.0:1788530425.130215:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555881216 00000100:00100000:3.0:1788530425.130323:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788530425.130334:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f051adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+13:17890:x1875409555881216:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788530425.130488:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f051adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+13:17890:x1875409555881216:12345-0@lo:501:mount.lustre.0 Request processed in 156us (4259us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788530425.130495:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788530425.130619:0:17890:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37377800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17890:1875409555881216:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788530425.130651:0:17890:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788530425.130675:0:17890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36be00/0xb28d70e125751781 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751788 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530425.130701:0:17890:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36be00/0xb28d70e125751781 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751788 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788530425.130710:0:17890:0:(mgc_request.c:206:do_config_log_add()) do adding config log params-ffff9a9e03637800 10000000:01000000:1.0:1788530425.130715:0:17890:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788530425.130752:0:17890:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.202.141@tcp: setup lustre-MDT0001-osd 00000040:01000000:1.0:1788530425.130842:0:17890:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.141@tcp ctxt 1 is initialized 00000040:01000000:1.0:1788530425.130848:0:17890:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.141@tcp ctxt 0 is initialized 10000000:01000000:1.0:1788530425.130854:0:17890:0:(mgc_request.c:206:do_config_log_add()) do adding config log nodemap-ffff9a9e027b8000 10000000:01000000:1.0:1788530425.130856:0:17890:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1788530425.130868:0:17890:0:(mgc_request.c:2194:mgc_process_log()) Process log nodemap-ffff9a9e027b8000 from 1 10000000:01000000:1.0:1788530425.130870:0:17890:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788530425.130905:0:17890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f012ea400/0xb28d70e12575178f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530425.130911:0:17890:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f012ea400/0xb28d70e12575178f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530425.130918:0:17890:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f012ea400/0xb28d70e12575178f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530425.130934:0:17890:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37377800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17890:1875409555881344:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788530425.130965:0:17890:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530425.136957:0:17890:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f09214180 going to sleep for 11 seconds 00000100:00100000:2.0:1788530425.137281:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555881344 00000100:00100000:2.0:1788530425.137293:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555881344 00000100:00100000:2.0:1788530425.137351:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788530425.137361:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f051af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+13:17890:x1875409555881344:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788530425.137379:0:17151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530425.137399:0:17151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f3d20c000/0xb28d70e125751796 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e12575178f expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530425.137426:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f3d20c000/0xb28d70e125751796 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e12575178f expref: 14 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530425.137437:0:17151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f3d20c000/0xb28d70e125751796 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e12575178f expref: 14 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530425.137445:0:17151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d20c000, rc 0) 00000100:00100000:2.0:1788530425.137615:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f051af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+14:17890:x1875409555881344:12345-0@lo:101:mount.lustre.0 Request processed in 255us (6647us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530425.137623:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788530425.140093:0:17890:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37377800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17890:1875409555881344:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788530425.140141:0:17890:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f012ea400/0xb28d70e12575178f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751796 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530425.140182:0:17890:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f012ea400/0xb28d70e12575178f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e125751796 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788530425.140214:0:17890:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788530425.140293:0:17890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f012ea400/0xb28d70e12575178f lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751796 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530425.140301:0:17890:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f012ea400/0xb28d70e12575178f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751796 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788530425.140317:0:17890:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-barrier-ffff9a9e03637800 10000000:01000000:1.0:1788530425.140325:0:17890:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788530425.140395:0:17890:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-barrier-ffff9a9e03637800 from 1 10000000:01000000:1.0:1788530425.140398:0:17890:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788530425.140450:0:17890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f012eb200/0xb28d70e12575179d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530425.140459:0:17890:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f012eb200/0xb28d70e12575179d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530425.140473:0:17890:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f012eb200/0xb28d70e12575179d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530425.140502:0:17890:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37377800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17890:1875409555881472:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788530425.140625:0:17890:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530425.140672:0:17890:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f09214180 going to sleep for 11 seconds 00000100:00100000:2.0:1788530425.140815:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555881472 00000100:00100000:2.0:1788530425.140822:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555881472 00000100:00100000:2.0:1788530425.140894:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788530425.140904:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f051ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+14:17890:x1875409555881472:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788530425.140918:0:17151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530425.140932:0:17151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f3d20dc00/0xb28d70e1257517a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e12575179d expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530425.140955:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f3d20dc00/0xb28d70e1257517a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e12575179d expref: 15 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530425.140974:0:17151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f3d20dc00/0xb28d70e1257517a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e12575179d expref: 15 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530425.140984:0:17151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d20dc00, rc 0) 00000100:00100000:2.0:1788530425.141024:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f051ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+15:17890:x1875409555881472:12345-0@lo:101:mount.lustre.0 Request processed in 121us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530425.141031:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788530425.141316:0:17890:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37377800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17890:1875409555881472:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788530425.141330:0:17890:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f012eb200/0xb28d70e12575179d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257517a4 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530425.141345:0:17890:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f012eb200/0xb28d70e12575179d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e1257517a4 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788530425.141360:0:17890:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788530425.143449:0:17890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f012eb200/0xb28d70e12575179d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257517a4 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530425.143469:0:17890:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f012eb200/0xb28d70e12575179d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257517a4 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788530425.143477:0:17890:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1788530425.143490:0:17890:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788530425.143524:0:17890:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.202.141@tcp: setup lustre-MDT0001-osd 00000040:01000000:1.0:1788530425.143801:0:17890:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.141@tcp ctxt 1 is initialized 00000040:01000000:1.0:1788530425.143811:0:17890:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.141@tcp ctxt 0 is initialized 10000000:01000000:1.0:1788530425.143820:0:17890:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-mdtir-ffff9a9e03637800 10000000:01000000:1.0:1788530425.143825:0:17890:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788530425.144059:0:17890:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:1.0:1788530425.144064:0:17890:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1788530425.144105:0:17890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f012eb000/0xb28d70e1257517ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530425.144114:0:17890:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f012eb000/0xb28d70e1257517ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530425.144126:0:17890:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f012eb000/0xb28d70e1257517ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530425.144151:0:17890:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37377800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17890:1875409555881600:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788530425.144238:0:17890:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530425.144338:0:17890:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f09214cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788530425.145511:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555881600 00000100:00100000:0.0:1788530425.145526:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555881600 00000100:00100000:0.0:1788530425.145792:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788530425.145807:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f051afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+15:17890:x1875409555881600:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788530425.146060:0:17151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530425.146090:0:17151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f3d100600/0xb28d70e1257517b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e1257517ab expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530425.146128:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f3d100600/0xb28d70e1257517b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e1257517ab expref: 16 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530425.146164:0:17151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f3d100600/0xb28d70e1257517b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e1257517ab expref: 16 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530425.146175:0:17151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d100600, rc 0) 00000100:00100000:0.0:1788530425.146291:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f051afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+16:17890:x1875409555881600:12345-0@lo:101:mount.lustre.0 Request processed in 489us (2053us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530425.146299:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788530425.146434:0:17890:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37377800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17890:1875409555881600:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788530425.146459:0:17890:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f012eb000/0xb28d70e1257517ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257517b2 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530425.146469:0:17890:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f012eb000/0xb28d70e1257517ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e1257517b2 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788530425.151371:0:17890:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x14:0x0] index 46 count 46 00000040:00080000:2.0:1788530425.152801:0:17890:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788530425.157732:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].1, 224 off8416 00000040:00080000:2.0:1788530425.157795:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].2, 136 off8552 00000040:00080000:2.0:1788530425.157812:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].3, 176 off8728 00000040:00080000:2.0:1788530425.157998:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].4, 224 off8952 00000040:00080000:2.0:1788530425.158021:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].5, 224 off9176 00000040:00080000:2.0:1788530425.158036:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].6, 120 off9296 00000040:00080000:2.0:1788530425.158097:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].7, 112 off9408 00000040:00080000:2.0:1788530425.158116:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].8, 160 off9568 00000040:00080000:2.0:1788530425.158128:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].9, 224 off9792 00000040:00080000:2.0:1788530425.158146:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].10, 224 off10016 00000040:00080000:2.0:1788530425.158168:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].11, 88 off10104 00000040:00080000:2.0:1788530425.158183:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].12, 144 off10248 00000040:00080000:2.0:1788530425.158210:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].13, 152 off10400 00000040:00080000:2.0:1788530425.158225:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].14, 168 off10568 00000040:00080000:2.0:1788530425.158240:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].15, 224 off10792 00000040:00080000:2.0:1788530425.158254:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].16, 224 off11016 00000040:00080000:2.0:1788530425.158268:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].17, 80 off11096 00000040:00080000:2.0:1788530425.158283:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].18, 224 off11320 00000040:00080000:2.0:1788530425.158297:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].19, 224 off11544 00000040:00080000:2.0:1788530425.158311:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].20, 160 off11704 00000040:00080000:2.0:1788530425.158325:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].21, 224 off11928 00000040:00080000:2.0:1788530425.158339:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].22, 224 off12152 00000040:00080000:2.0:1788530425.158354:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].23, 80 off12232 00000040:00080000:2.0:1788530425.158369:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].24, 224 off12456 00000040:00080000:2.0:1788530425.158385:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].25, 224 off12680 00000040:00080000:2.0:1788530425.158401:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].26, 88 off12768 00000040:00080000:2.0:1788530425.158415:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].27, 144 off12912 00000040:00080000:2.0:1788530425.158430:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].28, 152 off13064 00000040:00080000:2.0:1788530425.158444:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].29, 136 off13200 00000040:00080000:2.0:1788530425.158458:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].30, 224 off13424 00000040:00080000:2.0:1788530425.158473:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].31, 224 off13648 00000040:00080000:2.0:1788530425.158487:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].32, 80 off13728 00000040:00080000:2.0:1788530425.158502:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].33, 224 off13952 00000040:00080000:2.0:1788530425.158516:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].34, 224 off14176 00000040:00080000:2.0:1788530425.158531:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].35, 88 off14264 00000040:00080000:2.0:1788530425.158545:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].36, 144 off14408 00000040:00080000:2.0:1788530425.159045:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].37, 152 off14560 00000040:00080000:2.0:1788530425.159120:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].38, 136 off14696 00000040:00080000:2.0:1788530425.159136:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].39, 224 off14920 00000040:00080000:2.0:1788530425.159150:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].40, 224 off15144 00000040:00080000:2.0:1788530425.159164:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].41, 80 off15224 00000040:00080000:2.0:1788530425.159178:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].42, 224 off15448 00000040:00080000:2.0:1788530425.159192:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].43, 224 off15672 00000040:00080000:2.0:1788530425.159206:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].44, 120 off15792 00000040:00080000:2.0:1788530425.159242:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].45, 224 off16016 00000040:00080000:2.0:1788530425.159261:0:17890:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x14:0x0] index 45 count 46 00000100:00100000:2.0:1788530425.159393:0:17890:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d3ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17890:1875409555881728:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788530425.159476:0:17890:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530425.159808:0:17890:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f03e8b000 going to sleep for 11 seconds 00000100:00100000:0.0:1788530425.160175:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555881728 00000100:00100000:0.0:1788530425.160187:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555881728 00000100:00100000:0.0:1788530425.160315:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788530425.160328:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f051ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+16:17890:x1875409555881728:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788530425.160551:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f051ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+16:17890:x1875409555881728:12345-0@lo:501:mount.lustre.0 Request processed in 224us (1075us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530425.160596:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788530425.160718:0:17890:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d3ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17890:1875409555881728:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788530425.160775:0:17890:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d3ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17890:1875409555881856:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788530425.160845:0:17890:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530425.161279:0:17890:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f03e8b000 going to sleep for 11 seconds 00000100:00100000:1.0:1788530425.161365:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555881856 00000100:00100000:1.0:1788530425.161372:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555881856 00000100:00100000:1.0:1788530425.161411:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788530425.161421:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f051ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+16:17890:x1875409555881856:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788530425.162813:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f051ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+16:17890:x1875409555881856:12345-0@lo:503:mount.lustre.0 Request processed in 1386us (1975us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530425.162825:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788530425.163086:0:17890:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d3ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17890:1875409555881856:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788530425.163768:0:17890:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788530425.164065:0:17890:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d3ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17890:1875409555881984:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788530425.164145:0:17890:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530425.164326:0:17890:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f03e8b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788530425.164413:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555881984 00000100:00100000:3.0:1788530425.164420:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555881984 00000100:00100000:1.0:1788530425.165841:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788530425.165856:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f051ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+16:17890:x1875409555881984:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788530425.167243:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f051ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+16:17890:x1875409555881984:12345-0@lo:502:mount.lustre.0 Request processed in 1381us (3089us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530425.167259:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788530425.167299:0:17890:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d3ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17890:1875409555881984:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788530425.167774:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].1, 224 off8416 00000040:00080000:2.0:1788530425.167810:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].2, 136 off8552 00000040:00080000:2.0:1788530425.167826:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].3, 176 off8728 00000040:00080000:2.0:1788530425.167841:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].4, 224 off8952 00000040:00080000:2.0:1788530425.167855:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].5, 224 off9176 00000040:00080000:2.0:1788530425.167868:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].6, 120 off9296 00000040:00080000:2.0:1788530425.167882:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].7, 112 off9408 00000040:00080000:2.0:1788530425.167897:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].8, 160 off9568 00000040:00080000:2.0:1788530425.167909:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].9, 224 off9792 00000040:00080000:2.0:1788530425.167922:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].10, 224 off10016 00000040:00080000:2.0:1788530425.167935:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].11, 88 off10104 00000040:00080000:2.0:1788530425.167949:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].12, 144 off10248 00000040:00080000:2.0:1788530425.167978:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].13, 152 off10400 00000040:00080000:2.0:1788530425.168006:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].14, 168 off10568 00000040:00080000:2.0:1788530425.168021:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].15, 224 off10792 00000040:00080000:2.0:1788530425.168035:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].16, 224 off11016 00000040:00080000:2.0:1788530425.168064:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].17, 80 off11096 00000040:00080000:2.0:1788530425.168081:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].18, 224 off11320 00000040:00080000:2.0:1788530425.168095:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].19, 224 off11544 00000040:00080000:2.0:1788530425.168107:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].20, 160 off11704 00000040:00080000:2.0:1788530425.168121:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].21, 224 off11928 00000040:00080000:2.0:1788530425.168136:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].22, 224 off12152 00000040:00080000:2.0:1788530425.168150:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].23, 80 off12232 00000040:00080000:2.0:1788530425.168290:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].24, 224 off12456 00000040:00080000:2.0:1788530425.168316:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].25, 224 off12680 00000040:00080000:2.0:1788530425.168331:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].26, 88 off12768 00000040:00080000:2.0:1788530425.168465:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].27, 144 off12912 00000040:00080000:2.0:1788530425.168481:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].28, 152 off13064 00000040:00080000:2.0:1788530425.168493:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].29, 136 off13200 00000040:00080000:2.0:1788530425.168504:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].30, 224 off13424 00000040:00080000:2.0:1788530425.168516:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].31, 224 off13648 00000040:00080000:2.0:1788530425.168527:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].32, 80 off13728 00000040:00080000:2.0:1788530425.168537:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].33, 224 off13952 00000040:00080000:2.0:1788530425.168549:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].34, 224 off14176 00000040:00080000:2.0:1788530425.168602:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].35, 88 off14264 00000040:00080000:2.0:1788530425.168618:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].36, 144 off14408 00000040:00080000:2.0:1788530425.168631:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].37, 152 off14560 00000040:00080000:2.0:1788530425.168645:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].38, 136 off14696 00000040:00080000:2.0:1788530425.168665:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].39, 224 off14920 00000040:00080000:2.0:1788530425.168679:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].40, 224 off15144 00000040:00080000:2.0:1788530425.168692:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].41, 80 off15224 00000040:00080000:2.0:1788530425.168708:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].42, 224 off15448 00000040:00080000:2.0:1788530425.168723:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].43, 224 off15672 00000040:00080000:2.0:1788530425.168736:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].44, 120 off15792 00000100:00100000:2.0:1788530425.168786:0:17890:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d3ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17890:1875409555882112:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788530425.168878:0:17890:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530425.168977:0:17890:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f03e8b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788530425.169407:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555882112 00000100:00100000:0.0:1788530425.169415:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555882112 00000100:00100000:0.0:1788530425.169508:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788530425.169518:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f051ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+16:17890:x1875409555882112:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788530425.169723:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f051ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+16:17890:x1875409555882112:12345-0@lo:502:mount.lustre.0 Request processed in 206us (845us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530425.169731:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788530425.169797:0:17890:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d3ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17890:1875409555882112:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788530425.170197:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].45, 224 off16016 00000040:00080000:1.0:1788530425.170214:0:17890:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:1.0:1788530425.172710:0:17894:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788530425.172731:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788530425.172734:0:17894:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1788530425.172742:0:17894:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1788530425.172746:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788530425.172766:0:17894:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff9a9f2c14b310) 00000020:00000080:1.0:1788530425.172794:0:17894:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:1.0:1788530425.172800:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788530425.173338:0:17894:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788530425.173349:0:17894:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb28d70e1257517c0 00000020:00000080:1.0:1788530425.173703:0:17894:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1788530425.173719:0:17894:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788530425.173723:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788530425.173726:0:17894:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1788530425.173729:0:17894:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788530425.173734:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788530425.173735:0:17894:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1788530425.173739:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788530425.173749:0:17894:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff9a9f2c14e620) 00000020:00000080:1.0:1788530425.173763:0:17894:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:1.0:1788530425.173767:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788530425.173770:0:17894:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1788530425.173774:0:17894:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1788530425.173781:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788530425.174038:0:17894:0:(tgt_mount.c:167:server_get_mount()) get mount ffff9a9e03637800 from lustre-MDT0001, refs=2 00000020:00000080:1.0:1788530425.174150:0:17894:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9a9f2c148000) 00000020:00000080:1.0:1788530425.174164:0:17894:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:1.0:1788530425.174249:0:17894:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788530425.174256:0:17894:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb28d70e1257517d5 00000020:00000080:1.0:1788530425.174378:0:17894:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1788530425.174385:0:17894:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788530425.174389:0:17894:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xb28d70e1257517dc 00080000:01000000:1.0:1788530425.174396:0:17894:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788530425.174400:0:17894:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb28d70e1257517e3 00010000:00010000:3.0:1788530425.282184:0:17894:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:1.0:1788530425.288102:0:17894:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:1.0:1788530425.288721:0:17894:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1788530425.290151:0:17894:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1788530425.290163:0:17894:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788530425.290170:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788530425.290172:0:17894:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:1.0:1788530425.290175:0:17894:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788530425.290181:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788530425.290183:0:17894:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:1.0:1788530425.290185:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788530425.290207:0:17894:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.141@tcp to nid 0x20000c0a8ca8d (192.168.202.141@tcp) 00000020:00000080:1.0:1788530425.290236:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788530425.290263:0:17894:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff9a9f04531988) 00000020:00000080:1.0:1788530425.290286:0:17894:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:1.0:1788530425.290292:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788530425.290357:0:17894:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:1.0:1788530425.290364:0:17894:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788530425.290370:0:17894:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb28d70e1257517f1 00010000:00080000:1.0:1788530425.290402:0:17894:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a9f396b3000@lustre-MDT0000-osp-MDT0001: add connection 192.168.202.141@tcp at head 00010000:00010000:1.0:1788530425.294080:0:17894:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:3.0:1788530425.297278:0:17894:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788530425.297302:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1788530425.297360:0:17894:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788530425.297391:0:17894:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb28d70e1257517f8 00000100:00080000:3.0:1788530425.297406:0:17894:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788530425.297413:0:17894:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9a9f396b3000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:3.0:1788530425.297462:0:17894:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9f328e5880 x1875409555882240/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788530425.297494:0:17894:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788530425.298053:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875409555882240:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788530425.298171:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:3.0:1788530425.298692:0:17894:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00100000:3.0:1788530425.298730:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555882240 00000100:00100000:3.0:1788530425.298738:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555882240 00000100:00100000:3.0:1788530425.298787:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788530425.298795:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37375f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1875409555882240:12345-0@lo:38:llog_process_th.0 00000100:00080000:0.0:1788530425.299392:0:12493:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788530425.299399:0:12493:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788530425.299404:0:12493:0:(import.c:65:import_set_state_nolock()) ffff9a9e0258b800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788530425.299411:0:12493:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 629 00000100:00080000:0.0:1788530425.299423:0:12493:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788530425.299429:0:12493:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9a9e0258b800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:0.0:1788530425.299462:0:12493:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9e03736d80 x1875409555882368/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788530425.299492:0:12493:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788530425.299496:0:12493:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788530425.299499:0:12493:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788530425.299502:0:12493:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:00000080:0.0:1788530425.299537:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788530425.299540:0:17894:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:0.0:1788530425.299547:0:17894:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788530425.299550:0:17894:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1788530425.299552:0:17894:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788530425.299554:0:17894:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788530425.299555:0:17894:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00010000:00080000:3.0:1788530425.299656:0:17163:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 633 last 0 00000020:00000080:3.0:1788530425.299698:0:17163:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb28d70e1257517ff 00000004:00100000:3.0:1788530425.299717:0:17163:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1788530425.299723:0:17163:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:3.0:1788530425.299798:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788530425.299813:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03737100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875409555882496:0@lo:400:kworker.0 00000100:00100000:1.0:1788530425.300322:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03736d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875409555882368:0@lo:38:kworker.0 00000020:00000080:0.0:1788530425.300391:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788530425.300393:0:17894:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788530425.300400:0:17894:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788530425.300407:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788530425.300408:0:17894:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:0.0:1788530425.300412:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788530425.300485:0:17894:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1788530425.300519:0:17894:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788530425.300523:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788530425.300524:0:17894:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:0.0:1788530425.300527:0:17894:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788530425.300529:0:17894:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:0.0:1788530425.300530:0:17894:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788530425.300531:0:17894:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788530425.300533:0:17894:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788530425.300542:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788530425.300543:0:17894:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788530425.300546:0:17894:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788530425.300550:0:17894:0:(obd_mount.c:963:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1788530425.300553:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788530425.300554:0:17894:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788530425.300557:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788530425.300590:0:17894:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.141@tcp to nid 0x20000c0a8ca8d (192.168.202.141@tcp) 00000020:01000000:0.0:1788530425.300615:0:17894:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1788530425.300619:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788530425.300635:0:17894:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9a9f3d216620) 00000020:00000080:0.0:1788530425.300651:0:17894:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1788530425.300656:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788530425.300723:0:17894:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:0.0:1788530425.300730:0:17894:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788530425.300736:0:17894:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb28d70e12575180d 00010000:00080000:0.0:1788530425.300767:0:17894:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a9f08ce8000@lustre-OST0000-osc-MDT0001: add connection 192.168.202.141@tcp at head 00010000:00010000:0.0:1788530425.301038:0:17894:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:1.0:1788530425.307017:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530425.307080:0:17164:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:1.0:1788530425.307089:0:17164:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000040:01000000:2.0:1788530425.312748:0:17894:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1788530425.313021:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530425.313070:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555882496 00000100:00100000:3.0:1788530425.313079:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555882496 00000100:00100000:3.0:1788530425.313126:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788530425.313135:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f328e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875409555882496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530425.313185:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f328e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875409555882496:12345-0@lo:400:kworker.0 Request processed in 51us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530425.313192:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1788530425.313310:0:17163:0:(import.c:65:import_set_state_nolock()) ffff9a9f08ceb000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788530425.313360:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37375f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1875409555882240:12345-0@lo:38:llog_process_th.0 Request processed in 14564us (15189us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530425.313368:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788530425.313387:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555882368 00000100:00100000:0.0:1788530425.313390:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555882368 00000100:00100000:0.0:1788530425.313404:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788530425.313408:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37375880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1875409555882368:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1788530425.313445:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37375880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1875409555882368:12345-0@lo:38:kworker.0 Request processed in 35us (6437us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788530425.313451:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788530425.313492:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788530425.313507:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9e0258b800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788530425.313512:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788530425.313516:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03736d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875409555882368:0@lo:38:kworker.0 00000100:00100000:0.0:1788530425.313533:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788530425.313539:0:3646:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1788530425.313546:0:3646:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1788530425.313551:0:3646:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788530425.313553:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9f396b3000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00010000:00080000:3.0:1788530425.314092:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a9e03737100 x1875409555882496/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530441 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530425.314104:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03737100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875409555882496:0@lo:400:kworker.0 00000040:01000000:2.0:1788530425.314493:0:17894:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:0.0:1788530425.314735:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875409555882240:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788530425.314872:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555882624:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788530425.316076:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530425.316365:0:17899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555882624 00000100:00100000:1.0:1788530425.316373:0:17899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555882624 00000100:00100000:1.0:1788530425.316432:0:17899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788530425.316443:0:17899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f328e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3647:x1875409555882624:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788530425.316486:0:17899:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788530425.316550:0:17899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f328e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3647:x1875409555882624:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530425.316557:0:17899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788530425.318555:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555882624:0@lo:41:osp-pre-0-1.0 00000040:00080000:2.0:1788530425.320439:0:17894:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788530425.321167:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1788530425.321381:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000040:00080000:1.0:1788530425.322392:0:17900:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788530425.322399:0:17900:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788530425.324038:0:17894:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788530425.324056:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788530425.324120:0:17894:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788530425.324153:0:17894:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb28d70e125751814 00000100:00080000:2.0:1788530425.324168:0:17894:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788530425.324175:0:17894:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9a9f08ce8000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:2.0:1788530425.324291:0:17894:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9e03d3df80 x1875409555882752/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788530425.324364:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875409555882752:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788530425.324433:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875409555882752 offset 0 length 520: 4 00000100:00080000:2.0:1788530425.324504:0:17894:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788530425.325164:0:17894:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788530425.325173:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788530425.325175:0:17894:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788530425.325178:0:17894:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788530425.325181:0:17894:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:2.0:1788530425.325182:0:17894:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788530425.325183:0:17894:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788530425.325185:0:17894:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788530425.325188:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788530425.325189:0:17894:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788530425.325191:0:17894:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788530425.325267:0:17894:0:(obd_mount.c:963:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1788530425.325272:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788530425.325274:0:17894:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788530425.325278:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788530425.325300:0:17894:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.141@tcp to nid 0x20000c0a8ca8d (192.168.202.141@tcp) 00000020:01000000:2.0:1788530425.325329:0:17894:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1788530425.325332:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788530425.325348:0:17894:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9a9f33d91988) 00000020:00000080:2.0:1788530425.325371:0:17894:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:2.0:1788530425.325378:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788530425.325474:0:17894:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:2.0:1788530425.325482:0:17894:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788530425.325488:0:17894:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb28d70e125751822 00010000:00080000:2.0:1788530425.325522:0:17894:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a9f0d6f0800@lustre-OST0001-osc-MDT0001: add connection 192.168.202.141@tcp at head 00010000:00010000:2.0:1788530425.325815:0:17894:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000100:00080000:3.0:1788530425.326187:0:12493:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788530425.326204:0:12493:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788530425.326214:0:12493:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788530425.326217:0:12493:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:01000000:2.0:1788530425.326536:0:17894:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788530425.326552:0:17894:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1788530425.330438:0:17894:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788530425.331374:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1788530425.331553:0:17894:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1788530425.332387:0:17902:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788530425.332395:0:17902:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788530425.333823:0:17894:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788530425.334010:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788530425.334066:0:17894:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788530425.334094:0:17894:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb28d70e125751829 00000100:00080000:0.0:1788530425.334106:0:17894:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788530425.334112:0:17894:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9a9f0d6f0800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:0.0:1788530425.334154:0:17894:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9e03736d80 x1875409555882880/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788530425.334173:0:17894:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:1.0:1788530425.334384:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03736d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875409555882880:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788530425.334447:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875409555882880 offset 0 length 520: 4 00000020:01000000:0.0:1788530425.334593:0:17894:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788530425.334599:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788530425.334600:0:17894:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788530425.334604:0:17894:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788530425.334608:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788530425.334609:0:17894:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788530425.334619:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788530425.334621:0:17894:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788530425.334624:0:17894:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788530425.334627:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788530425.334628:0:17894:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788530425.334631:0:17894:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788530425.334634:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788530425.334635:0:17894:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788530425.334639:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788530425.334671:0:17894:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788530425.334674:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788530425.334675:0:17894:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788530425.334678:0:17894:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1c:0x0] index 46 count 46 00000020:01000000:1.0:1788530425.334866:0:17890:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:1.0:1788530425.334881:0:17890:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1788530425.334911:0:17890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f012eb000/0xb28d70e1257517ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257517b2 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530425.334922:0:17890:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f012eb000/0xb28d70e1257517ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257517b2 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788530425.334930:0:17890:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-mdtir-ffff9a9e03637800 from 1 10000000:01000000:1.0:1788530425.334933:0:17890:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788530425.334964:0:17890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f012ea000/0xb28d70e125751830 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530425.334972:0:17890:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f012ea000/0xb28d70e125751830 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530425.334984:0:17890:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f012ea000/0xb28d70e125751830 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530425.334999:0:17890:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37375c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17890:1875409555883008:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788530425.335039:0:17890:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530425.335063:0:17890:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e024a3c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788530425.335084:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555883008 00000100:00100000:1.0:1788530425.335092:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555883008 00000100:00100000:1.0:1788530425.335142:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788530425.335153:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f051af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+16:17890:x1875409555883008:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788530425.335171:0:17153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530425.335187:0:17153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f012eb600/0xb28d70e125751837 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e125751830 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530425.335360:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f012eb600/0xb28d70e125751837 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e125751830 expref: 17 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530425.335372:0:17153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f012eb600/0xb28d70e125751837 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125751830 expref: 17 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530425.335383:0:17153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f012eb600, rc 0) 00000100:00100000:1.0:1788530425.335426:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f051af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+17:17890:x1875409555883008:12345-0@lo:101:mount.lustre.0 Request processed in 274us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530425.335434:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788530425.335494:0:17890:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37375c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17890:1875409555883008:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788530425.335511:0:17890:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f012ea000/0xb28d70e125751830 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751837 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530425.335520:0:17890:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f012ea000/0xb28d70e125751830 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e125751837 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530425.336535:0:17890:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37375c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17890:1875409555883136:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1788530425.336816:0:17890:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530425.337044:0:17890:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e024a3c00 going to sleep for 11 seconds 00000100:00080000:2.0:1788530425.337184:0:12493:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788530425.337190:0:12493:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788530425.337255:0:12493:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788530425.337260:0:12493:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788530425.337312:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555883136 00000100:00100000:0.0:1788530425.337322:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555883136 00000100:00100000:0.0:1788530425.337389:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788530425.337400:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f051af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+17:17890:x1875409555883136:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1788530425.337429:0:17154:0:(mgs_nids.c:1159:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788530425.337454:0:17154:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788530425.337457:0:17154:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1788530425.337764:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f051af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+17:17890:x1875409555883136:12345-0@lo:256:mount.lustre.0 Request processed in 366us (948us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530425.337773:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788530425.337843:0:17890:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37375c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17890:1875409555883136:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1788530425.339036:0:17890:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788530425.339113:0:17890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f012ea000/0xb28d70e125751830 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751837 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530425.339125:0:17890:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f012ea000/0xb28d70e125751830 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751837 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788530425.339151:0:17890:0:(mgc_request.c:2194:mgc_process_log()) Process log params-ffff9a9e03637800 from 1 10000000:01000000:0.0:1788530425.339154:0:17890:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788530425.339266:0:17890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d101600/0xb28d70e12575183e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530425.339277:0:17890:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f3d101600/0xb28d70e12575183e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530425.339290:0:17890:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f3d101600/0xb28d70e12575183e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530425.339316:0:17890:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03737480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17890:1875409555883264:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788530425.339376:0:17890:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530425.339427:0:17890:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f06a6ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1788530425.339526:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555883264 00000100:00100000:1.0:1788530425.339533:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555883264 00000100:00100000:1.0:1788530425.339614:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788530425.339626:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f051ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+17:17890:x1875409555883264:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788530425.339640:0:17153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530425.339655:0:17153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f012eb800/0xb28d70e125751845 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e12575183e expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530425.339696:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f012eb800/0xb28d70e125751845 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e12575183e expref: 18 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530425.339708:0:17153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f012eb800/0xb28d70e125751845 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e12575183e expref: 18 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530425.339719:0:17153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f012eb800, rc 0) 00000100:00100000:1.0:1788530425.339769:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f051ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+18:17890:x1875409555883264:12345-0@lo:101:mount.lustre.0 Request processed in 145us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530425.339776:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788530425.340183:0:17890:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03737480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17890:1875409555883264:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788530425.340280:0:17890:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f3d101600/0xb28d70e12575183e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751845 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530425.340292:0:17890:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f3d101600/0xb28d70e12575183e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e125751845 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788530425.341643:0:17890:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1a:0x0] index 13 count 13 00000040:00080000:0.0:1788530425.344168:0:17890:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788530425.346395:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].1, 224 off8416 00000040:00080000:0.0:1788530425.346455:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].2, 112 off8528 00000040:00080000:0.0:1788530425.346474:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].3, 224 off8752 00000040:00080000:0.0:1788530425.346502:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].4, 224 off8976 00000040:00080000:0.0:1788530425.346518:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].5, 112 off9088 00000040:00080000:0.0:1788530425.346543:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].6, 224 off9312 00000040:00080000:0.0:1788530425.346607:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].7, 224 off9536 00000040:00080000:0.0:1788530425.346623:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].8, 128 off9664 00000040:00080000:0.0:1788530425.346638:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].9, 224 off9888 00000040:00080000:0.0:1788530425.346651:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].10, 224 off10112 00000040:00080000:0.0:1788530425.346663:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].11, 128 off10240 00000040:00080000:0.0:1788530425.346688:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].12, 224 off10464 00000040:00080000:0.0:1788530425.346694:0:17890:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1a:0x0] index 12 count 13 00000100:00100000:0.0:1788530425.346851:0:17890:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03737480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17890:1875409555883392:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788530425.346944:0:17890:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530425.347001:0:17890:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f03ac3d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788530425.347167:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555883392 00000100:00100000:2.0:1788530425.347181:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555883392 00000100:00100000:2.0:1788530425.347265:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788530425.347278:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f051aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+18:17890:x1875409555883392:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788530425.347466:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f051aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+18:17890:x1875409555883392:12345-0@lo:501:mount.lustre.0 Request processed in 188us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530425.347475:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788530425.347714:0:17890:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03737480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17890:1875409555883392:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788530425.347756:0:17890:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03737480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17890:1875409555883520:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788530425.347805:0:17890:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530425.347827:0:17890:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f03ac3d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788530425.347880:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555883520 00000100:00100000:2.0:1788530425.348038:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555883520 00000100:00100000:2.0:1788530425.348105:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788530425.348114:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f051ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+18:17890:x1875409555883520:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788530425.348236:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f051ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+18:17890:x1875409555883520:12345-0@lo:503:mount.lustre.0 Request processed in 123us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530425.348245:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788530425.348821:0:17890:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03737480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17890:1875409555883520:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788530425.350121:0:17890:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788530425.350325:0:17890:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d3c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17890:1875409555883648:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788530425.350395:0:17890:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530425.350501:0:17890:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f0d6db480 going to sleep for 11 seconds 00000100:00100000:0.0:1788530425.350548:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555883648 00000100:00100000:0.0:1788530425.350556:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555883648 00000100:00100000:0.0:1788530425.350809:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788530425.350818:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f051ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+18:17890:x1875409555883648:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788530425.351137:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f051ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+18:17890:x1875409555883648:12345-0@lo:502:mount.lustre.0 Request processed in 320us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530425.351146:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788530425.351250:0:17890:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d3c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17890:1875409555883648:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788530425.351506:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].1, 224 off8416 00000040:00080000:3.0:1788530425.351537:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].2, 112 off8528 00000040:00080000:3.0:1788530425.351550:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].3, 224 off8752 00000040:00080000:3.0:1788530425.351605:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].4, 224 off8976 00000040:00080000:3.0:1788530425.351623:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].5, 112 off9088 00000040:00080000:3.0:1788530425.351635:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].6, 224 off9312 00000040:00080000:3.0:1788530425.351649:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].7, 224 off9536 00000040:00080000:3.0:1788530425.351662:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].8, 128 off9664 00000040:00080000:3.0:1788530425.351674:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].9, 224 off9888 00000040:00080000:3.0:1788530425.351685:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].10, 224 off10112 00000040:00080000:3.0:1788530425.351702:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].11, 128 off10240 00000100:00100000:3.0:1788530425.351733:0:17890:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17890:1875409555883776:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788530425.351781:0:17890:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530425.352437:0:17890:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f32b9f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788530425.352539:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555883776 00000100:00100000:2.0:1788530425.352549:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555883776 00000100:00100000:2.0:1788530425.352619:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788530425.352627:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f051acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+18:17890:x1875409555883776:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788530425.352758:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f051acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+18:17890:x1875409555883776:12345-0@lo:502:mount.lustre.0 Request processed in 130us (975us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530425.352766:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788530425.353095:0:17890:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17890:1875409555883776:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788530425.353165:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].12, 224 off10464 00000040:00080000:3.0:1788530425.353178:0:17890:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1788530425.354188:0:17904:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788530425.354213:0:17904:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788530425.354216:0:17904:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788530425.354226:0:17904:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a9e03637800 00000020:00000080:2.0:1788530425.354229:0:17904:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788530425.354243:0:17904:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788530425.354245:0:17904:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788530425.354247:0:17904:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788530425.354249:0:17904:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788530425.354252:0:17904:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788530425.354260:0:17904:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788530425.354265:0:17904:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a9e03637800 00000020:00000080:2.0:1788530425.354268:0:17904:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788530425.354342:0:17904:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788530425.354346:0:17904:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788530425.354347:0:17904:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788530425.354349:0:17904:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788530425.354352:0:17904:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788530425.354353:0:17904:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788530425.354356:0:17904:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a9e03637800 00000020:00000080:2.0:1788530425.354358:0:17904:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788530425.354375:0:17904:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788530425.354377:0:17904:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788530425.354379:0:17904:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788530425.354381:0:17904:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788530425.354384:0:17904:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788530425.354385:0:17904:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788530425.354389:0:17904:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a9e03637800 00000020:00000080:2.0:1788530425.354391:0:17904:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788530425.354412:0:17904:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788530425.354415:0:17904:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788530425.354416:0:17904:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788530425.354419:0:17904:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1e:0x0] index 13 count 13 00000020:01000000:0.0:1788530425.358690:0:17890:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1788530425.358728:0:17890:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788530425.358760:0:17890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d101600/0xb28d70e12575183e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751845 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530425.358773:0:17890:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f3d101600/0xb28d70e12575183e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751845 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788530425.358864:0:17890:0:(mgc_request.c:2342:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788530425.358867:0:17890:0:(mgc_request.c:424:config_log_add()) add config log lustre-client-ffff9a9e03637800 10000000:01000000:0.0:1788530425.358870:0:17890:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-client-ffff9a9e03637800 10000000:01000000:0.0:1788530425.358874:0:17890:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788530425.359057:0:17890:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.202.141@tcp: setup lustre-MDT0001-osd 00000040:01000000:0.0:1788530425.359164:0:17890:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.141@tcp ctxt 1 is initialized 00000040:01000000:0.0:1788530425.359172:0:17890:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.141@tcp ctxt 0 is initialized 10000000:01000000:0.0:1788530425.359186:0:17890:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-client-ffff9a9e03637800 from 1 10000000:01000000:0.0:1788530425.359189:0:17890:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788530425.359239:0:17890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d101a00/0xb28d70e12575184c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530425.359248:0:17890:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f3d101a00/0xb28d70e12575184c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530425.359259:0:17890:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f3d101a00/0xb28d70e12575184c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530425.359283:0:17890:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03734000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17890:1875409555883904:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788530425.359363:0:17890:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530425.364424:0:17890:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f03ac3000 going to sleep for 11 seconds 00000100:00100000:1.0:1788530425.364676:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555883904 00000100:00100000:1.0:1788530425.364690:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555883904 00000100:00100000:1.0:1788530425.364786:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788530425.364799:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03752c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+18:17890:x1875409555883904:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788530425.364821:0:17151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530425.365755:0:17151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f012ebe00/0xb28d70e125751853 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e12575184c expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530425.365791:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f012ebe00/0xb28d70e125751853 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e12575184c expref: 19 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530425.365802:0:17151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f012ebe00/0xb28d70e125751853 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e12575184c expref: 19 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530425.365812:0:17151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f012ebe00, rc 0) 00000100:00100000:1.0:1788530425.367035:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03752c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+19:17890:x1875409555883904:12345-0@lo:101:mount.lustre.0 Request processed in 2232us (7665us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530425.367045:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788530425.367439:0:17890:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03734000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17890:1875409555883904:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788530425.367471:0:17890:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f3d101a00/0xb28d70e12575184c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751853 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530425.367485:0:17890:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f3d101a00/0xb28d70e12575184c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e125751853 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788530425.374462:0:17890:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000040:00080000:0.0:1788530425.376030:0:17890:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788530425.378371:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].1, 224 off8416 00000040:00080000:0.0:1788530425.378460:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].2, 120 off8536 00000040:00080000:0.0:1788530425.380085:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].3, 168 off8704 00000040:00080000:0.0:1788530425.380108:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].4, 224 off8928 00000040:00080000:0.0:1788530425.380123:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].5, 224 off9152 00000040:00080000:0.0:1788530425.380138:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].6, 120 off9272 00000040:00080000:0.0:1788530425.380152:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].7, 168 off9440 00000040:00080000:0.0:1788530425.380165:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].8, 224 off9664 00000040:00080000:0.0:1788530425.380178:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].9, 224 off9888 00000040:00080000:0.0:1788530425.380191:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].10, 120 off10008 00000040:00080000:0.0:1788530425.380994:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].11, 224 off10232 00000040:00080000:0.0:1788530425.381010:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].12, 224 off10456 00000040:00080000:0.0:1788530425.381021:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].13, 88 off10544 00000040:00080000:0.0:1788530425.381032:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].14, 128 off10672 00000040:00080000:0.0:1788530425.381044:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].15, 144 off10816 00000040:00080000:0.0:1788530425.381058:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].16, 160 off10976 00000040:00080000:0.0:1788530425.381090:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].17, 224 off11200 00000040:00080000:0.0:1788530425.381107:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].18, 224 off11424 00000040:00080000:0.0:1788530425.381121:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].19, 80 off11504 00000040:00080000:0.0:1788530425.381135:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].20, 224 off11728 00000040:00080000:0.0:1788530425.381148:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].21, 224 off11952 00000040:00080000:0.0:1788530425.381162:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].22, 88 off12040 00000040:00080000:0.0:1788530425.381175:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].23, 128 off12168 00000040:00080000:0.0:1788530425.381189:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].24, 144 off12312 00000040:00080000:0.0:1788530425.382828:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].25, 160 off12472 00000040:00080000:0.0:1788530425.382849:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].26, 224 off12696 00000040:00080000:0.0:1788530425.382861:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].27, 224 off12920 00000040:00080000:0.0:1788530425.382869:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].28, 80 off13000 00000040:00080000:0.0:1788530425.382887:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].29, 224 off13224 00000040:00080000:0.0:1788530425.382897:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].30, 224 off13448 00000040:00080000:0.0:1788530425.382909:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].31, 88 off13536 00000040:00080000:0.0:1788530425.382918:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].32, 128 off13664 00000040:00080000:0.0:1788530425.382938:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].33, 144 off13808 00000040:00080000:0.0:1788530425.382947:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].34, 128 off13936 00000040:00080000:0.0:1788530425.382960:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].35, 224 off14160 00000040:00080000:0.0:1788530425.382976:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].36, 224 off14384 00000040:00080000:0.0:1788530425.382991:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].37, 80 off14464 00000040:00080000:0.0:1788530425.383007:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].38, 224 off14688 00000040:00080000:0.0:1788530425.383022:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].39, 224 off14912 00000040:00080000:0.0:1788530425.383033:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].40, 88 off15000 00000040:00080000:0.0:1788530425.383060:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].41, 128 off15128 00000040:00080000:0.0:1788530425.383076:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].42, 144 off15272 00000040:00080000:0.0:1788530425.383092:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].43, 128 off15400 00000040:00080000:0.0:1788530425.383109:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].44, 224 off15624 00000040:00080000:0.0:1788530425.383125:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].45, 224 off15848 00000040:00080000:0.0:1788530425.383142:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].46, 80 off15928 00000040:00080000:0.0:1788530425.383163:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].47, 224 off16152 00000040:00080000:0.0:1788530425.383182:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].48, 232 off16384 00000040:00080000:0.0:1788530425.383344:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].49, 224 off16608 00000040:00080000:0.0:1788530425.383365:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].50, 120 off16728 00000040:00080000:0.0:1788530425.383387:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].51, 224 off16952 00000040:00080000:0.0:1788530425.383393:0:17890:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 51 count 51 00000100:00100000:0.0:1788530425.383493:0:17890:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03734000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17890:1875409555884032:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788530425.383557:0:17890:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530425.383636:0:17890:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f03ac33c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788530425.383894:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555884032 00000100:00100000:3.0:1788530425.383903:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555884032 00000100:00100000:3.0:1788530425.383954:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788530425.383967:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03750850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+19:17890:x1875409555884032:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788530425.384152:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03750850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+19:17890:x1875409555884032:12345-0@lo:501:mount.lustre.0 Request processed in 188us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530425.384168:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788530425.384239:0:17890:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03734000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17890:1875409555884032:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788530425.384272:0:17890:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17890:1875409555884160:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788530425.384300:0:17890:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530425.384319:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555884160 00000100:00100000:3.0:1788530425.384321:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555884160 00000100:00100000:3.0:1788530425.384338:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788530425.384344:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03752850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+19:17890:x1875409555884160:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788530425.384416:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03752850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+19:17890:x1875409555884160:12345-0@lo:503:mount.lustre.0 Request processed in 72us (115us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530425.384421:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788530425.384446:0:17890:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f08cd5600 going to sleep for 11 seconds 00000100:00100000:3.0:1788530425.384455:0:17890:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17890:1875409555884160:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788530425.384855:0:17890:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788530425.384907:0:17890:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17890:1875409555884288:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788530425.384934:0:17890:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530425.384953:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555884288 00000100:00100000:3.0:1788530425.384958:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555884288 00000100:00100000:3.0:1788530425.384982:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788530425.384989:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03751c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+19:17890:x1875409555884288:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788530425.385058:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03751c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+19:17890:x1875409555884288:12345-0@lo:502:mount.lustre.0 Request processed in 69us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530425.385065:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788530425.385096:0:17890:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f08cd5600 going to sleep for 11 seconds 00000100:00100000:3.0:1788530425.385114:0:17890:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17890:1875409555884288:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788530425.385289:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].1, 224 off8416 00000040:00080000:3.0:1788530425.385316:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].2, 120 off8536 00000040:00080000:3.0:1788530425.385331:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].3, 168 off8704 00000040:00080000:3.0:1788530425.385346:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].4, 224 off8928 00000040:00080000:3.0:1788530425.385362:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].5, 224 off9152 00000040:00080000:3.0:1788530425.385377:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].6, 120 off9272 00000040:00080000:3.0:1788530425.385393:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].7, 168 off9440 00000040:00080000:3.0:1788530425.385427:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].8, 224 off9664 00000040:00080000:3.0:1788530425.385445:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].9, 224 off9888 00000040:00080000:3.0:1788530425.385461:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].10, 120 off10008 00000040:00080000:3.0:1788530425.385471:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].11, 224 off10232 00000040:00080000:3.0:1788530425.385479:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].12, 224 off10456 00000040:00080000:3.0:1788530425.385487:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].13, 88 off10544 00000040:00080000:3.0:1788530425.385495:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].14, 128 off10672 00000040:00080000:3.0:1788530425.385502:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].15, 144 off10816 00000040:00080000:3.0:1788530425.385510:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].16, 160 off10976 00000040:00080000:3.0:1788530425.385519:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].17, 224 off11200 00000040:00080000:3.0:1788530425.385529:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].18, 224 off11424 00000040:00080000:3.0:1788530425.385545:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].19, 80 off11504 00000040:00080000:3.0:1788530425.385594:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].20, 224 off11728 00000040:00080000:3.0:1788530425.385610:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].21, 224 off11952 00000040:00080000:3.0:1788530425.385621:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].22, 88 off12040 00000040:00080000:3.0:1788530425.385629:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].23, 128 off12168 00000040:00080000:3.0:1788530425.385645:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].24, 144 off12312 00000040:00080000:3.0:1788530425.385655:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].25, 160 off12472 00000040:00080000:3.0:1788530425.385663:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].26, 224 off12696 00000040:00080000:3.0:1788530425.385672:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].27, 224 off12920 00000040:00080000:3.0:1788530425.385680:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].28, 80 off13000 00000040:00080000:3.0:1788530425.385690:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].29, 224 off13224 00000040:00080000:3.0:1788530425.385699:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].30, 224 off13448 00000040:00080000:3.0:1788530425.385707:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].31, 88 off13536 00000040:00080000:3.0:1788530425.385725:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].32, 128 off13664 00000040:00080000:3.0:1788530425.385739:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].33, 144 off13808 00000040:00080000:3.0:1788530425.385754:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].34, 128 off13936 00000040:00080000:3.0:1788530425.385770:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].35, 224 off14160 00000040:00080000:3.0:1788530425.385787:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].36, 224 off14384 00000040:00080000:3.0:1788530425.385798:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].37, 80 off14464 00000040:00080000:3.0:1788530425.385806:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].38, 224 off14688 00000040:00080000:3.0:1788530425.385813:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].39, 224 off14912 00000040:00080000:3.0:1788530425.385831:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].40, 88 off15000 00000040:00080000:3.0:1788530425.385840:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].41, 128 off15128 00000040:00080000:3.0:1788530425.385846:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].42, 144 off15272 00000040:00080000:3.0:1788530425.385854:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].43, 128 off15400 00000040:00080000:3.0:1788530425.385861:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].44, 224 off15624 00000040:00080000:3.0:1788530425.385868:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].45, 224 off15848 00000040:00080000:3.0:1788530425.385875:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].46, 80 off15928 00000040:00080000:3.0:1788530425.385882:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].47, 224 off16152 00000040:00080000:3.0:1788530425.385889:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].48, 232 off16384 00000100:00100000:3.0:1788530425.385913:0:17890:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17890:1875409555884416:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788530425.385951:0:17890:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530425.385983:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555884416 00000100:00100000:3.0:1788530425.385988:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555884416 00000100:00100000:3.0:1788530425.386017:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788530425.386023:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03753050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+19:17890:x1875409555884416:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788530425.386101:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03753050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+19:17890:x1875409555884416:12345-0@lo:502:mount.lustre.0 Request processed in 77us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530425.386110:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788530425.386146:0:17890:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f08cd5600 going to sleep for 11 seconds 00000100:00100000:3.0:1788530425.386163:0:17890:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17890:1875409555884416:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788530425.386285:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].49, 224 off16608 00000040:00080000:3.0:1788530425.386304:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].50, 120 off16728 00000100:00100000:3.0:1788530425.386319:0:17890:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17890:1875409555884544:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788530425.386351:0:17890:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530425.386372:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555884544 00000100:00100000:3.0:1788530425.386376:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555884544 00000100:00100000:3.0:1788530425.386397:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788530425.386404:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03752050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+19:17890:x1875409555884544:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788530425.386452:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03752050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+19:17890:x1875409555884544:12345-0@lo:502:mount.lustre.0 Request processed in 48us (100us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530425.386456:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788530425.386481:0:17890:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f08cd5600 going to sleep for 11 seconds 00000100:00100000:3.0:1788530425.386490:0:17890:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17890:1875409555884544:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788530425.386514:0:17890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].51, 224 off16952 00000040:00080000:3.0:1788530425.386519:0:17890:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1788530425.397797:0:17909:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1788530425.397821:0:17909:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff9a9f32886620) 00000020:00000080:2.0:1788530425.397854:0:17909:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1788530425.397951:0:17909:0:(tgt_mount.c:167:server_get_mount()) get mount ffff9a9e03637800 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1788530425.397956:0:17909:0:(tgt_mount.c:201:server_put_mount()) put mount ffff9a9e03637800 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1788530425.397959:0:17909:0:(obd_mount.c:712:lustre_put_lsi()) put ffff9a9e03637800 3 00010000:00080000:2.0:1788530425.397991:0:17909:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a9e027ac000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.202.141@tcp at head 00010000:00010000:2.0:1788530425.399708:0:17909:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:2.0:1788530425.399994:0:17909:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:2.0:1788530425.400055:0:17909:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788530425.400080:0:17909:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xb28d70e125751861 00000100:00080000:2.0:1788530425.400093:0:17909:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788530425.400101:0:17909:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9a9e027ac000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:2.0:1788530425.400155:0:17909:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9e03d3fb80 x1875409555884672/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788530425.400203:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875409555884672:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788530425.400338:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530425.400407:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555884672 00000100:00100000:2.0:1788530425.400416:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555884672 00000100:00100000:2.0:1788530425.400452:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788530425.400461:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1875409555884672:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788530425.400494:0:17158:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 633 last 0 00000020:00000080:2.0:1788530425.400529:0:17158:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xb28d70e125751868 00000004:00100000:2.0:1788530425.400544:0:17158:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788530425.401332:0:17909:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788530425.401416:0:12493:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788530425.401422:0:12493:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788530425.401425:0:12493:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788530425.401428:0:12493:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788530425.401503:0:17158:0:(import.c:65:import_set_state_nolock()) ffff9a9e027a9800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788530425.402255:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875409555884672:12345-0@lo:38:llog_process_th.0 Request processed in 1789us (1912us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530425.402268:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:00080000:0.0:1788530425.403369:0:17909:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x20:0x0] index 52 count 51 00000020:01000000:3.0:1788530425.404982:0:17890:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1788530425.405015:0:17890:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788530425.405034:0:17890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d101a00/0xb28d70e12575184c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751853 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530425.405048:0:17890:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f3d101a00/0xb28d70e12575184c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751853 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788530425.405117:0:17890:0:(tgt_mount.c:1239:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788530425.405119:0:17890:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788530425.405120:0:17890:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788530425.405121:0:17890:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:3.0:1788530425.405122:0:17890:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:3.0:1788530425.405124:0:17890:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:3.0:1788530425.405125:0:17890:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788530425.405127:0:17890:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788530425.405133:0:17890:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788530425.405137:0:17890:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:3.0:1788530425.405139:0:17890:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788530425.405140:0:17890:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788530425.405141:0:17890:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788530425.405142:0:17890:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:3.0:1788530425.405143:0:17890:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:3.0:1788530425.405143:0:17890:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:3.0:1788530425.405144:0:17890:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788530425.405145:0:17890:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788530425.405146:0:17890:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788530425.405178:0:17890:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1788530425.405206:0:17890:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17890:1875409555884800:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788530425.405295:0:17890:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530425.405343:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555884800 00000100:00100000:3.0:1788530425.405351:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555884800 00000100:00100000:3.0:1788530425.405400:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788530425.405411:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03750450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+19:17890:x1875409555884800:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788530425.405442:0:17153:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788530425.405457:0:17153:0:(mgs_nids.c:468:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1788530425.405655:0:17890:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f08cd5600 going to sleep for 11 seconds 00010000:00080000:1.0:1788530425.406267:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a9e03d3fb80 x1875409555884672/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788530435 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530425.406281:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788530425.406297:0:3646:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1788530425.406308:0:3646:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788530425.406314:0:3646:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788530425.406319:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9e027ac000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788530425.406328:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875409555884672:0@lo:38:llog_process_th.0 00000001:00100000:0.0:1788530425.411137:0:17139:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:3.0:1788530425.411255:0:17153:0:(mgs_nids.c:833:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788530425.411283:0:17153:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1788530425.411633:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03750450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+19:17890:x1875409555884800:12345-0@lo:253:mount.lustre.0 Request processed in 6218us (6332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530425.411649:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788530425.411730:0:17890:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17890:1875409555884800:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788530425.411749:0:17890:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1788530425.411754:0:17890:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788530425.411757:0:17890:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788530425.411758:0:17890:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788530425.411760:0:17890:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:3.0:1788530425.411774:0:17890:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:3.0:1788530425.411776:0:17890:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:3.0:1788530425.411778:0:17890:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788530425.411781:0:17890:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788530425.411782:0:17890:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788530425.411802:0:17890:0:(tgt_mount.c:2823:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:0.0:1788530425.414731:0:17174:0:(mgs_nids.c:730:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788530425.414770:0:17174:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788530425.414804:0:17174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a9f3d100200/0xb28d70e12575186f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530425.414830:0:17174:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a9f3d36b400/0xb28d70e125751765 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e12575175e expref: 18 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530425.414839:0:17174:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a9f012eb600/0xb28d70e125751837 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125751830 expref: 18 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530425.414848:0:17174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a9f3d100200/0xb28d70e12575186f lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530425.414911:0:17174:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a9f012eb600/0xb28d70e125751837 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb28d70e125751830 expref: 18 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530425.414938:0:17174:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a9f012eb600/0xb28d70e125751837 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb28d70e125751830 expref: 18 pid: 17153 timeout: 733 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530425.414961:0:17174:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03737b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17174:1875409555884928:0@lo:104: 00000100:00100000:0.0:1788530425.415067:0:17174:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788530425.415157:0:17174:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a9f3d36b400/0xb28d70e125751765 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb28d70e12575175e expref: 18 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530425.415165:0:17174:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a9f3d36b400/0xb28d70e125751765 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb28d70e12575175e expref: 18 pid: 17153 timeout: 733 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530425.415175:0:17174:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03734a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17174:1875409555885056:0@lo:104: 00000100:00100000:0.0:1788530425.415199:0:17174:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530425.415491:0:17200:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f09258000 going to sleep for 0 seconds 00000100:00100000:0.0:1788530425.419762:0:17174:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f22132840 going to sleep for 11 seconds 00000100:00100000:0.0:1788530425.419850:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555884928 00000100:00100000:0.0:1788530425.419871:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555884928 00000100:00100000:0.0:1788530425.419920:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555885056 00000100:00100000:0.0:1788530425.419923:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555885056 00000100:00100000:0.0:1788530425.419946:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788530425.419958:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03734380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+4:17174:x1875409555884928:12345-0@lo:104: 00010000:00010000:0.0:1788530425.419983:0:17143:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff9a9f012ea000/0xb28d70e125751830 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e125751837 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530425.420079:0:17143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788530425.420086:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03734380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+4:17174:x1875409555884928:12345-0@lo:104: Request processed in 130us (5021us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530425.420093:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788530425.420115:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788530425.420120:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03737800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+3:17174:x1875409555885056:12345-0@lo:104: 00010000:00010000:0.0:1788530425.420128:0:17143:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff9a9f3d20de00/0xb28d70e12575175e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e125751765 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530425.420162:0:17143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788530425.420247:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03737800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+3:17174:x1875409555885056:12345-0@lo:104: Request processed in 127us (5047us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530425.420254:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1788530425.420272:0:17147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788530425.420279:0:17147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f012ea000/0xb28d70e125751830 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e125751837 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530425.420287:0:17147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f012ea000 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:0.0:1788530425.420291:0:17147:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f012ea000/0xb28d70e125751830 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb28d70e125751837 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530425.420312:0:17147:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f012ea000/0xb28d70e125751830 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb28d70e125751837 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788530425.420320:0:17147:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f012ea000/0xb28d70e125751830 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb28d70e125751837 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788530425.420326:0:17147:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788530425.420367:0:17147:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9f012ea000/0xb28d70e125751830 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125751837 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530425.420374:0:17147:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788530425.420400:0:17147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f012ea000/0xb28d70e125751830 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125751837 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530425.420407:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f012ea000/0xb28d70e125751830 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125751837 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530425.420422:0:17147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788530425.420426:0:17147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f3d20de00/0xb28d70e12575175e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e125751765 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530425.420430:0:17147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d20de00 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:0.0:1788530425.420433:0:17147:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f3d20de00/0xb28d70e12575175e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb28d70e125751765 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530425.420439:0:17147:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f3d20de00/0xb28d70e12575175e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb28d70e125751765 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788530425.420445:0:17147:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f3d20de00/0xb28d70e12575175e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb28d70e125751765 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788530425.420455:0:17147:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788530425.420470:0:17147:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9f3d20de00/0xb28d70e12575175e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125751765 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530425.420475:0:17147:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788530425.420492:0:17147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f3d20de00/0xb28d70e12575175e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125751765 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530425.420498:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f3d20de00/0xb28d70e12575175e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125751765 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530425.420513:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530425.420514:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530425.420515:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788530425.420530:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03736300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:3648:1875409555885184:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788530425.421381:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530425.421467:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03735c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:3649:1875409555885312:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788530425.421501:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530425.421551:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555885184 00000100:00100000:0.0:1788530425.421557:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555885184 00010000:00010000:0.0:1788530425.421616:0:17145:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a9f012eb600/0xb28d70e125751837 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e125751830 expref: 19 pid: 17153 timeout: 733 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530425.421642:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555885312 00000100:00100000:0.0:1788530425.421646:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555885312 00010000:00010000:0.0:1788530425.421658:0:17145:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a9f3d36b400/0xb28d70e125751765 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e12575175e expref: 20 pid: 17153 timeout: 733 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530425.421671:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788530425.421690:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03736a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+20:3648:x1875409555885184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788530425.421703:0:17145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788530425.421709:0:17145:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a9f012eb600/0xb28d70e125751837 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e125751830 expref: 20 pid: 17153 timeout: 733 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530425.421721:0:17145:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a9f012eb600/0xb28d70e125751837 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb28d70e125751830 expref: 20 pid: 17153 timeout: 733 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530425.421743:0:17145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788530425.421778:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03736a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+20:3648:x1875409555885184:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530425.421785:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788530425.421802:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788530425.421808:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03734000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+19:3649:x1875409555885312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788530425.421816:0:17145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788530425.421820:0:17145:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a9f3d36b400/0xb28d70e125751765 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e12575175e expref: 19 pid: 17153 timeout: 733 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530425.423046:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530425.425950:0:17145:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a9f3d36b400/0xb28d70e125751765 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb28d70e12575175e expref: 19 pid: 17153 timeout: 733 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530425.425985:0:17145:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a9f3d100200/0xb28d70e12575186f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530425.425995:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f3d100200/0xb28d70e12575186f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788530425.426015:0:17145:0:(mgs_nids.c:706:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.011245978s 00010000:00010000:0.0:1788530425.426022:0:17145:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a9f3d100200/0xb28d70e12575186f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530425.426039:0:17145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a9f3d100200/0xb28d70e12575186f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530425.426046:0:17145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a9f3d100200/0xb28d70e12575186f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530425.426053:0:17145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a9f3d100200/0xb28d70e12575186f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530425.426061:0:17145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d100200 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:0.0:1788530425.426067:0:17145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a9f3d100200/0xb28d70e12575186f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530425.426076:0:17145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a9f3d100200/0xb28d70e12575186f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530425.426086:0:17145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a9f3d100200/0xb28d70e12575186f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530425.426096:0:17145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788530425.426197:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03734000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+19:3649:x1875409555885312:12345-0@lo:103:ldlm_bl.0 Request processed in 4387us (4693us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530425.426211:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788530425.426536:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03735c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:3649:1875409555885312:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788530425.426624:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03736300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:3648:1875409555885184:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788530425.426656:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f012eb600/0xb28d70e125751837 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb28d70e125751830 expref: 18 pid: 17153 timeout: 733 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530425.426683:0:17174:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03737b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17174:1875409555884928:0@lo:104: 00010000:00010000:0.0:1788530425.426699:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f3d36b400/0xb28d70e125751765 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb28d70e12575175e expref: 17 pid: 17153 timeout: 733 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530425.426707:0:17174:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03734a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17174:1875409555885056:0@lo:104: 00010000:00010000:0.0:1788530425.426723:0:17174:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a9f3d100200/0xb28d70e12575186f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530425.426733:0:17174:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a9f3d100200/0xb28d70e12575186f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530425.426740:0:17174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a9f3d100200/0xb28d70e12575186f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530425.426746:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f3d100200/0xb28d70e12575186f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:01000000:2.0:1788530425.438086:0:17890:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:3.0:1788530425.439653:0:17915:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:3.0:1788530425.439660:0:17915:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:3.0:1788530425.443460:0:17916:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:3.0:1788530425.444060:0:17916:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788530425.447257:0:17916:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788530425.447375:0:17916:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000040:01000000:3.0:1788530425.447731:0:17890:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:1.0:1788530425.448216:0:17917:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37374e00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17917:1875409555885440:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788530425.448325:0:17917:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530425.448376:0:17917:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f03e8ba80 going to sleep for 11 seconds 00000040:01000000:3.0:1788530425.448621:0:17890:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:3.0:1788530425.448673:0:17890:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788530425.449208:0:17890:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788530425.449216:0:17890:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:3.0:1788530425.449261:0:17890:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788530425.449687:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555885440 00000100:00100000:0.0:1788530425.449698:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555885440 00000100:00100000:0.0:1788530425.449780:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788530425.449791:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37377b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17917:x1875409555885440:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788530425.450039:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37377b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17917:x1875409555885440:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 249us (1714us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530425.450048:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788530425.450146:0:17917:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37374e00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17917:1875409555885440:0@lo:1000:lod0001_rec0000.0 00000040:01000000:1.0:1788530425.450187:0:17917:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1788530425.450231:0:17917:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37374e00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17917:1875409555885568:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788530425.450270:0:17917:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530425.450301:0:17917:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f03e8b840 going to sleep for 11 seconds 00000100:00100000:0.0:1788530425.450342:0:17899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555885568 00000100:00100000:0.0:1788530425.450347:0:17899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555885568 00000100:00100000:0.0:1788530425.450376:0:17899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788530425.450383:0:17899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37376a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17917:x1875409555885568:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788530425.450496:0:17899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37376a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17917:x1875409555885568:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 113us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530425.450503:0:17899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788530425.450527:0:17917:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37374e00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17917:1875409555885568:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788530425.450620:0:17917:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03734a80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17917:1875409555885696:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1788530425.450651:0:17917:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530425.450673:0:17917:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f17dadb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788530425.451737:0:17169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555885696 00000100:00100000:0.0:1788530425.451753:0:17169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555885696 00000040:00080000:3.0:1788530425.451948:0:17890:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788530425.452492:0:17890:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788530425.452529:0:17890:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:3.0:1788530425.452807:0:17890:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788530425.452940:0:17169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788530425.452954:0:17169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03737b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17917:x1875409555885696:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1788530425.453073:0:17169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03737b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17917:x1875409555885696:12345-0@lo:900:lod0001_rec0000.0 Request processed in 122us (2419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530425.453081:0:17169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00080000:10000000:3.0:1788530425.453810:0:17890:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00010000:00080000:1.0:1788530425.454943:0:17917:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a9e03734a80 x1875409555885696/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788530441 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530425.454964:0:17917:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03734a80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17917:1875409555885696:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1788530425.455091:0:17917:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37374a80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17917:1875409555885824:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788530425.455178:0:17917:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530425.455268:0:17917:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f18162180 going to sleep for 11 seconds 00000100:00100000:2.0:1788530425.455458:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555885824 00000100:00100000:2.0:1788530425.455467:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555885824 00000100:00100000:2.0:1788530425.455552:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788530425.455596:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37374380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17917:x1875409555885824:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788530425.455700:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37374380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17917:x1875409555885824:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 138us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530425.455718:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788530425.455789:0:17917:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37374a80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17917:1875409555885824:0@lo:1000:lod0001_rec0000.0 00000040:00080000:1.0:1788530425.455854:0:17917:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788530425.457931:0:17917:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788530425.458030:0:17917:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788530425.458036:0:17917:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00000004:3.0:1788530425.459387:0:17890:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1788530425.476481:0:17890:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788530425.476523:0:17890:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb37801c2f9b8 00100000:10000000:3.0:1788530425.476532:0:17890:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:3.0:1788530425.477718:0:17890:0:(tgt_mount.c:2543:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1788530425.477740:0:17890:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:3.0:1788530425.478459:0:17890:0:(tgt_mount.c:2429:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788530425.478731:0:17890:0:(tgt_mount.c:2444:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788530425.920815:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788530426.446782:0:17200:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f09258000 going to sleep for 0 seconds 00000040:00080000:2.0:1788530426.511792:0:17913:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:0.0:1788530426.818099:0:17156:0:(mgc_request.c:715:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788530426.818108:0:17156:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-mdtir-ffff9a9e03637800 from 8 10000000:01000000:0.0:1788530426.818113:0:17156:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788530426.818164:0:17156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d100a00/0xb28d70e125751876 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530426.818176:0:17156:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f3d100a00/0xb28d70e125751876 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530426.818190:0:17156:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f3d100a00/0xb28d70e125751876 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530426.818216:0:17156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03736300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17156:1875409555885952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788530426.818311:0:17156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530426.818353:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f17dad0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788530426.818470:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555885952 00000100:00100000:3.0:1788530426.818485:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555885952 00000100:00100000:3.0:1788530426.818544:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788530426.818600:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03751050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+17:17156:x1875409555885952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788530426.818615:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788530426.818629:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f3d36a600/0xb28d70e12575187d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e125751876 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530426.818652:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f3d36a600/0xb28d70e12575187d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e125751876 expref: 18 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530426.818663:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f3d36a600/0xb28d70e12575187d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125751876 expref: 18 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530426.818673:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d36a600, rc 0) 00000100:00100000:3.0:1788530426.818717:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03751050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+18:17156:x1875409555885952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530426.818724:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788530426.818832:0:17156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03736300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17156:1875409555885952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788530426.818849:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f3d100a00/0xb28d70e125751876 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575187d expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530426.818860:0:17156:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f3d100a00/0xb28d70e125751876 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e12575187d expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530426.818917:0:17156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d3d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17156:1875409555886080:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788530426.818950:0:17156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530426.818978:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f03ac33c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788530426.819025:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555886080 00000100:00100000:3.0:1788530426.819030:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555886080 00000100:00100000:3.0:1788530426.819072:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788530426.819079:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03751450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+18:17156:x1875409555886080:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788530426.819095:0:17153:0:(mgs_nids.c:1159:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788530426.819113:0:17153:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788530426.819116:0:17153:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1788530426.819196:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03751450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+18:17156:x1875409555886080:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 117us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530426.819204:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788530426.819234:0:17156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d3d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17156:1875409555886080:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788530426.819293:0:17156:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788530426.819300:0:17156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d100a00/0xb28d70e125751876 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575187d expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530426.819308:0:17156:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f3d100a00/0xb28d70e125751876 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575187d expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788530426.819320:0:17156:0:(mgc_request.c:715:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788530426.819322:0:17156:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-mdtir-ffff9a9f202a8800 from 8 10000000:01000000:3.0:1788530426.819325:0:17156:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788530426.819344:0:17156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36bc00/0xb28d70e125751884 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530426.819351:0:17156:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36bc00/0xb28d70e125751884 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530426.819359:0:17156:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36bc00/0xb28d70e125751884 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530426.819372:0:17156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17156:1875409555886208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788530426.819396:0:17156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530426.819410:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e02768540 going to sleep for 11 seconds 00000100:00100000:3.0:1788530426.819421:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555886208 00000100:00100000:3.0:1788530426.819424:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555886208 00000100:00100000:3.0:1788530426.819442:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788530426.819447:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03753c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+18:17156:x1875409555886208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788530426.819454:0:17153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788530426.819462:0:17153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f3d36b600/0xb28d70e12575188b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e125751884 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530426.819488:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f3d36b600/0xb28d70e12575188b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e125751884 expref: 19 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530426.819496:0:17153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f3d36b600/0xb28d70e12575188b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125751884 expref: 19 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530426.819503:0:17153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d36b600, rc 0) 00000100:00100000:3.0:1788530426.819530:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03753c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+19:17156:x1875409555886208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 83us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530426.819536:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788530426.819598:0:17156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17156:1875409555886208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788530426.819610:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36bc00/0xb28d70e125751884 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575188b expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530426.819617:0:17156:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36bc00/0xb28d70e125751884 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e12575188b expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530426.819654:0:17156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17156:1875409555886336:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788530426.819679:0:17156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530426.819692:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e02768540 going to sleep for 11 seconds 00000100:00100000:3.0:1788530426.819702:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555886336 00000100:00100000:3.0:1788530426.819705:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555886336 00000100:00100000:3.0:1788530426.819724:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788530426.819729:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03751850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+19:17156:x1875409555886336:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788530426.819738:0:17153:0:(mgs_nids.c:1159:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788530426.819749:0:17153:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788530426.819755:0:17153:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1788530426.819815:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03751850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+19:17156:x1875409555886336:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 85us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530426.819822:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788530426.819848:0:17156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17156:1875409555886336:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788530426.819877:0:17156:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788530426.819883:0:17156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36bc00/0xb28d70e125751884 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575188b expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530426.819890:0:17156:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36bc00/0xb28d70e125751884 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575188b expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530426.944717:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788530427.463726:0:17200:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f09258000 going to sleep for 0 seconds 00000040:00080000:2.0:1788530427.522704:0:17913:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788530427.968884:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788530428.417695:0:17192:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788530428.481081:0:17200:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f09258000 going to sleep for 0 seconds 00010000:00010000:1.0:1788530428.997444:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788530429.510759:0:17200:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f09258000 going to sleep for 0 seconds 00010000:00010000:0.0:1788530430.016833:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788530430.529664:0:17200:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f09258000 going to sleep for 0 seconds 00000100:00100000:3.0:1788530430.532689:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788530430.532713:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555886464:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788530430.532801:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788530430.532878:0:476:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788530430.532882:0:476:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788530430.532885:0:476:0:(import.c:65:import_set_state_nolock()) ffff9a9e0258b800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788530430.532893:0:476:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9a9e0258b800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:3.0:1788530430.532914:0:476:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9f328e4700 x1875409555886720/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788530430.532930:0:476:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788530430.532934:0:476:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788530430.532937:0:476:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788530430.532948:0:476:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788530430.532962:0:476:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788530430.532966:0:476:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788530430.532969:0:476:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788530430.532971:0:476:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788530430.533002:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875409555886848:0@lo:400:kworker.0 00000100:00100000:3.0:1788530430.533037:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530430.533065:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788530430.533070:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:3648:1875409555886592:0@lo:400:kworker.0 00000100:00100000:3.0:1788530430.533099:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530430.533137:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555886848 00000100:00100000:3.0:1788530430.533147:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555886848 00000100:00100000:3.0:1788530430.533198:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788530430.533206:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f328e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875409555886848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530430.533253:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f328e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875409555886848:12345-0@lo:400:kworker.0 Request processed in 47us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530430.533260:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788530430.533281:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555886592 00000100:00100000:3.0:1788530430.533297:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555886592 00000100:00100000:3.0:1788530430.533325:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788530430.533332:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03cff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+19:3648:x1875409555886592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530430.533371:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03cff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+19:3648:x1875409555886592:12345-0@lo:400:kworker.0 Request processed in 39us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530430.533378:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788530430.533419:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875409555886720:0@lo:38:kworker.0 00000100:00100000:3.0:1788530430.533444:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530430.533493:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:3648:1875409555886592:0@lo:400:kworker.0 00010000:00080000:3.0:1788530430.533506:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a9f328e6680 x1875409555886848/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530446 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530430.533529:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875409555886848:0@lo:400:kworker.0 00000100:00100000:3.0:1788530430.533583:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875409555886976:0@lo:400:kworker.0 00000100:00100000:3.0:1788530430.533611:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530430.533637:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555886976 00000100:00100000:3.0:1788530430.533641:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555886976 00000100:00100000:3.0:1788530430.533663:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788530430.533669:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f328e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875409555886976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530430.533703:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f328e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875409555886976:12345-0@lo:400:kworker.0 Request processed in 34us (91us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530430.533709:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788530430.533731:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a9f328e5180 x1875409555886976/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530446 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530430.533741:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875409555886976:0@lo:400:kworker.0 00000100:00100000:2.0:1788530430.535325:0:17899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555886464 00000100:00100000:2.0:1788530430.535337:0:17899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555886464 00000100:00100000:2.0:1788530430.535402:0:17899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555886720 00000100:00100000:2.0:1788530430.535406:0:17899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555886720 00000100:00100000:2.0:1788530430.535421:0:17899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788530430.535430:0:17899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f328e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555886464:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788530430.535464:0:17899:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788530430.535741:0:17899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f328e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555886464:12345-0@lo:41:osp-pre-0-1.0 Request processed in 312us (2941us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530430.535749:0:17899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788530430.535769:0:17899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788530430.535774:0:17899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f328e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3646:x1875409555886720:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788530430.535832:0:17899:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 638 last 0 00000020:00000080:2.0:1788530430.535873:0:17899:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb28d70e125751892 00000004:00100000:2.0:1788530430.535892:0:17899:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1788530430.535900:0:17899:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:2.0:1788530430.536048:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555886464:0@lo:41:osp-pre-0-1.0 00000100:00080000:0.0:1788530430.588120:0:17899:0:(import.c:65:import_set_state_nolock()) ffff9a9f0d6f0000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788530430.588345:0:17899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f328e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3646:x1875409555886720:12345-0@lo:38:kworker.0 Request processed in 52566us (54896us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530430.588358:0:17899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1788530430.598876:0:3646:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788530430.598892:0:3646:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1788530430.598900:0:3646:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788530430.598903:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9e0258b800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1788530430.598936:0:3646:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000008215b4c6): req@ffff9a9f328e6d80 x1875409555879040/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530430.599664:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37374a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555887104:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788530430.599750:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530430.603968:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875409555886720:0@lo:38:kworker.0 00000100:00100000:3.0:1788530430.604044:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555887104 00000100:00100000:3.0:1788530430.604058:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555887104 00000100:00100000:3.0:1788530430.604129:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788530430.604140:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37374000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3650:x1875409555887104:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788530430.604184:0:17163:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788530430.604283:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37374000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3650:x1875409555887104:12345-0@lo:41:osp-pre-1-0.0 Request processed in 143us (4533us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530430.604290:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788530430.604370:0:17200:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530430.604409:0:17200:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f09258000 going to sleep for 11 seconds 00000100:00100000:0.0:1788530430.604942:0:17899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555879040 00000100:00100000:0.0:1788530430.604949:0:17899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555879040 00000100:00100000:0.0:1788530430.604996:0:17899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788530430.605005:0:17899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f328e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17200:x1875409555879040:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788530430.605111:0:17899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f328e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17200:x1875409555879040:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 106us (740us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530430.605117:0:17899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788530430.605706:0:17200:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e6d80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17200:1875409555879040:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1788530430.605752:0:17200:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1788530430.606631:0:17200:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e6d80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17200:1875409555887232:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788530430.606759:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37374a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555887104:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788530430.607299:0:17200:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530430.607349:0:17200:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f03d76900 going to sleep for 11 seconds 00000100:00100000:1.0:1788530430.608404:0:17899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555887232 00000100:00100000:1.0:1788530430.608414:0:17899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555887232 00000100:00100000:1.0:1788530430.608465:0:17899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788530430.608473:0:17899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f328e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17200:x1875409555887232:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788530430.608871:0:17899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f328e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17200:x1875409555887232:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 398us (1573us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530430.608879:0:17899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788530430.609394:0:17200:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e6d80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17200:1875409555887232:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788530430.609511:0:17200:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e6d80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17200:1875409555887360:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788530430.609587:0:17200:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530430.609615:0:17200:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f03d76000 going to sleep for 11 seconds 00000100:00100000:1.0:1788530430.609652:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555887360 00000100:00100000:1.0:1788530430.609658:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555887360 00000100:00100000:1.0:1788530430.609704:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788530430.609714:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f328e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17200:x1875409555887360:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788530430.609807:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f328e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17200:x1875409555887360:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 94us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530430.609833:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788530430.610291:0:17200:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e6d80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17200:1875409555887360:0@lo:1000:lod0000_rec0001.0 00000040:00080000:0.0:1788530430.610355:0:17200:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788530430.612368:0:17200:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788530430.612457:0:17200:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 24, retries 0 00000004:00080000:0.0:1788530430.612464:0:17200:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:1.0:1788530431.047642:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788530431.488270:0:18160:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg241-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1788530431.566371:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788530416/real 1788530416] req@ffff9a9e03735180 x1875409555880064/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788530431 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530431.566779:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a9e03735180 x1875409555880064/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788530431 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530431.566791:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788530416/real 1788530416] req@ffff9a9e03735f80 x1875409555880192/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788530431 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530431.566804:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a9e03735f80 x1875409555880192/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788530431 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788530431.566825:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9e024dd000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788530431.566844:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788530431.566847:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03735180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875409555880064:0@lo:8:kworker.0 00000100:00080000:1.0:1788530431.566902:0:476:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788530431.566906:0:476:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788530431.566908:0:476:0:(import.c:65:import_set_state_nolock()) ffff9a9e024dd000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788530431.566912:0:476:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 624 00000100:00080000:1.0:1788530431.566917:0:476:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788530431.566923:0:476:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9a9e024dd000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:1.0:1788530431.566940:0:476:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9f37375c00 x1875409555887744/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788530431.566949:0:476:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788530431.566952:0:476:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788530431.566988:0:476:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788530431.566991:0:476:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788530431.566994:0:476:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788530431.566997:0:476:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788530431.567022:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37374a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:3647:1875409555887488:0@lo:400:kworker.0 00000100:00100000:1.0:1788530431.567082:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530431.567117:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37376d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875409555888128:0@lo:400:kworker.0 00000100:00100000:1.0:1788530431.567139:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530431.567159:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788530431.567164:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37374e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555887616:0@lo:400:kworker.0 00000100:00100000:1.0:1788530431.567184:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530431.567209:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37377800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875409555887872:0@lo:400:kworker.0 00000100:00100000:1.0:1788530431.567230:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530431.567244:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788530431.567248:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37376300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555888000:0@lo:400:kworker.0 00000100:00100000:1.0:1788530431.567263:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530431.567292:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555888128 00000100:00100000:1.0:1788530431.567302:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555888128 00000100:00100000:1.0:1788530431.567362:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555887872 00000100:00100000:1.0:1788530431.567365:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555887872 00000100:00100000:1.0:1788530431.567381:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788530431.567389:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37375180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875409555888128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530431.568155:0:17160:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788530431.568167:0:17160:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1788530431.568187:0:17899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555887616 00000100:00100000:3.0:1788530431.568202:0:17899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555887616 00000100:00100000:3.0:1788530431.568236:0:17899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555888000 00000100:00100000:3.0:1788530431.568238:0:17899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555888000 00000100:00100000:3.0:1788530431.568250:0:17899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788530431.568258:0:17899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37376680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3647:x1875409555887616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530431.568331:0:17899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37376680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3647:x1875409555887616:12345-0@lo:400:kworker.0 Request processed in 74us (1144us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530431.568339:0:17899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788530431.568369:0:17899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788530431.568375:0:17899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37374700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555888000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530431.568910:0:17899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37374700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555888000:12345-0@lo:400:kworker.0 Request processed in 28us (1138us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530431.568920:0:17899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:3.0:1788530431.568957:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9f37411800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788530431.568973:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788530431.568978:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03735f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875409555880192:0@lo:8:kworker.0 00000100:00100000:3.0:1788530431.569012:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37375c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875409555887744:0@lo:8:kworker.0 00000400:00000100:3.0:1788530431.569056:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875409555887744 offset 0 length 520: 4 00000100:00100000:3.0:1788530431.569147:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37374e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555887616:0@lo:400:kworker.0 00000100:00100000:3.0:1788530431.569287:0:17159:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788530431.569297:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788530431.569308:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37375500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875409555887872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530431.569713:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37375500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875409555887872:12345-0@lo:400:kworker.0 Request processed in 407us (2480us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530431.569720:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1788530431.569906:0:476:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788530431.569911:0:476:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788530431.569914:0:476:0:(import.c:65:import_set_state_nolock()) ffff9a9f37411800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788530431.569919:0:476:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 624 00000100:00080000:3.0:1788530431.569924:0:476:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788530431.569929:0:476:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a9f37411800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:3.0:1788530431.569965:0:476:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9f328e7800 x1875409555888256/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788530431.569985:0:476:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788530431.569991:0:476:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788530431.569994:0:476:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788530431.569997:0:476:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788530431.570018:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875409555888256:0@lo:8:kworker.0 00000400:00000100:3.0:1788530431.570049:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875409555888256 offset 0 length 520: 4 00000100:00100000:3.0:1788530431.570097:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37376300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555888000:0@lo:400:kworker.0 00010000:00080000:3.0:1788530431.570108:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a9f37377800 x1875409555887872/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530447 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530431.570118:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37377800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875409555887872:0@lo:400:kworker.0 00000100:00100000:1.0:1788530431.570326:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37375180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875409555888128:12345-0@lo:400:kworker.0 Request processed in 2934us (3183us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530431.570335:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1788530431.570623:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a9f37376d80 x1875409555888128/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530447 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530431.570634:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37376d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875409555888128:0@lo:400:kworker.0 00000100:00100000:1.0:1788530431.573821:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555887488 00000100:00100000:1.0:1788530431.573840:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555887488 00000100:00100000:1.0:1788530431.573911:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788530431.573924:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03cfec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+19:3647:x1875409555887488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530431.574054:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03cfec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+19:3647:x1875409555887488:12345-0@lo:400:kworker.0 Request processed in 132us (6970us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530431.574062:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788530431.574148:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37374a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:3647:1875409555887488:0@lo:400:kworker.0 00010000:00010000:3.0:1788530432.064744:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788530432.576409:0:18213:0:(tgt_mount.c:2429:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788530432.576670:0:18213:0:(tgt_mount.c:2444:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788530433.093863:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788530433.672518:0:18264:0:(tgt_mount.c:2429:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788530433.674383:0:18264:0:(tgt_mount.c:2444:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788530434.115913:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788530434.818902:0:18312:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd1e64df10 20000000:00000080:2.0:1788530434.818927:0:18312:0:(mgs_handler.c:1172:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a9f041c8c00 uarg=0000000000000000 20000000:01000000:2.0:1788530434.818979:0:18312:0:(mgs_llog.c:6198:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1788530434.818990:0:18312:0:(mgs_llog.c:4653:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1788530434.818997:0:18312:0:(mgs_llog.c:1385:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1788530434.819552:0:18313:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:2.0:1788530434.819892:0:18312:0:(mgs_llog.c:1456:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788530434.825737:0:18312:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788530434.825838:0:18312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a9f3d20c600/0xb28d70e125751899 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530434.825967:0:18312:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a9f3d100400/0xb28d70e125751734 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e12575172d expref: 18 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530434.825993:0:18312:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a9f012eb800/0xb28d70e125751845 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e12575183e expref: 18 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530434.826002:0:18312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a9f3d20c600/0xb28d70e125751899 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530434.826049:0:18312:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a9f012eb800/0xb28d70e125751845 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb28d70e12575183e expref: 18 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530434.826066:0:18312:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a9f012eb800/0xb28d70e125751845 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb28d70e12575183e expref: 18 pid: 17153 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530434.826098:0:18312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d3f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18312:1875409555888384:0@lo:104: 00000100:00100000:2.0:1788530434.826178:0:18312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788530434.826351:0:18312:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a9f3d100400/0xb28d70e125751734 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb28d70e12575172d expref: 18 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530434.826359:0:18312:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a9f3d100400/0xb28d70e125751734 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb28d70e12575172d expref: 18 pid: 17151 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530434.826367:0:18312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d3ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18312:1875409555888512:0@lo:104: 00000100:00100000:2.0:1788530434.826392:0:18312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530434.826523:0:18312:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e03639e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788530434.826657:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555888384 00000100:00100000:0.0:1788530434.826666:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555888384 00000100:00100000:0.0:1788530434.826710:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555888512 00000100:00100000:0.0:1788530434.826713:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555888512 00000100:00100000:0.0:1788530434.826728:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788530434.826904:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d3e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+4:18312:x1875409555888384:12345-0@lo:104: 00010000:00010000:0.0:1788530434.826919:0:17142:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff9a9f3d101600/0xb28d70e12575183e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e125751845 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530434.826989:0:17142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788530434.826995:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d3e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+4:18312:x1875409555888384:12345-0@lo:104: Request processed in 97us (819us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530434.827002:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788530434.827024:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788530434.827031:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d3d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+3:18312:x1875409555888512:12345-0@lo:104: 00010000:00010000:0.0:1788530434.827038:0:17142:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b800/0xb28d70e12575172d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e125751734 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530434.827071:0:17142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788530434.827076:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d3d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+3:18312:x1875409555888512:12345-0@lo:104: Request processed in 47us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530434.827082:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1788530434.827098:0:17147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788530434.827104:0:17147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f3d101600/0xb28d70e12575183e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e125751845 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530434.827111:0:17147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d101600 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:0.0:1788530434.827115:0:17147:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f3d101600/0xb28d70e12575183e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb28d70e125751845 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530434.827124:0:17147:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f3d101600/0xb28d70e12575183e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb28d70e125751845 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788530434.827130:0:17147:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f3d101600/0xb28d70e12575183e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb28d70e125751845 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788530434.827142:0:17147:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:2.0:1788530434.827305:0:18312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d3f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18312:1875409555888384:0@lo:104: 00000100:00100000:2.0:1788530434.827315:0:18312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d3ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18312:1875409555888512:0@lo:104: 00010000:00010000:2.0:1788530434.827339:0:18312:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a9f3d20c600/0xb28d70e125751899 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530434.827384:0:17147:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9f3d101600/0xb28d70e12575183e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125751845 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530434.827391:0:17147:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788530434.827424:0:17147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f3d101600/0xb28d70e12575183e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125751845 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530434.827431:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f3d101600/0xb28d70e12575183e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125751845 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530434.827445:0:17147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788530434.827448:0:17147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b800/0xb28d70e12575172d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e125751734 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530434.827454:0:17147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d36b800 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:0.0:1788530434.827457:0:17147:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b800/0xb28d70e12575172d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb28d70e125751734 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530434.827464:0:17147:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b800/0xb28d70e12575172d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb28d70e125751734 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788530434.827470:0:17147:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b800/0xb28d70e12575172d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb28d70e125751734 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788530434.827487:0:17147:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788530434.827503:0:17147:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b800/0xb28d70e12575172d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125751734 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530434.827508:0:17147:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788530434.827530:0:17147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b800/0xb28d70e12575172d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125751734 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530434.827537:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b800/0xb28d70e12575172d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125751734 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530434.827550:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530434.827552:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530434.827554:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788530434.827602:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03737480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:3649:1875409555888768:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788530434.827640:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530434.827684:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555888768 00000100:00100000:0.0:1788530434.827689:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555888768 00010000:00010000:0.0:1788530434.827709:0:17144:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a9f3d100400/0xb28d70e125751734 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e12575172d expref: 19 pid: 17151 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530434.827732:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788530434.827864:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03735c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:3648:1875409555888640:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788530434.827892:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530434.827940:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03737100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+19:3649:x1875409555888768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788530434.827953:0:17144:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788530434.827958:0:17144:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a9f3d100400/0xb28d70e125751734 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e12575172d expref: 19 pid: 17151 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530434.827967:0:17144:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a9f3d100400/0xb28d70e125751734 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb28d70e12575172d expref: 19 pid: 17151 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530434.827980:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f3d100400/0xb28d70e125751734 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb28d70e12575172d expref: 19 pid: 17151 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530434.827992:0:17144:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788530434.828065:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03737100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+18:3649:x1875409555888768:12345-0@lo:103:ldlm_bl.0 Request processed in 326us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530434.828080:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788530434.828096:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555888640 00000100:00100000:0.0:1788530434.828099:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555888640 00010000:00010000:0.0:1788530434.828111:0:17144:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a9f012eb800/0xb28d70e125751845 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e12575183e expref: 18 pid: 17153 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530434.828124:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788530434.828130:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+18:3648:x1875409555888640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788530434.828138:0:17144:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788530434.828143:0:17144:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a9f012eb800/0xb28d70e125751845 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e12575183e expref: 18 pid: 17153 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530434.828152:0:17144:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a9f012eb800/0xb28d70e125751845 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb28d70e12575183e expref: 18 pid: 17153 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530434.828162:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f012eb800/0xb28d70e125751845 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb28d70e12575183e expref: 18 pid: 17153 timeout: 742 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530434.828173:0:17144:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a9f3d20c600/0xb28d70e125751899 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530434.828181:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f3d20c600/0xb28d70e125751899 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530434.828208:0:17144:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a9f3d20c600/0xb28d70e125751899 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530434.828217:0:17144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a9f3d20c600/0xb28d70e125751899 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530434.828234:0:17144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a9f3d20c600/0xb28d70e125751899 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530434.828241:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a9f3d20c600/0xb28d70e125751899 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530434.828246:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d20c600 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:0.0:1788530434.828251:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a9f3d20c600/0xb28d70e125751899 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530434.828258:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a9f3d20c600/0xb28d70e125751899 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530434.828272:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a9f3d20c600/0xb28d70e125751899 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530434.828282:0:17144:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788530434.828313:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+17:3648:x1875409555888640:12345-0@lo:103:ldlm_bl.0 Request processed in 183us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530434.828320:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788530434.828352:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03735c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:3648:1875409555888640:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788530434.828869:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788530434.829126:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03737480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:3649:1875409555888768:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788530434.829169:0:18312:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a9f3d20c600/0xb28d70e125751899 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530434.829190:0:18312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a9f3d20c600/0xb28d70e125751899 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530434.829263:0:18312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f3d20c600/0xb28d70e125751899 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530435.145158:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788530435.651044:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788530425/real 1788530425] req@ffff9a9e03736d80 x1875409555882880/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788530435 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530435.651085:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a9e03736d80 x1875409555882880/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788530435 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530435.651096:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788530425/real 1788530425] req@ffff9a9e03d3df80 x1875409555882752/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788530435 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530435.651140:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a9e03d3df80 x1875409555882752/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788530435 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788530435.651162:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9f0d6f0800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788530435.651235:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788530435.651239:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03736d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875409555882880:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788530435.651245:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9f08ce8000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788530435.651251:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788530435.651254:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875409555882752:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1788530435.653663:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788530435.653684:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03736d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555888896:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788530435.653773:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530435.653822:0:17899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555888896 00000100:00100000:0.0:1788530435.653831:0:17899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555888896 00000100:00100000:0.0:1788530435.653892:0:17899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788530435.653902:0:17899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03735c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555888896:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788530435.653941:0:17899:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788530435.653987:0:17899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03735c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555888896:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530435.653994:0:17899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788530435.654045:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03736d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555888896:0@lo:41:osp-pre-0-1.0 00000100:00080000:1.0:1788530435.654232:0:12493:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788530435.654237:0:12493:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788530435.654241:0:12493:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788530435.654244:0:12493:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788530435.654255:0:12493:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788530435.654258:0:12493:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788530435.654262:0:12493:0:(import.c:65:import_set_state_nolock()) ffff9a9f08ce8000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788530435.654270:0:12493:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 633 00000100:00080000:1.0:1788530435.654274:0:12493:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788530435.654279:0:12493:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9a9f08ce8000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:1.0:1788530435.654332:0:12493:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9f37377800 x1875409555889408/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788530435.654347:0:12493:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788530435.654351:0:12493:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788530435.654352:0:12493:0:(import.c:65:import_set_state_nolock()) ffff9a9f0d6f0800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788530435.654356:0:12493:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 633 00000100:00080000:1.0:1788530435.654359:0:12493:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788530435.654363:0:12493:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9a9f0d6f0800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:1.0:1788530435.654376:0:12493:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9f37376300 x1875409555889536/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788530435.654612:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37374a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:3647:1875409555889024:0@lo:400:kworker.0 00000100:00100000:1.0:1788530435.654656:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530435.654691:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788530435.654698:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37376d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555889152:0@lo:400:kworker.0 00000100:00100000:1.0:1788530435.654722:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530435.654808:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788530435.654816:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03736d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555889792:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788530435.654849:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37377100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875409555889280:0@lo:400:kworker.0 00000100:00100000:0.0:1788530435.654886:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530435.654909:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788530435.654915:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37374e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875409555889664:0@lo:400:kworker.0 00000100:00100000:0.0:1788530435.654933:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530435.654968:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555889280 00000100:00100000:0.0:1788530435.654973:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555889280 00000100:00100000:3.0:1788530435.657285:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555889024 00000100:00100000:3.0:1788530435.657297:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555889024 00000100:00100000:3.0:1788530435.657348:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788530435.657358:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03cffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+17:3647:x1875409555889024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530435.657450:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03cffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+17:3647:x1875409555889024:12345-0@lo:400:kworker.0 Request processed in 93us (2793us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530435.657459:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788530435.658785:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37377800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875409555889408:0@lo:8:kworker.0 00000400:00000100:2.0:1788530435.658856:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875409555889408 offset 0 length 520: 4 00000100:00100000:2.0:1788530435.658922:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37376300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875409555889536:0@lo:8:kworker.0 00000400:00000100:2.0:1788530435.658947:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875409555889536 offset 0 length 520: 4 00000100:00100000:1.0:1788530435.659590:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37374a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:3647:1875409555889024:0@lo:400:kworker.0 00000100:00100000:2.0:1788530435.660439:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530435.660977:0:17899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555889152 00000100:00100000:0.0:1788530435.660985:0:17899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555889152 00000100:00100000:0.0:1788530435.661184:0:17899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555889792 00000100:00100000:0.0:1788530435.661188:0:17899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555889792 00000100:00100000:2.0:1788530435.661411:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788530435.661424:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3647:x1875409555889152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530435.661515:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3647:x1875409555889152:12345-0@lo:400:kworker.0 Request processed in 94us (6790us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530435.661522:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788530435.661856:0:17899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788530435.661866:0:17899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3648:x1875409555889792:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788530435.662048:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555889664 00000100:00100000:3.0:1788530435.662055:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555889664 00000100:00100000:3.0:1788530435.662090:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788530435.662099:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03735880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875409555889280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530435.662155:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03735880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875409555889280:12345-0@lo:400:kworker.0 Request processed in 57us (7267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530435.662162:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788530435.662175:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788530435.662181:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03737480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875409555889664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530435.662210:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03737480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875409555889664:12345-0@lo:400:kworker.0 Request processed in 29us (7275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530435.662216:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1788530435.662305:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a9f37374e00 x1875409555889664/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530451 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530435.662411:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37374e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875409555889664:0@lo:400:kworker.0 00010000:00080000:3.0:1788530435.662428:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a9f37377100 x1875409555889280/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530451 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530435.662437:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37377100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875409555889280:0@lo:400:kworker.0 00000004:00000024:0.0:1788530435.662556:0:17899:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788530435.664167:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37376d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555889152:0@lo:400:kworker.0 00000100:00100000:0.0:1788530435.664536:0:17899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3648:x1875409555889792:12345-0@lo:41:osp-pre-1-0.0 Request processed in 2671us (4100us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530435.664546:0:17899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788530435.664709:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03736d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555889792:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788530436.163244:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788530436.163404:0:17891:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 10000000:01000000:1.0:1788530436.615139:0:17156:0:(mgc_request.c:715:do_requeue()) updating log params 10000000:01000000:1.0:1788530436.615151:0:17156:0:(mgc_request.c:2194:mgc_process_log()) Process log params-ffff9a9e03637800 from 13 10000000:01000000:1.0:1788530436.615158:0:17156:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788530436.615233:0:17156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f012ea000/0xb28d70e1257518a0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530436.615248:0:17156:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f012ea000/0xb28d70e1257518a0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530436.615274:0:17156:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f012ea000/0xb28d70e1257518a0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530436.615307:0:17156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2ba300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17156:1875409555889920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788530436.615390:0:17156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530436.615443:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f177156c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788530436.617257:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555889920 00000100:00100000:0.0:1788530436.617271:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555889920 00000100:00100000:0.0:1788530436.617330:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788530436.617341:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03cfe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+17:17156:x1875409555889920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788530436.617358:0:17153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530436.617407:0:17153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f3d101200/0xb28d70e1257518a7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e1257518a0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530436.617434:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f3d101200/0xb28d70e1257518a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e1257518a0 expref: 18 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530436.617468:0:17153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f3d101200/0xb28d70e1257518a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e1257518a0 expref: 18 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530436.617478:0:17153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d101200, rc 0) 00000100:00100000:0.0:1788530436.617541:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03cfe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+18:17156:x1875409555889920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 202us (2150us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530436.617548:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788530436.617742:0:17156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2ba300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17156:1875409555889920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788530436.617761:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f012ea000/0xb28d70e1257518a0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257518a7 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530436.617771:0:17156:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f012ea000/0xb28d70e1257518a0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e1257518a7 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788530436.617970:0:17156:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1e:0x0] index 13 count 13 00000040:00080000:1.0:1788530436.619440:0:17156:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788530436.619751:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].1, 224 off8416 00000040:00080000:1.0:1788530436.619780:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].2, 112 off8528 00000040:00080000:1.0:1788530436.619795:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].3, 224 off8752 00000040:00080000:1.0:1788530436.619806:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].4, 224 off8976 00000040:00080000:1.0:1788530436.619818:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].5, 112 off9088 00000040:00080000:1.0:1788530436.619831:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].6, 224 off9312 00000040:00080000:1.0:1788530436.619845:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].7, 224 off9536 00000040:00080000:1.0:1788530436.619859:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].8, 128 off9664 00000040:00080000:1.0:1788530436.619973:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].9, 224 off9888 00000040:00080000:1.0:1788530436.619991:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].10, 224 off10112 00000040:00080000:1.0:1788530436.620007:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].11, 128 off10240 00000040:00080000:1.0:1788530436.620028:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].12, 224 off10464 00000040:00080000:1.0:1788530436.620033:0:17156:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1e:0x0] index 12 count 13 00000100:00100000:1.0:1788530436.620357:0:17156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2ba300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17156:1875409555890048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788530436.620438:0:17156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530436.620547:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f177156c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788530436.624338:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555890048 00000100:00100000:0.0:1788530436.624355:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555890048 00000100:00100000:1.0:1788530436.624527:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788530436.624538:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03cfc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+18:17156:x1875409555890048:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788530436.626161:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03cfc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+18:17156:x1875409555890048:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1617us (5716us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530436.626173:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788530436.629896:0:17156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2ba300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17156:1875409555890048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788530436.630392:0:17156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d3ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17156:1875409555890176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788530436.630517:0:17156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530436.635682:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e03639000 going to sleep for 11 seconds 00000100:00100000:0.0:1788530436.638736:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555890176 00000100:00100000:0.0:1788530436.638768:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555890176 00000100:00100000:0.0:1788530436.639648:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788530436.639662:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03cff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+18:17156:x1875409555890176:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788530436.639881:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03cff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+18:17156:x1875409555890176:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 222us (9364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530436.639890:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788530436.641269:0:17156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d3ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17156:1875409555890176:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788530436.641794:0:17156:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788530436.641919:0:17156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d3ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17156:1875409555890304:0@lo:502:ll_cfg_requeue.0 00000100:00100000:2.0:1788530436.642004:0:17156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530436.646519:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e03639000 going to sleep for 11 seconds 00000100:00100000:3.0:1788530436.646800:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555890304 00000100:00100000:3.0:1788530436.646814:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555890304 00000100:00100000:3.0:1788530436.646900:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788530436.646915:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+18:17156:x1875409555890304:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:3.0:1788530436.647160:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+18:17156:x1875409555890304:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 248us (5155us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530436.647169:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788530436.647429:0:17156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d3ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17156:1875409555890304:0@lo:502:ll_cfg_requeue.0 00000040:00080000:2.0:1788530436.647771:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].1, 224 off8416 00000040:00080000:2.0:1788530436.647807:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].2, 112 off8528 00000040:00080000:2.0:1788530436.647822:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].3, 224 off8752 00000040:00080000:2.0:1788530436.647835:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].4, 224 off8976 00000040:00080000:2.0:1788530436.647851:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].5, 112 off9088 00000040:00080000:2.0:1788530436.647866:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].6, 224 off9312 00000040:00080000:2.0:1788530436.647880:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].7, 224 off9536 00000040:00080000:2.0:1788530436.647895:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].8, 128 off9664 00000040:00080000:2.0:1788530436.647908:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].9, 224 off9888 00000040:00080000:2.0:1788530436.647922:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].10, 224 off10112 00000040:00080000:2.0:1788530436.647937:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].11, 128 off10240 00000100:00100000:2.0:1788530436.647981:0:17156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d3ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17156:1875409555890432:0@lo:502:ll_cfg_requeue.0 00000100:00100000:2.0:1788530436.648051:0:17156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530436.648114:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e03639000 going to sleep for 11 seconds 00000100:00100000:3.0:1788530436.648332:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555890432 00000100:00100000:3.0:1788530436.648339:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555890432 00000100:00100000:3.0:1788530436.648380:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788530436.648389:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+18:17156:x1875409555890432:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:3.0:1788530436.648523:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+18:17156:x1875409555890432:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 136us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530436.648532:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788530436.648659:0:17156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d3ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17156:1875409555890432:0@lo:502:ll_cfg_requeue.0 00000040:00080000:2.0:1788530436.648719:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].12, 224 off10464 00000040:00080000:2.0:1788530436.648733:0:17156:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000040:00080000:0.0:1788530436.651546:0:18379:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x22:0x0] index 64768 count 13 00000020:01000000:2.0:1788530436.651988:0:17156:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788530436.652006:0:17156:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788530436.652017:0:17156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f012ea000/0xb28d70e1257518a0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257518a7 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530436.652030:0:17156:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f012ea000/0xb28d70e1257518a0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257518a7 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788530436.652044:0:17156:0:(mgc_request.c:715:do_requeue()) updating log params 10000000:01000000:2.0:1788530436.652047:0:17156:0:(mgc_request.c:2194:mgc_process_log()) Process log params-ffff9a9f202a8800 from 13 10000000:01000000:2.0:1788530436.652049:0:17156:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788530436.652096:0:17156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d20d000/0xb28d70e1257518ae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530436.652104:0:17156:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f3d20d000/0xb28d70e1257518ae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530436.652116:0:17156:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f3d20d000/0xb28d70e1257518ae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530436.652142:0:17156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d3ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17156:1875409555890560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788530436.652225:0:17156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530436.652278:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e03639000 going to sleep for 11 seconds 00000100:00100000:0.0:1788530436.652464:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555890560 00000100:00100000:0.0:1788530436.652475:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555890560 00000100:00100000:0.0:1788530436.652531:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788530436.652543:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+18:17156:x1875409555890560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788530436.652591:0:17153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530436.652607:0:17153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f3d101800/0xb28d70e1257518b5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e1257518ae expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530436.652633:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f3d101800/0xb28d70e1257518b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e1257518ae expref: 19 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530436.652664:0:17153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f3d101800/0xb28d70e1257518b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e1257518ae expref: 19 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530436.652673:0:17153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d101800, rc 0) 00000100:00100000:0.0:1788530436.652728:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+19:17156:x1875409555890560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 187us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530436.652736:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788530436.652907:0:17156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d3ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17156:1875409555890560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788530436.652927:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f3d20d000/0xb28d70e1257518ae lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257518b5 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530436.652946:0:17156:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f3d20d000/0xb28d70e1257518ae lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e1257518b5 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530436.652998:0:17156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d3ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17156:1875409555890688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788530436.653030:0:17156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530436.653062:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e03639000 going to sleep for 11 seconds 00000100:00100000:1.0:1788530436.653110:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555890688 00000100:00100000:1.0:1788530436.653115:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555890688 00000100:00100000:1.0:1788530436.653150:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788530436.653158:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+19:17156:x1875409555890688:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788530436.653295:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+19:17156:x1875409555890688:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 137us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530436.653303:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788530436.653487:0:17156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d3ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17156:1875409555890688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788530436.653520:0:17156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d3ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17156:1875409555890816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788530436.653593:0:17156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530436.653615:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e03639000 going to sleep for 11 seconds 00000100:00100000:1.0:1788530436.653678:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555890816 00000100:00100000:1.0:1788530436.653684:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555890816 00000100:00100000:1.0:1788530436.653715:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788530436.653722:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+19:17156:x1875409555890816:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788530436.653804:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+19:17156:x1875409555890816:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 82us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530436.653811:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788530436.653964:0:17156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d3ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17156:1875409555890816:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788530436.654890:0:18380:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788530436.655082:0:17156:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788530436.655104:0:17156:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788530436.655116:0:17156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d20d000/0xb28d70e1257518ae lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257518b5 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530436.655144:0:17156:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f3d20d000/0xb28d70e1257518ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257518b5 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530437.185543:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788530437.761818:0:17913:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788530438.209439:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788530438.672981:0:17192:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788530439.234159:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530440.264799:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788530440.769132:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788530440.769140:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788530440.769143:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788530440.769147:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788530440.769165:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788530440.769169:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788530440.769171:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788530440.769174:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788530440.769205:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:3648:1875409555890944:0@lo:400:kworker.0 00000100:00100000:1.0:1788530440.769278:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530440.769325:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875409555891456:0@lo:400:kworker.0 00000100:00100000:1.0:1788530440.769354:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530440.769391:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788530440.769398:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555891328:0@lo:400:kworker.0 00000100:00100000:1.0:1788530440.769451:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530440.769483:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555891072:0@lo:400:kworker.0 00000100:00100000:1.0:1788530440.769536:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530440.769557:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03736d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555891584:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788530440.769597:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530440.769605:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555891456 00000100:00100000:0.0:1788530440.769614:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555891456 00000100:00100000:1.0:1788530440.769615:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788530440.769620:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875409555891200:0@lo:400:kworker.0 00000100:00100000:1.0:1788530440.769639:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530440.769655:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03735f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555891712:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788530440.769659:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555891200 00000100:00100000:0.0:1788530440.769661:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555891200 00000100:00100000:1.0:1788530440.769672:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530440.769682:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788530440.769691:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875409555891456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530440.769701:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555890944 00000100:00100000:1.0:1788530440.769704:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555890944 00000100:00100000:1.0:1788530440.769731:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788530440.769738:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f04d59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+19:3648:x1875409555890944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530440.769742:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875409555891456:12345-0@lo:400:kworker.0 Request processed in 54us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530440.769751:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788530440.769763:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f04d59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+19:3648:x1875409555890944:12345-0@lo:400:kworker.0 Request processed in 27us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530440.769767:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788530440.769769:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788530440.769772:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875409555891200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530440.769795:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555891328 00000100:00100000:1.0:1788530440.769798:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555891328 00000100:00100000:0.0:1788530440.769800:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875409555891200:12345-0@lo:400:kworker.0 Request processed in 27us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530440.769805:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788530440.769814:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555891072 00000100:00100000:1.0:1788530440.769816:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555891072 00000100:00100000:1.0:1788530440.769827:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555891584 00000100:00100000:1.0:1788530440.769829:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555891584 00000100:00100000:1.0:1788530440.769838:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555891712 00000100:00100000:1.0:1788530440.769840:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555891712 00000100:00100000:1.0:1788530440.769849:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788530440.769855:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3648:x1875409555891328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530440.769887:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3648:x1875409555891328:12345-0@lo:400:kworker.0 Request processed in 32us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530440.769903:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788530440.769915:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788530440.769920:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3649:x1875409555891072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530440.769948:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3649:x1875409555891072:12345-0@lo:400:kworker.0 Request processed in 28us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530440.769954:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788530440.769966:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788530440.769972:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555891584:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788530440.770000:0:17164:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788530440.770034:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555891584:12345-0@lo:41:osp-pre-1-0.0 Request processed in 62us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530440.770040:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788530440.770051:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788530440.770056:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555891712:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788530440.770072:0:17164:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788530440.770097:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555891712:12345-0@lo:41:osp-pre-0-1.0 Request processed in 40us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530440.770102:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:1.0:1788530440.770154:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a9f3d2b8a80 x1875409555891200/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530440.770168:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875409555891200:0@lo:400:kworker.0 00000100:00100000:1.0:1788530440.770185:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03735f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555891712:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788530440.770193:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555891072:0@lo:400:kworker.0 00000100:00100000:1.0:1788530440.770215:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03736d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555891584:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788530440.770251:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555891328:0@lo:400:kworker.0 00000100:00100000:1.0:1788530440.770259:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:3648:1875409555890944:0@lo:400:kworker.0 00010000:00080000:1.0:1788530440.770269:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a9f3d2bb480 x1875409555891456/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530440.770277:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875409555891456:0@lo:400:kworker.0 00010000:00010000:0.0:1788530441.280892:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530442.306352:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788530442.685182:0:18662:0:(obd_mount.c:925:lmd_print()) mount data: 00000020:01000004:2.0:1788530442.685186:0:18662:0:(obd_mount.c:928:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1788530442.685188:0:18662:0:(obd_mount.c:931:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1788530442.686044:0:18662:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9a9f0519b800 00000020:01000004:2.0:1788530442.686069:0:18662:0:(tgt_mount.c:2585:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788530442.686085:0:18662:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788530442.686103:0:18662:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9a9f32880000) 00000020:00000080:2.0:1788530442.686124:0:18662:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788530442.811184:0:18662:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788530442.826883:0:18662:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788530442.829835:0:18662:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788530442.831580:0:18662:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788530442.832239:0:18662:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1788530442.834686:0:18662:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1788530442.835186:0:18662:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:01000000:0.0:1788530442.850220:0:18662:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788530442.850535:0:18662:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1788530442.850617:0:18662:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788530442.850685:0:18662:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xb28d70e1257518c3 00000020:01000004:0.0:1788530442.850697:0:18662:0:(tgt_mount.c:2670:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:0.0:1788530442.850726:0:18662:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.141@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788530442.850731:0:18662:0:(mgc_request.c:1372:mgc_set_info_async()) InitRecov MGC192.168.202.141@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788530442.850739:0:18662:0:(tgt_mount.c:1882:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1788530442.850744:0:18662:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1788530442.850757:0:18662:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9a9f3d214c98) 00000020:00000080:0.0:1788530442.850769:0:18662:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:1.0:1788530442.852300:0:18662:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788530442.852486:0:18662:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1788530442.852492:0:18662:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1788530442.854617:0:18662:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1788530442.854627:0:18662:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1788530442.864074:0:18662:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1788530442.864092:0:18662:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1788530442.876444:0:18662:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788530442.880796:0:18662:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1788530442.880807:0:18662:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1788530442.884227:0:18662:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1788530442.884247:0:18662:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1788530442.918127:0:18662:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788530442.918837:0:18662:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788530442.918853:0:18662:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1788530442.924181:0:18662:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788530442.924199:0:18662:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788530442.927286:0:18662:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788530442.927299:0:18662:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1788530442.934896:0:18662:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788530442.937036:0:18662:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1788530442.937055:0:18662:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1788530442.939248:0:18662:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1788530442.939411:0:18662:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1788530443.047469:0:18662:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788530443.053844:0:18662:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1788530443.053858:0:18662:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788530443.064290:0:18662:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788530443.064318:0:18662:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1788530443.069479:0:18662:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1788530443.069526:0:18662:0:(tgt_mount.c:1482:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.141@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1788530443.069531:0:18662:0:(tgt_mount.c:1239:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788530443.069532:0:18662:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788530443.069533:0:18662:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788530443.069535:0:18662:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:3.0:1788530443.069536:0:18662:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:3.0:1788530443.069538:0:18662:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:3.0:1788530443.069539:0:18662:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788530443.069541:0:18662:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788530443.069543:0:18662:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788530443.069547:0:18662:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1788530443.069549:0:18662:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788530443.069551:0:18662:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788530443.069552:0:18662:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788530443.069554:0:18662:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:3.0:1788530443.069555:0:18662:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:3.0:1788530443.069556:0:18662:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:3.0:1788530443.069557:0:18662:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788530443.069582:0:18662:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788530443.069583:0:18662:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788530443.069614:0:18662:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788530443.069636:0:18662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:18662:1875409555891840:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788530443.069741:0:18662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530443.069785:0:18662:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f177156c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788530443.069833:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555891840 00000100:00100000:0.0:1788530443.069842:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555891840 00000100:00100000:0.0:1788530443.069917:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788530443.069930:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f04d5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+19:18662:x1875409555891840:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788530443.069966:0:17153:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788530443.069970:0:17153:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1788530443.069975:0:17153:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1788530443.070553:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f04d5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+19:18662:x1875409555891840:12345-0@lo:253:mount.lustre.0 Request processed in 624us (810us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530443.070588:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788530443.070681:0:18662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:18662:1875409555891840:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788530443.070700:0:18662:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788530443.070703:0:18662:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788530443.070704:0:18662:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788530443.070705:0:18662:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788530443.070706:0:18662:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:3.0:1788530443.070707:0:18662:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:3.0:1788530443.070708:0:18662:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:3.0:1788530443.070709:0:18662:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788530443.070711:0:18662:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788530443.070712:0:18662:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788530443.070731:0:18662:0:(tgt_mount.c:115:server_register_mount()) register mount ffff9a9f0519b800 from lustre-OST0000 10000000:01000000:3.0:1788530443.070755:0:18662:0:(mgc_request.c:2342:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1788530443.070758:0:18662:0:(mgc_request.c:424:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788530443.070765:0:18662:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9a9f0519b800 10000000:01000000:3.0:1788530443.070771:0:18662:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788530443.070802:0:18662:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.202.141@tcp: setup lustre-OST0000-osd 00000040:01000000:3.0:1788530443.084469:0:18662:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.141@tcp ctxt 1 is initialized 00000040:01000000:2.0:1788530443.092777:0:18662:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.141@tcp ctxt 0 is initialized 10000000:01000000:2.0:1788530443.092804:0:18662:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-sptlrpc-ffff9a9f0519b800 from 1 10000000:01000000:2.0:1788530443.092808:0:18662:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788530443.092866:0:18662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d20c200/0xb28d70e1257518d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530443.092877:0:18662:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f3d20c200/0xb28d70e1257518d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530443.092889:0:18662:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f3d20c200/0xb28d70e1257518d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530443.092918:0:18662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d3ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:18662:1875409555891968:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788530443.093112:0:18662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530443.093242:0:18662:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f1f42d540 going to sleep for 11 seconds 00000100:00100000:1.0:1788530443.093475:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555891968 00000100:00100000:1.0:1788530443.093484:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555891968 00000100:00100000:1.0:1788530443.093618:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788530443.093629:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f04d5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+19:18662:x1875409555891968:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788530443.093642:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530443.093656:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f012eac00/0xb28d70e1257518d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e1257518d1 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530443.093713:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f012eac00/0xb28d70e1257518d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e1257518d1 expref: 20 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530443.093733:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f012eac00/0xb28d70e1257518d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e1257518d1 expref: 20 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530443.093743:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f012eac00, rc 0) 00000100:00100000:1.0:1788530443.093792:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f04d5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+20:18662:x1875409555891968:12345-0@lo:101:mount.lustre.0 Request processed in 165us (681us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530443.093799:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788530443.093900:0:18662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d3ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:18662:1875409555891968:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788530443.093918:0:18662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f3d20c200/0xb28d70e1257518d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257518d8 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530443.093929:0:18662:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f3d20c200/0xb28d70e1257518d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e1257518d8 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530443.094048:0:18662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:18662:1875409555892096:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788530443.094082:0:18662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530443.094546:0:18662:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f177150c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788530443.094700:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555892096 00000100:00100000:2.0:1788530443.094705:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555892096 00000100:00100000:2.0:1788530443.094733:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788530443.094740:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03ccd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+20:18662:x1875409555892096:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788530443.094821:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03ccd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+20:18662:x1875409555892096:12345-0@lo:501:mount.lustre.0 Request processed in 81us (738us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788530443.094828:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788530443.094951:0:18662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:18662:1875409555892096:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788530443.094967:0:18662:0:(mgc_request_server.c:748:mgc_llog_local_copy()) MGC192.168.202.141@tcp: no remote llog for lustre-sptlrpc, check MGS config 00000100:00100000:3.0:1788530443.095015:0:18662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:18662:1875409555892224:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788530443.095061:0:18662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530443.095090:0:18662:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f177150c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788530443.095195:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555892224 00000100:00100000:2.0:1788530443.095200:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555892224 00000100:00100000:2.0:1788530443.095219:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788530443.095225:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03ccd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+20:18662:x1875409555892224:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788530443.095299:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03ccd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+20:18662:x1875409555892224:12345-0@lo:501:mount.lustre.0 Request processed in 73us (236us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788530443.095306:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788530443.095435:0:18662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:18662:1875409555892224:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788530443.095453:0:18662:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788530443.095475:0:18662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d20c200/0xb28d70e1257518d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257518d8 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530443.095485:0:18662:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f3d20c200/0xb28d70e1257518d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257518d8 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788530443.095497:0:18662:0:(mgc_request.c:206:do_config_log_add()) do adding config log params-ffff9a9f0519b800 10000000:01000000:3.0:1788530443.095504:0:18662:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788530443.095532:0:18662:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.202.141@tcp: setup lustre-OST0000-osd 00000040:01000000:3.0:1788530443.095648:0:18662:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.141@tcp ctxt 1 is initialized 00000040:01000000:3.0:1788530443.095656:0:18662:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.141@tcp ctxt 0 is initialized 10000000:01000000:3.0:1788530443.095677:0:18662:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788530443.095681:0:18662:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788530443.095712:0:18662:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.202.141@tcp: setup lustre-OST0000-osd 00000040:01000000:3.0:1788530443.095755:0:18662:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.141@tcp ctxt 1 is initialized 00000040:01000000:3.0:1788530443.095759:0:18662:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.141@tcp ctxt 0 is initialized 10000000:01000000:3.0:1788530443.095765:0:18662:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-mdtir-ffff9a9f0519b800 10000000:01000000:3.0:1788530443.095768:0:18662:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788530443.095787:0:18662:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788530443.095790:0:18662:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788530443.095814:0:18662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36a800/0xb28d70e1257518df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530443.095822:0:18662:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36a800/0xb28d70e1257518df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530443.095840:0:18662:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36a800/0xb28d70e1257518df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530443.095853:0:18662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:18662:1875409555892352:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788530443.095883:0:18662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530443.095903:0:18662:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f329c3cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788530443.098640:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555892352 00000100:00100000:2.0:1788530443.098657:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555892352 00000100:00100000:2.0:1788530443.098722:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788530443.098731:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03ccf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+20:18662:x1875409555892352:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788530443.098748:0:17151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530443.098766:0:17151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f3d20cc00/0xb28d70e1257518e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e1257518df expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530443.098796:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f3d20cc00/0xb28d70e1257518e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e1257518df expref: 21 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530443.098807:0:17151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f3d20cc00/0xb28d70e1257518e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e1257518df expref: 21 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530443.098816:0:17151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d20cc00, rc 0) 00000100:00100000:2.0:1788530443.098896:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03ccf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+21:18662:x1875409555892352:12345-0@lo:101:mount.lustre.0 Request processed in 166us (3013us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530443.098903:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788530443.100855:0:18662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:18662:1875409555892352:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788530443.100891:0:18662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36a800/0xb28d70e1257518df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257518e6 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530443.100906:0:18662:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36a800/0xb28d70e1257518df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e1257518e6 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788530443.104767:0:18662:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000040:00080000:3.0:1788530443.106010:0:18662:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788530443.109723:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].1, 224 off8416 00000040:00080000:1.0:1788530443.109793:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].2, 128 off8544 00000040:00080000:1.0:1788530443.109808:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].3, 112 off8656 00000040:00080000:1.0:1788530443.109822:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].4, 224 off8880 00000040:00080000:1.0:1788530443.109836:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].5, 224 off9104 00000040:00080000:1.0:1788530443.109847:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].6, 80 off9184 00000040:00080000:1.0:1788530443.109859:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].7, 224 off9408 00000040:00080000:1.0:1788530443.109875:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].8, 224 off9632 00000040:00080000:1.0:1788530443.109895:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].9, 80 off9712 00000040:00080000:1.0:1788530443.109909:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].10, 224 off9936 00000040:00080000:1.0:1788530443.109923:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].11, 224 off10160 00000040:00080000:1.0:1788530443.109937:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].12, 120 off10280 00000040:00080000:1.0:1788530443.109970:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].13, 224 off10504 00000040:00080000:1.0:1788530443.109977:0:18662:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 13 count 14 00000100:00100000:1.0:1788530443.110183:0:18662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:18662:1875409555892480:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788530443.110275:0:18662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530443.110336:0:18662:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e0273bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788530443.110580:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555892480 00000100:00100000:2.0:1788530443.110589:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555892480 00000100:00100000:2.0:1788530443.110634:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788530443.110643:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03ccfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+21:18662:x1875409555892480:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788530443.110799:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03ccfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+21:18662:x1875409555892480:12345-0@lo:501:mount.lustre.0 Request processed in 156us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530443.110806:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788530443.111348:0:18662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:18662:1875409555892480:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788530443.111391:0:18662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:18662:1875409555892608:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788530443.111450:0:18662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530443.111626:0:18662:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e0273bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788530443.111779:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555892608 00000100:00100000:0.0:1788530443.111785:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555892608 00000100:00100000:2.0:1788530443.111872:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788530443.111884:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03ccf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+21:18662:x1875409555892608:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788530443.116828:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03ccf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+21:18662:x1875409555892608:12345-0@lo:503:mount.lustre.0 Request processed in 4936us (5365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530443.116845:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788530443.116976:0:18662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:18662:1875409555892608:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788530443.118404:0:18662:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788530443.118503:0:18662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:18662:1875409555892736:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788530443.118772:0:18662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530443.118814:0:18662:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e0273bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788530443.118878:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555892736 00000100:00100000:2.0:1788530443.118885:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555892736 00000100:00100000:2.0:1788530443.118963:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788530443.118973:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03ccdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+21:18662:x1875409555892736:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788530443.119672:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03ccdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+21:18662:x1875409555892736:12345-0@lo:502:mount.lustre.0 Request processed in 687us (887us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530443.119684:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788530443.120151:0:18662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:18662:1875409555892736:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788530443.120730:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].1, 224 off8416 00000040:00080000:1.0:1788530443.120769:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].2, 128 off8544 00000040:00080000:1.0:1788530443.120791:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].3, 112 off8656 00000040:00080000:1.0:1788530443.120808:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].4, 224 off8880 00000040:00080000:1.0:1788530443.120824:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].5, 224 off9104 00000040:00080000:1.0:1788530443.120838:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].6, 80 off9184 00000040:00080000:1.0:1788530443.120854:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].7, 224 off9408 00000040:00080000:1.0:1788530443.120870:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].8, 224 off9632 00000040:00080000:1.0:1788530443.120886:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].9, 80 off9712 00000040:00080000:1.0:1788530443.120902:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].10, 224 off9936 00000040:00080000:1.0:1788530443.120919:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].11, 224 off10160 00000040:00080000:1.0:1788530443.120936:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].12, 120 off10280 00000100:00100000:1.0:1788530443.120976:0:18662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:18662:1875409555892864:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788530443.121528:0:18662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530443.121601:0:18662:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e0273bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788530443.121693:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555892864 00000100:00100000:3.0:1788530443.121702:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555892864 00000100:00100000:3.0:1788530443.121755:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788530443.121765:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03cce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+21:18662:x1875409555892864:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788530443.121893:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03cce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+21:18662:x1875409555892864:12345-0@lo:502:mount.lustre.0 Request processed in 128us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530443.121903:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788530443.122010:0:18662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:18662:1875409555892864:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788530443.122077:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].13, 224 off10504 00000040:00080000:1.0:1788530443.122088:0:18662:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:3.0:1788530443.123932:0:18679:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788530443.123944:0:18679:0:(obd_mount.c:963:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1788530443.123950:0:18679:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788530443.123953:0:18679:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1788530443.123960:0:18679:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788530443.123997:0:18679:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9a9e027be620) 00000020:00000080:3.0:1788530443.124023:0:18679:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788530443.124037:0:18679:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788530443.124135:0:18679:0:(tgt_mount.c:167:server_get_mount()) get mount ffff9a9f0519b800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1788530443.124145:0:18679:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788530443.124153:0:18679:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xb28d70e1257518f4 00010000:00010000:2.0:1788530443.132910:0:18679:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:2.0:1788530443.134330:0:18679:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:2.0:1788530443.141777:0:18679:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:0.0:1788530443.155626:0:18679:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1788530443.155642:0:18679:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788530443.155652:0:18679:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788530443.155654:0:18679:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1788530443.155866:0:18679:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788530443.155870:0:18679:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:0.0:1788530443.155872:0:18679:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788530443.155874:0:18679:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788530443.155876:0:18679:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788530443.155880:0:18679:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788530443.155881:0:18679:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788530443.155885:0:18679:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788530443.155888:0:18679:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788530443.155904:0:18679:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788530443.155909:0:18679:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788530443.155912:0:18679:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788530443.155914:0:18679:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788530443.155917:0:18679:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788530443.155918:0:18679:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788530443.155921:0:18679:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788530443.155923:0:18679:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788530443.155925:0:18679:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788530443.155929:0:18679:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788530443.155971:0:18679:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788530443.155975:0:18679:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788530443.155977:0:18679:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788530443.155980:0:18679:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x14:0x0] index 14 count 14 00000020:01000000:1.0:1788530443.156246:0:18662:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1788530443.156286:0:18662:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788530443.156315:0:18662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36a800/0xb28d70e1257518df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257518e6 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530443.156335:0:18662:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36a800/0xb28d70e1257518df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e1257518e6 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788530443.156344:0:18662:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-mdtir-ffff9a9f0519b800 from 1 10000000:01000000:1.0:1788530443.156347:0:18662:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788530443.156386:0:18662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f012eb400/0xb28d70e1257518fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530443.156404:0:18662:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f012eb400/0xb28d70e1257518fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530443.156417:0:18662:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f012eb400/0xb28d70e1257518fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530443.156446:0:18662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:18662:1875409555892992:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788530443.156526:0:18662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530443.156602:0:18662:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e0273be40 going to sleep for 11 seconds 00000100:00100000:0.0:1788530443.156855:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555892992 00000100:00100000:0.0:1788530443.156864:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555892992 00000100:00100000:0.0:1788530443.156944:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788530443.156956:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03ccf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+21:18662:x1875409555892992:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788530443.156971:0:17151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530443.156988:0:17151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f3d101c00/0xb28d70e125751902 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e1257518fb expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530443.157015:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f3d101c00/0xb28d70e125751902 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e1257518fb expref: 22 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530443.157311:0:17151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f3d101c00/0xb28d70e125751902 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e1257518fb expref: 22 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530443.157321:0:17151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d101c00, rc 0) 00000100:00100000:0.0:1788530443.157374:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03ccf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+22:18662:x1875409555892992:12345-0@lo:101:mount.lustre.0 Request processed in 421us (850us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530443.157380:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788530443.157509:0:18662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:18662:1875409555892992:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788530443.157526:0:18662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f012eb400/0xb28d70e1257518fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751902 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530443.157535:0:18662:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f012eb400/0xb28d70e1257518fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e125751902 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530443.158656:0:18662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:18662:1875409555893120:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1788530443.158735:0:18662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530443.164970:0:18662:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e0273be40 going to sleep for 11 seconds 00000100:00100000:3.0:1788530443.165707:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555893120 00000100:00100000:3.0:1788530443.165719:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555893120 00000100:00100000:3.0:1788530443.165764:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788530443.165774:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03ccd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+22:18662:x1875409555893120:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788530443.165800:0:17153:0:(mgs_nids.c:1159:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788530443.165822:0:17153:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788530443.165827:0:17153:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788530443.165829:0:17153:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 88, version 8 00000100:00100000:3.0:1788530443.165966:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03ccd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+22:18662:x1875409555893120:12345-0@lo:256:mount.lustre.0 Request processed in 193us (7230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530443.165975:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788530443.166431:0:18662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:18662:1875409555893120:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1788530443.167497:0:18662:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788530443.167535:0:18662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f012eb400/0xb28d70e1257518fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751902 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530443.167550:0:18662:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f012eb400/0xb28d70e1257518fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751902 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788530443.167589:0:18662:0:(mgc_request.c:2194:mgc_process_log()) Process log params-ffff9a9f0519b800 from 1 10000000:01000000:1.0:1788530443.167593:0:18662:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788530443.167640:0:18662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f012ebc00/0xb28d70e125751909 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530443.167649:0:18662:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f012ebc00/0xb28d70e125751909 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530443.167722:0:18662:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f012ebc00/0xb28d70e125751909 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530443.167762:0:18662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:18662:1875409555893248:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788530443.167832:0:18662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530443.167878:0:18662:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e0273be40 going to sleep for 11 seconds 00000100:00100000:0.0:1788530443.167979:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555893248 00000100:00100000:0.0:1788530443.167999:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555893248 00000100:00100000:0.0:1788530443.168062:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788530443.168073:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03cccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+22:18662:x1875409555893248:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788530443.168088:0:17153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530443.168105:0:17153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f3d100800/0xb28d70e125751910 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e125751909 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530443.168130:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f3d100800/0xb28d70e125751910 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e125751909 expref: 23 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530443.168141:0:17153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f3d100800/0xb28d70e125751910 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125751909 expref: 23 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530443.168150:0:17153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d100800, rc 0) 00000100:00100000:0.0:1788530443.168192:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03cccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+23:18662:x1875409555893248:12345-0@lo:101:mount.lustre.0 Request processed in 120us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530443.168199:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788530443.168903:0:18662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:18662:1875409555893248:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788530443.168928:0:18662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f012ebc00/0xb28d70e125751909 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751910 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530443.168940:0:18662:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f012ebc00/0xb28d70e125751909 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e125751910 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788530443.176914:0:18662:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 13 count 13 00000040:00080000:0.0:1788530443.177351:0:18662:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788530443.177630:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].1, 224 off8416 00000040:00080000:0.0:1788530443.177657:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].2, 112 off8528 00000040:00080000:0.0:1788530443.177672:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].3, 224 off8752 00000040:00080000:0.0:1788530443.177686:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].4, 224 off8976 00000040:00080000:0.0:1788530443.177697:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].5, 112 off9088 00000040:00080000:0.0:1788530443.177709:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].6, 224 off9312 00000040:00080000:0.0:1788530443.177721:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].7, 224 off9536 00000040:00080000:0.0:1788530443.177732:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].8, 128 off9664 00000040:00080000:0.0:1788530443.177743:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].9, 224 off9888 00000040:00080000:0.0:1788530443.177755:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].10, 224 off10112 00000040:00080000:0.0:1788530443.177766:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].11, 128 off10240 00000040:00080000:0.0:1788530443.177793:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].12, 224 off10464 00000040:00080000:0.0:1788530443.177800:0:18662:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 12 count 13 00000100:00100000:0.0:1788530443.177892:0:18662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03735180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:18662:1875409555893376:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788530443.177988:0:18662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530443.178036:0:18662:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f32b9fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1788530443.178149:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555893376 00000100:00100000:3.0:1788530443.178156:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555893376 00000100:00100000:3.0:1788530443.178198:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788530443.178206:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+23:18662:x1875409555893376:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788530443.178337:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+23:18662:x1875409555893376:12345-0@lo:501:mount.lustre.0 Request processed in 131us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530443.178345:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788530443.178897:0:18662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03735180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:18662:1875409555893376:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788530443.178942:0:18662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03735180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:18662:1875409555893504:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788530443.178991:0:18662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530443.179024:0:18662:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f32b9fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1788530443.179163:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555893504 00000100:00100000:2.0:1788530443.179168:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555893504 00000100:00100000:2.0:1788530443.179207:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788530443.179216:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+23:18662:x1875409555893504:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788530443.179328:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+23:18662:x1875409555893504:12345-0@lo:503:mount.lustre.0 Request processed in 113us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530443.179336:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788530443.180592:0:18662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03735180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:18662:1875409555893504:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788530443.181827:0:18662:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788530443.181944:0:18662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:18662:1875409555893632:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788530443.182061:0:18662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530443.182113:0:18662:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e0273b480 going to sleep for 11 seconds 00000100:00100000:0.0:1788530443.184086:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555893632 00000100:00100000:0.0:1788530443.184103:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555893632 00000100:00100000:0.0:1788530443.184170:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788530443.184182:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+23:18662:x1875409555893632:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788530443.184370:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+23:18662:x1875409555893632:12345-0@lo:502:mount.lustre.0 Request processed in 191us (2309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530443.184379:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788530443.184433:0:18662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:18662:1875409555893632:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788530443.184956:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].1, 224 off8416 00000040:00080000:1.0:1788530443.185006:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].2, 112 off8528 00000040:00080000:1.0:1788530443.185024:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].3, 224 off8752 00000040:00080000:1.0:1788530443.185056:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].4, 224 off8976 00000040:00080000:1.0:1788530443.185071:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].5, 112 off9088 00000040:00080000:1.0:1788530443.185085:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].6, 224 off9312 00000040:00080000:1.0:1788530443.185099:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].7, 224 off9536 00000040:00080000:1.0:1788530443.185111:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].8, 128 off9664 00000040:00080000:1.0:1788530443.185126:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].9, 224 off9888 00000040:00080000:1.0:1788530443.185140:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].10, 224 off10112 00000040:00080000:1.0:1788530443.185153:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].11, 128 off10240 00000100:00100000:1.0:1788530443.185192:0:18662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:18662:1875409555893760:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788530443.185468:0:18662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530443.185515:0:18662:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e0273b480 going to sleep for 11 seconds 00000100:00100000:3.0:1788530443.185619:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555893760 00000100:00100000:3.0:1788530443.185626:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555893760 00000100:00100000:3.0:1788530443.185683:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788530443.185694:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+23:18662:x1875409555893760:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788530443.185803:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+23:18662:x1875409555893760:12345-0@lo:502:mount.lustre.0 Request processed in 111us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530443.185818:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788530443.185999:0:18662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:18662:1875409555893760:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788530443.186094:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].12, 224 off10464 00000040:00080000:1.0:1788530443.186105:0:18662:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1788530443.187107:0:18683:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788530443.187119:0:18683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788530443.187121:0:18683:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788530443.187129:0:18683:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a9f0519b800 00000020:00000080:1.0:1788530443.187132:0:18683:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788530443.187152:0:18683:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788530443.187155:0:18683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788530443.187157:0:18683:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788530443.187160:0:18683:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788530443.187163:0:18683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788530443.187165:0:18683:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788530443.187168:0:18683:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a9f0519b800 00000020:00000080:1.0:1788530443.187170:0:18683:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788530443.187227:0:18683:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788530443.187231:0:18683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788530443.187233:0:18683:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788530443.187235:0:18683:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788530443.187238:0:18683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788530443.187239:0:18683:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788530443.187242:0:18683:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a9f0519b800 00000020:00000080:1.0:1788530443.187244:0:18683:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788530443.189591:0:18683:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788530443.189602:0:18683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788530443.189604:0:18683:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788530443.189608:0:18683:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788530443.189613:0:18683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788530443.189614:0:18683:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788530443.189619:0:18683:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a9f0519b800 00000020:00000080:1.0:1788530443.189621:0:18683:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788530443.191127:0:18683:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788530443.191138:0:18683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788530443.191140:0:18683:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788530443.191145:0:18683:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x16:0x0] index 13 count 13 00000020:01000000:3.0:1788530443.192900:0:18662:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1788530443.192929:0:18662:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788530443.192953:0:18662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f012ebc00/0xb28d70e125751909 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751910 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530443.192968:0:18662:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f012ebc00/0xb28d70e125751909 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751910 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788530443.196593:0:18662:0:(mgc_request.c:2342:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788530443.196602:0:18662:0:(mgc_request.c:424:config_log_add()) add config log lustre-client-ffff9a9f0519b800 10000000:01000000:3.0:1788530443.196606:0:18662:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-client-ffff9a9f0519b800 10000000:01000000:3.0:1788530443.196611:0:18662:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788530443.196642:0:18662:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.202.141@tcp: setup lustre-OST0000-osd 00000040:01000000:3.0:1788530443.198546:0:18662:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.141@tcp ctxt 1 is initialized 00000040:01000000:3.0:1788530443.198577:0:18662:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.141@tcp ctxt 0 is initialized 10000000:01000000:3.0:1788530443.198596:0:18662:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-client-ffff9a9f0519b800 from 1 10000000:01000000:3.0:1788530443.198601:0:18662:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788530443.198644:0:18662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36ba00/0xb28d70e125751917 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530443.198657:0:18662:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36ba00/0xb28d70e125751917 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530443.202155:0:18662:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36ba00/0xb28d70e125751917 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530443.202186:0:18662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:18662:1875409555893888:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788530443.202269:0:18662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530443.202328:0:18662:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f03ac3d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788530443.202640:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555893888 00000100:00100000:0.0:1788530443.202649:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555893888 00000100:00100000:0.0:1788530443.202704:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788530443.202715:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+23:18662:x1875409555893888:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788530443.202730:0:17151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530443.202752:0:17151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f3d100000/0xb28d70e12575191e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e125751917 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530443.202778:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f3d100000/0xb28d70e12575191e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e125751917 expref: 24 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530443.202797:0:17151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f3d100000/0xb28d70e12575191e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125751917 expref: 24 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530443.202806:0:17151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d100000, rc 0) 00000100:00100000:0.0:1788530443.202855:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+24:18662:x1875409555893888:12345-0@lo:101:mount.lustre.0 Request processed in 142us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530443.202898:0:18662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:18662:1875409555893888:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788530443.202916:0:18662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36ba00/0xb28d70e125751917 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575191e expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530443.202926:0:18662:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36ba00/0xb28d70e125751917 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e12575191e expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530443.202968:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000040:00080000:3.0:1788530443.204735:0:18662:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:3.0:1788530443.205234:0:18662:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788530443.205539:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].1, 224 off8416 00000040:00080000:3.0:1788530443.205597:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].2, 120 off8536 00000040:00080000:3.0:1788530443.205615:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].3, 168 off8704 00000040:00080000:3.0:1788530443.205632:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].4, 224 off8928 00000040:00080000:3.0:1788530443.205732:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].5, 224 off9152 00000040:00080000:3.0:1788530443.205754:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].6, 120 off9272 00000040:00080000:3.0:1788530443.205769:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].7, 168 off9440 00000040:00080000:3.0:1788530443.205783:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].8, 224 off9664 00000040:00080000:3.0:1788530443.205796:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].9, 224 off9888 00000040:00080000:3.0:1788530443.205809:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].10, 120 off10008 00000040:00080000:3.0:1788530443.205821:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].11, 224 off10232 00000040:00080000:3.0:1788530443.205831:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].12, 224 off10456 00000040:00080000:3.0:1788530443.205842:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].13, 88 off10544 00000040:00080000:3.0:1788530443.205853:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].14, 128 off10672 00000040:00080000:3.0:1788530443.205865:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].15, 144 off10816 00000040:00080000:3.0:1788530443.205878:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].16, 160 off10976 00000040:00080000:3.0:1788530443.205889:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].17, 224 off11200 00000040:00080000:3.0:1788530443.205901:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].18, 224 off11424 00000040:00080000:3.0:1788530443.205912:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].19, 80 off11504 00000040:00080000:3.0:1788530443.205925:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].20, 224 off11728 00000040:00080000:3.0:1788530443.205955:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].21, 224 off11952 00000040:00080000:3.0:1788530443.205980:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].22, 88 off12040 00000040:00080000:3.0:1788530443.206150:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].23, 128 off12168 00000040:00080000:3.0:1788530443.206168:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].24, 144 off12312 00000040:00080000:3.0:1788530443.206182:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].25, 160 off12472 00000040:00080000:3.0:1788530443.206196:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].26, 224 off12696 00000040:00080000:3.0:1788530443.206210:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].27, 224 off12920 00000040:00080000:3.0:1788530443.206223:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].28, 80 off13000 00000040:00080000:3.0:1788530443.206237:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].29, 224 off13224 00000040:00080000:3.0:1788530443.206331:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].30, 224 off13448 00000040:00080000:3.0:1788530443.206350:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].31, 88 off13536 00000040:00080000:3.0:1788530443.206366:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].32, 128 off13664 00000040:00080000:3.0:1788530443.206383:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].33, 144 off13808 00000040:00080000:3.0:1788530443.206411:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].34, 128 off13936 00000040:00080000:3.0:1788530443.206429:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].35, 224 off14160 00000040:00080000:3.0:1788530443.206445:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].36, 224 off14384 00000040:00080000:3.0:1788530443.206474:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].37, 80 off14464 00000040:00080000:3.0:1788530443.206492:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].38, 224 off14688 00000040:00080000:3.0:1788530443.206507:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].39, 224 off14912 00000040:00080000:3.0:1788530443.206523:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].40, 88 off15000 00000040:00080000:3.0:1788530443.206537:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].41, 128 off15128 00000040:00080000:3.0:1788530443.206552:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].42, 144 off15272 00000040:00080000:3.0:1788530443.206602:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].43, 128 off15400 00000040:00080000:3.0:1788530443.206618:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].44, 224 off15624 00000040:00080000:3.0:1788530443.206633:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].45, 224 off15848 00000040:00080000:3.0:1788530443.206647:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].46, 80 off15928 00000040:00080000:3.0:1788530443.206738:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].47, 224 off16152 00000040:00080000:3.0:1788530443.206759:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].48, 232 off16384 00000040:00080000:3.0:1788530443.206894:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].49, 224 off16608 00000040:00080000:3.0:1788530443.206913:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].50, 120 off16728 00000040:00080000:3.0:1788530443.206930:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].51, 224 off16952 00000040:00080000:3.0:1788530443.206935:0:18662:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:3.0:1788530443.207188:0:18662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:18662:1875409555894016:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788530443.207339:0:18662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530443.207650:0:18662:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f396d5f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788530443.208658:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555894016 00000100:00100000:3.0:1788530443.208738:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555894016 00000100:00100000:3.0:1788530443.208807:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788530443.208817:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+24:18662:x1875409555894016:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788530443.209239:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+24:18662:x1875409555894016:12345-0@lo:501:mount.lustre.0 Request processed in 423us (1899us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530443.209256:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788530443.209334:0:18662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:18662:1875409555894016:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788530443.209386:0:18662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03735180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:18662:1875409555894144:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788530443.209435:0:18662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530443.209457:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555894144 00000100:00100000:0.0:1788530443.209460:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555894144 00000100:00100000:0.0:1788530443.209488:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788530443.209496:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+24:18662:x1875409555894144:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788530443.209602:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+24:18662:x1875409555894144:12345-0@lo:503:mount.lustre.0 Request processed in 107us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530443.209620:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788530443.209658:0:18662:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f17dadb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788530443.209670:0:18662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03735180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:18662:1875409555894144:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788530443.210506:0:18662:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788530443.211134:0:18662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03735180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:18662:1875409555894272:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788530443.211339:0:18662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530443.211381:0:18662:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f17dadb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788530443.211384:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555894272 00000100:00100000:3.0:1788530443.211391:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555894272 00000100:00100000:3.0:1788530443.211446:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788530443.211456:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+24:18662:x1875409555894272:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788530443.211579:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+24:18662:x1875409555894272:12345-0@lo:502:mount.lustre.0 Request processed in 103us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530443.211589:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788530443.211674:0:18662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03735180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:18662:1875409555894272:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788530443.212046:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].1, 224 off8416 00000040:00080000:0.0:1788530443.212081:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].2, 120 off8536 00000040:00080000:0.0:1788530443.212096:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].3, 168 off8704 00000040:00080000:0.0:1788530443.212111:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].4, 224 off8928 00000040:00080000:0.0:1788530443.212126:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].5, 224 off9152 00000040:00080000:0.0:1788530443.212140:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].6, 120 off9272 00000040:00080000:0.0:1788530443.212154:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].7, 168 off9440 00000040:00080000:0.0:1788530443.212167:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].8, 224 off9664 00000040:00080000:0.0:1788530443.212182:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].9, 224 off9888 00000040:00080000:0.0:1788530443.212386:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].10, 120 off10008 00000040:00080000:0.0:1788530443.212423:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].11, 224 off10232 00000040:00080000:0.0:1788530443.212438:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].12, 224 off10456 00000040:00080000:0.0:1788530443.212452:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].13, 88 off10544 00000040:00080000:0.0:1788530443.212465:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].14, 128 off10672 00000040:00080000:0.0:1788530443.212478:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].15, 144 off10816 00000040:00080000:0.0:1788530443.212492:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].16, 160 off10976 00000040:00080000:0.0:1788530443.212507:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].17, 224 off11200 00000040:00080000:0.0:1788530443.212522:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].18, 224 off11424 00000040:00080000:0.0:1788530443.212535:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].19, 80 off11504 00000040:00080000:0.0:1788530443.212548:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].20, 224 off11728 00000040:00080000:0.0:1788530443.213332:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].21, 224 off11952 00000040:00080000:0.0:1788530443.213370:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].22, 88 off12040 00000040:00080000:0.0:1788530443.213386:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].23, 128 off12168 00000040:00080000:0.0:1788530443.213415:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].24, 144 off12312 00000040:00080000:0.0:1788530443.213434:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].25, 160 off12472 00000040:00080000:0.0:1788530443.213470:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].26, 224 off12696 00000040:00080000:0.0:1788530443.213488:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].27, 224 off12920 00000040:00080000:0.0:1788530443.213503:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].28, 80 off13000 00000040:00080000:0.0:1788530443.213518:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].29, 224 off13224 00000040:00080000:0.0:1788530443.213534:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].30, 224 off13448 00000040:00080000:0.0:1788530443.213551:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].31, 88 off13536 00000040:00080000:0.0:1788530443.213604:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].32, 128 off13664 00000040:00080000:0.0:1788530443.213632:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].33, 144 off13808 00000040:00080000:0.0:1788530443.213646:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].34, 128 off13936 00000040:00080000:0.0:1788530443.213660:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].35, 224 off14160 00000040:00080000:0.0:1788530443.213676:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].36, 224 off14384 00000040:00080000:0.0:1788530443.213688:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].37, 80 off14464 00000040:00080000:0.0:1788530443.213701:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].38, 224 off14688 00000040:00080000:0.0:1788530443.213715:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].39, 224 off14912 00000040:00080000:0.0:1788530443.213729:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].40, 88 off15000 00000040:00080000:0.0:1788530443.213743:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].41, 128 off15128 00000040:00080000:0.0:1788530443.213771:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].42, 144 off15272 00000040:00080000:0.0:1788530443.213787:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].43, 128 off15400 00000040:00080000:0.0:1788530443.213801:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].44, 224 off15624 00000040:00080000:0.0:1788530443.213815:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].45, 224 off15848 00000040:00080000:0.0:1788530443.213831:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].46, 80 off15928 00000040:00080000:0.0:1788530443.213848:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].47, 224 off16152 00000040:00080000:0.0:1788530443.215043:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].48, 232 off16384 00000100:00100000:0.0:1788530443.215133:0:18662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03735180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:18662:1875409555894400:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788530443.215223:0:18662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530443.215325:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555894400 00000100:00100000:0.0:1788530443.215332:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555894400 00000100:00100000:0.0:1788530443.215390:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788530443.215408:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+24:18662:x1875409555894400:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788530443.215516:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+24:18662:x1875409555894400:12345-0@lo:502:mount.lustre.0 Request processed in 109us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530443.215524:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788530443.215602:0:18662:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f17dadb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788530443.215628:0:18662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03735180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:18662:1875409555894400:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788530443.215843:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].49, 224 off16608 00000040:00080000:0.0:1788530443.221633:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].50, 120 off16728 00000100:00100000:0.0:1788530443.221726:0:18662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03735180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:18662:1875409555894528:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788530443.221818:0:18662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530443.221868:0:18662:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f17dadb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788530443.222188:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555894528 00000100:00100000:3.0:1788530443.222198:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555894528 00000100:00100000:3.0:1788530443.222263:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788530443.222274:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+24:18662:x1875409555894528:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788530443.222408:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+24:18662:x1875409555894528:12345-0@lo:502:mount.lustre.0 Request processed in 124us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530443.222416:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788530443.222614:0:18662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03735180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:18662:1875409555894528:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788530443.222688:0:18662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].51, 224 off16952 00000040:00080000:0.0:1788530443.222699:0:18662:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1788530443.237245:0:18688:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788530443.237265:0:18688:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9a9f39656620) 00000020:00000080:3.0:1788530443.237294:0:18688:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:3.0:1788530443.237387:0:18688:0:(tgt_mount.c:167:server_get_mount()) get mount ffff9a9f0519b800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788530443.237407:0:18688:0:(tgt_mount.c:201:server_put_mount()) put mount ffff9a9f0519b800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788530443.237410:0:18688:0:(obd_mount.c:712:lustre_put_lsi()) put ffff9a9f0519b800 3 00010000:00080000:3.0:1788530443.237449:0:18688:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a9e025eb800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.141@tcp at head 00010000:00010000:3.0:1788530443.241881:0:18688:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:3.0:1788530443.242192:0:18688:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1788530443.242236:0:18688:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788530443.242251:0:18688:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xb28d70e12575192c 00000100:00080000:3.0:1788530443.242262:0:18688:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788530443.242268:0:18688:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9a9e025eb800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:3.0:1788530443.242303:0:18688:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9f328e7480 x1875409555894656/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788530443.242329:0:18688:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788530443.244097:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1875409555894656:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788530443.244205:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530443.244313:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555894656 00000100:00080000:1.0:1788530443.244315:0:12493:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788530443.244321:0:12493:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788530443.244324:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555894656 00000100:00080000:1.0:1788530443.244333:0:12493:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788530443.244336:0:12493:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788530443.244363:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1788530443.244367:0:12493:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:0.0:1788530443.244373:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1875409555894656:12345-0@lo:38:llog_process_th.0 00000100:00080000:1.0:1788530443.244374:0:12493:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788530443.244380:0:12493:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788530443.244384:0:12493:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00080000:0.0:1788530443.244416:0:17160:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 651 last 0 00000100:00100000:1.0:1788530443.244441:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555894784:0@lo:400:kworker.0 00000100:00100000:1.0:1788530443.244480:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:0.0:1788530443.244483:0:17160:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xb28d70e125751933 00000004:00100000:0.0:1788530443.244500:0:17160:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:1.0:1788530443.244505:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788530443.244514:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875409555894912:0@lo:400:kworker.0 00000100:00100000:1.0:1788530443.244539:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788530443.244549:0:17160:0:(import.c:65:import_set_state_nolock()) ffff9a9e0223b800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788530443.244600:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555895040:0@lo:400:kworker.0 00000100:00100000:1.0:1788530443.244636:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530443.244649:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875409555894656:12345-0@lo:38:llog_process_th.0 Request processed in 275us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530443.244661:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788530443.244668:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875409555895168:0@lo:400:kworker.0 00000100:00100000:1.0:1788530443.244689:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530443.244721:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555894784 00000100:00100000:1.0:1788530443.244725:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555894784 00000100:00100000:1.0:1788530443.244751:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555895040 00000100:00100000:1.0:1788530443.244754:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555895040 00000100:00100000:1.0:1788530443.244768:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788530443.244774:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555894784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530443.244812:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555894784:12345-0@lo:400:kworker.0 Request processed in 38us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530443.244827:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788530443.244843:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788530443.244849:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555895040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530443.244882:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555895040:12345-0@lo:400:kworker.0 Request processed in 33us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530443.244888:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788530443.244905:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555894912 00000100:00100000:1.0:1788530443.244909:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555894912 00000100:00100000:0.0:1788530443.244913:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788530443.244926:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555895168 00000100:00100000:1.0:1788530443.244930:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555895168 00000100:00100000:0.0:1788530443.244939:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788530443.244949:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875409555894912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530443.244996:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875409555894912:12345-0@lo:400:kworker.0 Request processed in 38us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530443.248125:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788530443.248143:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875409555895168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530443.248247:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875409555895168:12345-0@lo:400:kworker.0 Request processed in 111us (3556us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530443.248254:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1788530443.248312:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a9f328e7480 x1875409555894656/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788530453 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530443.248323:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788530443.248334:0:3646:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1788530443.248342:0:3646:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788530443.248347:0:3646:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788530443.248350:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9e025eb800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788530443.248356:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1875409555894656:0@lo:38:llog_process_th.0 00000020:01000004:3.0:1788530443.248892:0:18688:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788530443.248913:0:18688:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9a9f39650000) 00000020:00000080:3.0:1788530443.248938:0:18688:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:3.0:1788530443.249161:0:18688:0:(tgt_mount.c:167:server_get_mount()) get mount ffff9a9f0519b800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788530443.249165:0:18688:0:(tgt_mount.c:201:server_put_mount()) put mount ffff9a9f0519b800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788530443.249168:0:18688:0:(obd_mount.c:712:lustre_put_lsi()) put ffff9a9f0519b800 3 00010000:00080000:3.0:1788530443.249195:0:18688:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a9e025e9800@lustre-MDT0001-lwp-OST0000: add connection 192.168.202.141@tcp at head 00000100:00100000:0.0:1788530443.249816:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1788530443.250633:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a9f3d2b8000 x1875409555894912/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530459 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530443.250674:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875409555894912:0@lo:400:kworker.0 00000100:00100000:1.0:1788530443.250711:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555894784:0@lo:400:kworker.0 00010000:00080000:1.0:1788530443.250758:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a9f3d2b8a80 x1875409555895168/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530459 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530443.250768:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875409555895168:0@lo:400:kworker.0 00000100:00100000:1.0:1788530443.250779:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555895040:0@lo:400:kworker.0 00010000:00010000:3.0:1788530443.256133:0:18688:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:3.0:1788530443.256528:0:18688:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1788530443.256599:0:18688:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788530443.256616:0:18688:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xb28d70e125751941 00000100:00080000:3.0:1788530443.256627:0:18688:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788530443.256634:0:18688:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9a9e025e9800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:3.0:1788530443.256682:0:18688:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9f328e5500 x1875409555895296/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788530443.256703:0:18688:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1788530443.256855:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3646:1875409555895296:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788530443.256930:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530443.257208:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555895296 00000100:00100000:3.0:1788530443.257216:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555895296 00000100:00080000:1.0:1788530443.257737:0:12493:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788530443.257744:0:12493:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788530443.257747:0:12493:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788530443.257750:0:12493:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788530443.257754:0:12493:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788530443.257758:0:12493:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788530443.257761:0:12493:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788530443.257764:0:12493:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788530443.257776:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788530443.257786:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1875409555895296:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788530443.257817:0:17159:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 651 last 0 00000020:00000080:3.0:1788530443.257850:0:17159:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xb28d70e125751948 00000004:00100000:3.0:1788530443.257869:0:17159:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788530443.257903:0:17159:0:(import.c:65:import_set_state_nolock()) ffff9a9f274df000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788530443.258152:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875409555895296:12345-0@lo:38:llog_process_th.0 Request processed in 363us (1219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530443.258162:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788530443.258740:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a9f328e5500 x1875409555895296/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788530453 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530443.258753:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788530443.258762:0:3646:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1788530443.258778:0:3646:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788530443.258784:0:3646:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788530443.258787:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9e025e9800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788530443.258794:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3646:1875409555895296:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1788530443.259765:0:18688:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x18:0x0] index 52 count 51 00000020:01000000:1.0:1788530443.259890:0:18662:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1788530443.259905:0:18662:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788530443.259921:0:18662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36ba00/0xb28d70e125751917 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575191e expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530443.259937:0:18662:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36ba00/0xb28d70e125751917 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575191e expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788530443.259999:0:18662:0:(tgt_mount.c:1239:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788530443.260002:0:18662:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788530443.260003:0:18662:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788530443.260004:0:18662:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:1.0:1788530443.260006:0:18662:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:1.0:1788530443.260007:0:18662:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:1.0:1788530443.260009:0:18662:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788530443.260011:0:18662:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788530443.260013:0:18662:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788530443.260018:0:18662:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1788530443.260020:0:18662:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788530443.260022:0:18662:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788530443.260023:0:18662:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788530443.260024:0:18662:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:1.0:1788530443.260025:0:18662:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:1.0:1788530443.260026:0:18662:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:1.0:1788530443.260027:0:18662:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788530443.260029:0:18662:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788530443.260030:0:18662:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788530443.260062:0:18662:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788530443.260089:0:18662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2b8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:18662:1875409555895424:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788530443.260360:0:18662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530443.260418:0:18662:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e0273b480 going to sleep for 11 seconds 00000100:00100000:3.0:1788530443.261486:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555895424 00000100:00100000:3.0:1788530443.261495:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555895424 00000100:00100000:3.0:1788530443.261576:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788530443.261586:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+24:18662:x1875409555895424:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788530443.261615:0:17153:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788530443.261630:0:17153:0:(mgs_nids.c:468:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788530443.265699:0:17153:0:(mgs_nids.c:833:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788530443.265724:0:17153:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1788530443.266160:0:17174:0:(mgs_nids.c:730:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788530443.266166:0:17174:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788530443.266194:0:17174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a9f012eb800/0xb28d70e12575194f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530443.266218:0:17174:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a9f3d36a600/0xb28d70e12575187d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125751876 expref: 24 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530443.266226:0:17174:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a9f3d36b600/0xb28d70e12575188b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125751884 expref: 24 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530443.266232:0:17174:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a9f3d101c00/0xb28d70e125751902 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e1257518fb expref: 24 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530443.266239:0:17174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a9f012eb800/0xb28d70e12575194f lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530443.266303:0:17174:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a9f3d101c00/0xb28d70e125751902 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb28d70e1257518fb expref: 24 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530443.266321:0:17174:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a9f3d101c00/0xb28d70e125751902 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb28d70e1257518fb expref: 24 pid: 17151 timeout: 751 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530443.266339:0:17174:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2b9180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17174:1875409555895552:0@lo:104: 00000100:00100000:1.0:1788530443.266429:0:17174:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788530443.266487:0:17174:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a9f3d36b600/0xb28d70e12575188b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb28d70e125751884 expref: 24 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530443.266495:0:17174:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a9f3d36b600/0xb28d70e12575188b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb28d70e125751884 expref: 24 pid: 17153 timeout: 751 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530443.266515:0:17174:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2ba680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17174:1875409555895680:0@lo:104: 00000100:00100000:1.0:1788530443.266542:0:17174:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788530443.266609:0:17174:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a9f3d36a600/0xb28d70e12575187d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb28d70e125751876 expref: 24 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530443.266619:0:17174:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a9f3d36a600/0xb28d70e12575187d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb28d70e125751876 expref: 24 pid: 17154 timeout: 751 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530443.266628:0:17143:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788530443.266628:0:17174:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2ba300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17174:1875409555895808:0@lo:104: 00000100:00100000:2.0:1788530443.266657:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555895552 00000100:00100000:2.0:1788530443.266665:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555895552 00000100:00100000:1.0:1788530443.266670:0:17174:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530443.266683:0:17174:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e0273b600 going to sleep for 11 seconds 00000100:00100000:2.0:1788530443.266704:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555895680 00000100:00100000:2.0:1788530443.266708:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555895680 00000100:00100000:2.0:1788530443.266721:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555895808 00000100:00100000:2.0:1788530443.266724:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555895808 00000100:00100000:2.0:1788530443.266738:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788530443.266750:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+5:17174:x1875409555895552:12345-0@lo:104: 00010000:00010000:2.0:1788530443.266766:0:17143:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff9a9f012eb400/0xb28d70e1257518fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e125751902 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530443.266838:0:17143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788530443.266845:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+5:17174:x1875409555895552:12345-0@lo:104: Request processed in 98us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530443.266852:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788530443.266872:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788530443.266879:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03cfc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+4:17174:x1875409555895680:12345-0@lo:104: 00010000:00010000:2.0:1788530443.266886:0:17143:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36bc00/0xb28d70e125751884 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e12575188b expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530443.266919:0:17143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788530443.266924:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03cfc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+4:17174:x1875409555895680:12345-0@lo:104: Request processed in 47us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530443.266931:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788530443.266971:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788530443.266979:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37376d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+3:17174:x1875409555895808:12345-0@lo:104: 00010000:00010000:2.0:1788530443.266987:0:17143:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff9a9f3d100a00/0xb28d70e125751876 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e12575187d expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530443.267027:0:17143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788530443.267033:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37376d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+3:17174:x1875409555895808:12345-0@lo:104: Request processed in 55us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530443.267040:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788530443.267095:0:17174:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2b9180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17174:1875409555895552:0@lo:104: 00000100:00100000:2.0:1788530443.267105:0:17174:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2ba680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17174:1875409555895680:0@lo:104: 00000100:00100000:2.0:1788530443.267114:0:17174:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2ba300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17174:1875409555895808:0@lo:104: 00010000:00010000:2.0:1788530443.267138:0:17174:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a9f012eb800/0xb28d70e12575194f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530443.267355:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+24:18662:x1875409555895424:12345-0@lo:253:mount.lustre.0 Request processed in 5769us (6995us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530443.267364:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00010000:00010000:1.0:1788530443.267642:0:17147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788530443.267649:0:17147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f012eb400/0xb28d70e1257518fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e125751902 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530443.267710:0:17147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f012eb400 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:1.0:1788530443.267716:0:17147:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f012eb400/0xb28d70e1257518fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb28d70e125751902 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530443.267725:0:17147:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f012eb400/0xb28d70e1257518fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb28d70e125751902 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788530443.267732:0:17147:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f012eb400/0xb28d70e1257518fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb28d70e125751902 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788530443.267748:0:17147:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788530443.267827:0:17147:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9f012eb400/0xb28d70e1257518fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125751902 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530443.267834:0:17147:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788530443.267853:0:17147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f012eb400/0xb28d70e1257518fb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125751902 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530443.267868:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f012eb400/0xb28d70e1257518fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125751902 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530443.267879:0:17147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788530443.267882:0:17147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36bc00/0xb28d70e125751884 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e12575188b expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530443.267887:0:17147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d36bc00 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:1.0:1788530443.267890:0:17147:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36bc00/0xb28d70e125751884 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb28d70e12575188b expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530443.267897:0:17147:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36bc00/0xb28d70e125751884 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb28d70e12575188b expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788530443.267903:0:17147:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36bc00/0xb28d70e125751884 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb28d70e12575188b expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788530443.267908:0:17147:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788530443.268241:0:17147:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36bc00/0xb28d70e125751884 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e12575188b expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530443.268314:0:17147:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788530443.268327:0:17147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36bc00/0xb28d70e125751884 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e12575188b expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530443.268335:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36bc00/0xb28d70e125751884 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e12575188b expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530443.268343:0:17147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788530443.268347:0:17147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f3d100a00/0xb28d70e125751876 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e12575187d expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530443.268352:0:17147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d100a00 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:1.0:1788530443.268355:0:17147:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f3d100a00/0xb28d70e125751876 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb28d70e12575187d expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530443.268362:0:17147:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f3d100a00/0xb28d70e125751876 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb28d70e12575187d expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788530443.268368:0:17147:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f3d100a00/0xb28d70e125751876 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb28d70e12575187d expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788530443.268372:0:17147:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788530443.268442:0:17147:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9f3d100a00/0xb28d70e125751876 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e12575187d expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530443.268449:0:17147:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788530443.268463:0:17147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f3d100a00/0xb28d70e125751876 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e12575187d expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530443.268469:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f3d100a00/0xb28d70e125751876 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e12575187d expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530443.268487:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530443.268491:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530443.268493:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530443.268494:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788530443.268510:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37377100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:3647:1875409555895936:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788530443.268590:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530443.268634:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788530443.268640:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37374e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:3647:1875409555896064:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788530443.268690:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555895936 00000100:00100000:0.0:1788530443.268697:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555895936 00010000:00010000:0.0:1788530443.268725:0:17146:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a9f3d101c00/0xb28d70e125751902 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e1257518fb expref: 24 pid: 17151 timeout: 751 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530443.268768:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788530443.268777:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37377480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+24:3647:x1875409555895936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788530443.268791:0:17146:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788530443.268792:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788530443.268796:0:17146:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a9f3d101c00/0xb28d70e125751902 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e1257518fb expref: 24 pid: 17151 timeout: 751 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530443.268808:0:17146:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a9f3d101c00/0xb28d70e125751902 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb28d70e1257518fb expref: 24 pid: 17151 timeout: 751 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530443.268824:0:17146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f3d101c00/0xb28d70e125751902 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb28d70e1257518fb expref: 24 pid: 17151 timeout: 751 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530443.268839:0:17146:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788530443.268873:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37377480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+23:3647:x1875409555895936:12345-0@lo:103:ldlm_bl.0 Request processed in 97us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530443.268880:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788530443.269006:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37377100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:3647:1875409555895936:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788530443.269050:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37374a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:3649:1875409555896192:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788530443.269075:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530443.269733:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555896064 00000100:00100000:0.0:1788530443.269740:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555896064 00010000:00010000:0.0:1788530443.269761:0:17146:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a9f3d36b600/0xb28d70e12575188b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e125751884 expref: 23 pid: 17153 timeout: 751 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530443.269780:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788530443.269788:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f178eb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+23:3647:x1875409555896064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788530443.269800:0:17146:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788530443.269804:0:17146:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a9f3d36b600/0xb28d70e12575188b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e125751884 expref: 23 pid: 17153 timeout: 751 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530443.269814:0:17146:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a9f3d36b600/0xb28d70e12575188b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb28d70e125751884 expref: 23 pid: 17153 timeout: 751 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530443.269837:0:17146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f3d36b600/0xb28d70e12575188b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb28d70e125751884 expref: 23 pid: 17153 timeout: 751 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530443.269850:0:17146:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788530443.269897:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f178eb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+22:3647:x1875409555896064:12345-0@lo:103:ldlm_bl.0 Request processed in 110us (1105us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530443.269905:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788530443.269967:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37374e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:3647:1875409555896064:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788530443.270166:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555896192 00000100:00100000:0.0:1788530443.270171:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555896192 00010000:00010000:0.0:1788530443.270185:0:17146:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a9f3d36a600/0xb28d70e12575187d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e125751876 expref: 22 pid: 17154 timeout: 751 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530443.270261:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788530443.270268:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37377100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+22:3649:x1875409555896192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788530443.270276:0:17146:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788530443.270280:0:17146:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a9f3d36a600/0xb28d70e12575187d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e125751876 expref: 22 pid: 17154 timeout: 751 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530443.270289:0:17146:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a9f3d36a600/0xb28d70e12575187d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb28d70e125751876 expref: 22 pid: 17154 timeout: 751 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530443.270299:0:17146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f3d36a600/0xb28d70e12575187d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb28d70e125751876 expref: 22 pid: 17154 timeout: 751 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530443.270312:0:17146:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a9f012eb800/0xb28d70e12575194f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530443.270330:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f012eb800/0xb28d70e12575194f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788530443.270346:0:17146:0:(mgs_nids.c:706:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.011245978s 00010000:00010000:0.0:1788530443.270351:0:17146:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a9f012eb800/0xb28d70e12575194f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530443.270358:0:17146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a9f012eb800/0xb28d70e12575194f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530443.270419:0:17146:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a9f012eb800/0xb28d70e12575194f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530443.270427:0:17146:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a9f012eb800/0xb28d70e12575194f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530443.270433:0:17146:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f012eb800 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:0.0:1788530443.270437:0:17146:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a9f012eb800/0xb28d70e12575194f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530443.270446:0:17146:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a9f012eb800/0xb28d70e12575194f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530443.270462:0:17146:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a9f012eb800/0xb28d70e12575194f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530443.270471:0:17146:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788530443.270505:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37377100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+21:3649:x1875409555896192:12345-0@lo:103:ldlm_bl.0 Request processed in 238us (1429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530443.270511:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788530443.270547:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37374a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:3649:1875409555896192:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788530443.270661:0:17174:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a9f012eb800/0xb28d70e12575194f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530443.270670:0:17174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a9f012eb800/0xb28d70e12575194f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530443.270676:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f012eb800/0xb28d70e12575194f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530443.270770:0:18662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2b8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:18662:1875409555895424:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788530443.270784:0:18662:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788530443.270787:0:18662:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788530443.270789:0:18662:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788530443.270790:0:18662:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788530443.270791:0:18662:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:2.0:1788530443.270793:0:18662:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:2.0:1788530443.270795:0:18662:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:2.0:1788530443.270796:0:18662:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788530443.270798:0:18662:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788530443.270800:0:18662:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788530443.270827:0:18662:0:(tgt_mount.c:2823:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:1.0:1788530443.290752:0:18662:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1788530443.302301:0:18662:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1788530443.302312:0:18662:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1788530443.302356:0:18662:0:(tgt_mount.c:2543:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1788530443.302383:0:18662:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:0.0:1788530443.303229:0:18662:0:(tgt_mount.c:2429:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788530443.303474:0:18662:0:(tgt_mount.c:2444:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788530443.343832:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530444.367185:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788530444.620419:0:18741:0:(tgt_mount.c:2429:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788530444.620674:0:18741:0:(tgt_mount.c:2444:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:2.0:1788530444.738530:0:17156:0:(mgc_request.c:715:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788530444.738540:0:17156:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-mdtir-ffff9a9f0519b800 from 9 10000000:01000000:2.0:1788530444.738547:0:17156:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788530444.738799:0:17156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d20c600/0xb28d70e125751956 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530444.738821:0:17156:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f3d20c600/0xb28d70e125751956 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530444.738837:0:17156:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f3d20c600/0xb28d70e125751956 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530444.738870:0:17156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d3e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17156:1875409555896320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788530444.738977:0:17156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530444.739818:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f32a533c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788530444.743302:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555896320 00000100:00100000:0.0:1788530444.743318:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555896320 00000100:00100000:1.0:1788530444.748056:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788530444.748072:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+21:17156:x1875409555896320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788530444.748093:0:17151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530444.748124:0:17151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f012eb600/0xb28d70e12575195d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e125751956 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530444.748160:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f012eb600/0xb28d70e12575195d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e125751956 expref: 22 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530444.748172:0:17151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f012eb600/0xb28d70e12575195d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125751956 expref: 22 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530444.748181:0:17151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f012eb600, rc 0) 00000100:00100000:1.0:1788530444.748270:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+22:17156:x1875409555896320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 202us (9292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530444.748277:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788530444.749794:0:17156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d3e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17156:1875409555896320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788530444.749822:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f3d20c600/0xb28d70e125751956 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575195d expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530444.749833:0:17156:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f3d20c600/0xb28d70e125751956 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e12575195d expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530444.749901:0:17156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d3e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17156:1875409555896448:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788530444.749957:0:17156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530444.753608:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f32a533c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788530444.756853:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555896448 00000100:00100000:0.0:1788530444.756869:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555896448 00000100:00100000:0.0:1788530444.756927:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788530444.756937:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f22280450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+22:17156:x1875409555896448:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788530444.756962:0:17154:0:(mgs_nids.c:1159:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788530444.756981:0:17154:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788530444.756984:0:17154:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:0.0:1788530444.757743:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f22280450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+22:17156:x1875409555896448:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 805us (7784us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530444.757752:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788530444.757977:0:17156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d3e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17156:1875409555896448:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788530444.758037:0:17156:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788530444.758050:0:17156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d20c600/0xb28d70e125751956 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575195d expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530444.758062:0:17156:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f3d20c600/0xb28d70e125751956 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575195d expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788530444.758090:0:17156:0:(mgc_request.c:715:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788530444.758093:0:17156:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-mdtir-ffff9a9e03637800 from 9 10000000:01000000:2.0:1788530444.758096:0:17156:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788530444.758148:0:17156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d20ce00/0xb28d70e125751964 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530444.758334:0:17156:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f3d20ce00/0xb28d70e125751964 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530444.758345:0:17156:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f3d20ce00/0xb28d70e125751964 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530444.758367:0:17156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d3e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17156:1875409555896576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788530444.758421:0:17156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530444.758533:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f32a533c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788530444.758849:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555896576 00000100:00100000:0.0:1788530444.758856:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555896576 00000100:00100000:0.0:1788530444.758892:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788530444.758900:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f051ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+22:17156:x1875409555896576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788530444.758911:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530444.758925:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f3d100a00/0xb28d70e12575196b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e125751964 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530444.758947:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f3d100a00/0xb28d70e12575196b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e125751964 expref: 23 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530444.758959:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f3d100a00/0xb28d70e12575196b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125751964 expref: 23 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530444.758967:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d100a00, rc 0) 00000100:00100000:0.0:1788530444.759000:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f051ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+23:17156:x1875409555896576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530444.759007:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788530444.759261:0:17156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d3e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17156:1875409555896576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788530444.759277:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f3d20ce00/0xb28d70e125751964 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575196b expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530444.759286:0:17156:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f3d20ce00/0xb28d70e125751964 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e12575196b expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530444.759339:0:17156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d3e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17156:1875409555896704:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788530444.759376:0:17156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530444.759410:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f32a533c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788530444.759875:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555896704 00000100:00100000:1.0:1788530444.759881:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555896704 00000100:00100000:1.0:1788530444.760322:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788530444.760333:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f051adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+23:17156:x1875409555896704:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788530444.760355:0:17151:0:(mgs_nids.c:1159:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788530444.760373:0:17151:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788530444.760376:0:17151:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:1.0:1788530444.761543:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f051adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+23:17156:x1875409555896704:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 1208us (2162us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530444.761555:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788530444.761850:0:17156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d3e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17156:1875409555896704:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788530444.761926:0:17156:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788530444.761942:0:17156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d20ce00/0xb28d70e125751964 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575196b expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530444.761953:0:17156:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f3d20ce00/0xb28d70e125751964 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e12575196b expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788530444.761967:0:17156:0:(mgc_request.c:715:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788530444.761969:0:17156:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-mdtir-ffff9a9f202a8800 from 9 10000000:01000000:2.0:1788530444.761972:0:17156:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788530444.762003:0:17156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d20c400/0xb28d70e125751972 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530444.762519:0:17156:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f3d20c400/0xb28d70e125751972 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530444.762533:0:17156:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f3d20c400/0xb28d70e125751972 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530444.762554:0:17156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d3e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17156:1875409555896832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788530444.762638:0:17156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530444.763258:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f32a533c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788530444.763330:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555896832 00000100:00100000:0.0:1788530444.763337:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555896832 00000100:00100000:0.0:1788530444.763395:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788530444.763404:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f051af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+23:17156:x1875409555896832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788530444.763415:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530444.763429:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f3d100400/0xb28d70e125751979 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e125751972 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530444.763821:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f3d100400/0xb28d70e125751979 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e125751972 expref: 24 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530444.763835:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f3d100400/0xb28d70e125751979 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125751972 expref: 24 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530444.763857:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d100400, rc 0) 00000100:00100000:0.0:1788530444.763903:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f051af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+24:17156:x1875409555896832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 499us (1264us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530444.763910:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788530444.764002:0:17156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d3e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17156:1875409555896832:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788530444.764226:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f3d20c400/0xb28d70e125751972 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751979 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530444.764238:0:17156:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f3d20c400/0xb28d70e125751972 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e125751979 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530444.764294:0:17156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d3e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17156:1875409555896960:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788530444.764340:0:17156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530444.764375:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f32a533c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788530444.764765:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555896960 00000100:00100000:1.0:1788530444.765148:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555896960 00000100:00100000:2.0:1788530444.766432:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788530444.766455:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f051ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+24:17156:x1875409555896960:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788530444.766478:0:17151:0:(mgs_nids.c:1159:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788530444.766493:0:17151:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788530444.766496:0:17151:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:2.0:1788530444.766623:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f051ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+24:17156:x1875409555896960:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 181us (2282us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530444.766631:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788530444.766768:0:17156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d3e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17156:1875409555896960:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788530444.766839:0:17156:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788530444.766850:0:17156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d20c400/0xb28d70e125751972 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751979 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530444.766860:0:17156:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f3d20c400/0xb28d70e125751972 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751979 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530445.376706:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788530445.901320:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788530445.901354:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555897088:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788530445.901443:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530445.901492:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03736a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555897216:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788530445.901514:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530445.901547:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555897088 00000100:00100000:0.0:1788530445.901555:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555897088 00000100:00100000:0.0:1788530445.901608:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555897216 00000100:00100000:0.0:1788530445.901611:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555897216 00000100:00100000:0.0:1788530445.901626:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788530445.901648:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03734000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555897088:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788530445.901683:0:17164:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788530445.901723:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03734000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555897088:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530445.901740:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788530445.901760:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788530445.901766:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03737100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555897216:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788530445.902427:0:17164:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788530445.902476:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03737100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555897216:12345-0@lo:41:osp-pre-0-1.0 Request processed in 709us (960us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530445.902484:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788530445.902548:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03736a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555897216:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788530445.902700:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555897088:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788530446.400922:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530447.425970:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788530448.002483:0:17913:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788530448.449178:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788530448.452279:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788530448.452287:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788530448.452290:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788530448.452293:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788530448.452311:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788530448.452314:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788530448.452325:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788530448.452327:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788530448.452387:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555897728:0@lo:400:kworker.0 00000100:00100000:3.0:1788530448.452456:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530448.452500:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788530448.452507:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:3647:1875409555897344:0@lo:400:kworker.0 00000100:00100000:3.0:1788530448.452539:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530448.452663:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875409555897856:0@lo:400:kworker.0 00000100:00100000:3.0:1788530448.452694:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530448.452727:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555897472:0@lo:400:kworker.0 00000100:00100000:3.0:1788530448.452755:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530448.452776:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875409555897984:0@lo:400:kworker.0 00000100:00100000:3.0:1788530448.452806:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530448.452828:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788530448.452833:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875409555897600:0@lo:400:kworker.0 00000100:00100000:3.0:1788530448.452856:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530448.452871:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875409555898112:0@lo:400:kworker.0 00000100:00100000:3.0:1788530448.452895:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530448.452932:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555897728 00000100:00100000:3.0:1788530448.452941:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555897728 00000100:00100000:3.0:1788530448.452997:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555897472 00000100:00100000:3.0:1788530448.453000:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555897472 00000100:00100000:3.0:1788530448.453020:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788530448.453030:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555897728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530448.453097:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555897728:12345-0@lo:400:kworker.0 Request processed in 67us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530448.453114:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788530448.453132:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788530448.453138:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555897472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530448.453172:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555897472:12345-0@lo:400:kworker.0 Request processed in 34us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530448.453179:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788530448.453197:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555897344 00000100:00100000:3.0:1788530448.453201:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555897344 00000100:00100000:3.0:1788530448.453223:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788530448.453228:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f051afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+24:3647:x1875409555897344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530448.453280:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f051afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+24:3647:x1875409555897344:12345-0@lo:400:kworker.0 Request processed in 52us (740us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530448.453288:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788530448.453321:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555897856 00000100:00100000:3.0:1788530448.453325:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555897856 00000100:00100000:3.0:1788530448.453353:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555897984 00000100:00100000:3.0:1788530448.453356:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555897984 00000100:00100000:3.0:1788530448.453379:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555897600 00000100:00100000:3.0:1788530448.453382:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555897600 00000100:00100000:3.0:1788530448.453392:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555898112 00000100:00100000:3.0:1788530448.453394:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555898112 00000100:00100000:3.0:1788530448.453408:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788530448.453414:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875409555897856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530448.453445:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875409555897856:12345-0@lo:400:kworker.0 Request processed in 31us (750us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530448.453451:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788530448.453463:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788530448.453476:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875409555897984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530448.453504:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875409555897984:12345-0@lo:400:kworker.0 Request processed in 30us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530448.453510:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788530448.453520:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788530448.453526:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875409555897600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530448.453551:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875409555897600:12345-0@lo:400:kworker.0 Request processed in 24us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530448.453557:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788530448.453596:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788530448.453604:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875409555898112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530448.453628:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875409555898112:12345-0@lo:400:kworker.0 Request processed in 27us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530448.453634:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1788530448.453692:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9f328e6300 x1875409555897600/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530464 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530448.453707:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875409555897600:0@lo:400:kworker.0 00010000:00080000:3.0:1788530448.453718:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9f328e6d80 x1875409555898112/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530464 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530448.453726:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875409555898112:0@lo:400:kworker.0 00000100:00100000:3.0:1788530448.453736:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555897472:0@lo:400:kworker.0 00010000:00080000:3.0:1788530448.453745:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9f328e7480 x1875409555897984/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530464 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530448.453764:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875409555897984:0@lo:400:kworker.0 00000100:00100000:3.0:1788530448.453800:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:3647:1875409555897344:0@lo:400:kworker.0 00010000:00080000:3.0:1788530448.453811:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9f328e5500 x1875409555897856/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530464 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530448.453819:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875409555897856:0@lo:400:kworker.0 00000100:00100000:3.0:1788530448.453831:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555897728:0@lo:400:kworker.0 00000100:00080000:1.0:1788530448.457863:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788530448.457873:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:0.0:1788530448.897777:0:17192:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788530449.472730:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788530450.458844:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788530435/real 1788530435] req@ffff9a9f37377800 x1875409555889408/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788530450 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530450.458887:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a9f37377800 x1875409555889408/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788530450 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530450.458946:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788530435/real 1788530435] req@ffff9a9f37376300 x1875409555889536/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788530450 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530450.458959:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a9f37376300 x1875409555889536/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788530450 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788530450.458985:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9f08ce8000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788530450.459003:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788530450.459007:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37377800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875409555889408:0@lo:8:kworker.0 00000100:00080000:2.0:1788530450.459012:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9f0d6f0800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788530450.459034:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788530450.459037:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37376300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875409555889536:0@lo:8:kworker.0 00000100:00080000:1.0:1788530450.461295:0:12493:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788530450.461302:0:12493:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788530450.461304:0:12493:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788530450.461307:0:12493:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788530450.461343:0:12493:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788530450.461347:0:12493:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788530450.461350:0:12493:0:(import.c:65:import_set_state_nolock()) ffff9a9f08ce8000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788530450.461358:0:12493:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 643 00000100:00080000:1.0:1788530450.461364:0:12493:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788530450.461381:0:12493:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9a9f08ce8000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:1.0:1788530450.461405:0:12493:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9f37377480 x1875409555898752/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788530450.461420:0:12493:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788530450.461423:0:12493:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788530450.461425:0:12493:0:(import.c:65:import_set_state_nolock()) ffff9a9f0d6f0800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788530450.461428:0:12493:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 643 00000100:00080000:1.0:1788530450.461431:0:12493:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788530450.461434:0:12493:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9a9f0d6f0800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:1.0:1788530450.461446:0:12493:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9f05f44000 x1875409555898880/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788530450.461490:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37377800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555898368:0@lo:400:kworker.0 00000100:00100000:1.0:1788530450.461555:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530450.461605:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f05f44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875409555899136:0@lo:400:kworker.0 00000100:00100000:1.0:1788530450.461631:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530450.461660:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788530450.461666:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37376300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:3648:1875409555898240:0@lo:400:kworker.0 00000100:00100000:1.0:1788530450.461700:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530450.461730:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f05f45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875409555899008:0@lo:400:kworker.0 00000100:00100000:1.0:1788530450.461754:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530450.461782:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37374a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875409555898496:0@lo:400:kworker.0 00000100:00100000:1.0:1788530450.461805:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530450.461823:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f05f44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875409555899264:0@lo:400:kworker.0 00000100:00100000:1.0:1788530450.461843:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530450.461868:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788530450.461874:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37374e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555898624:0@lo:400:kworker.0 00000100:00100000:1.0:1788530450.461896:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530450.461933:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555898368 00000100:00100000:1.0:1788530450.461944:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555898368 00000100:00100000:1.0:1788530450.461997:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555898624 00000100:00100000:1.0:1788530450.462000:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555898624 00000100:00100000:1.0:1788530450.462019:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788530450.462028:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f05f47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555898368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530450.462084:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f05f47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555898368:12345-0@lo:400:kworker.0 Request processed in 56us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530450.462092:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788530450.462208:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788530450.462217:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f05f46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555898624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530450.462254:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f05f46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555898624:12345-0@lo:400:kworker.0 Request processed in 38us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530450.462260:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788530450.462280:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555899136 00000100:00100000:1.0:1788530450.462284:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555899136 00000100:00100000:1.0:1788530450.462320:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555899008 00000100:00100000:1.0:1788530450.462323:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555899008 00000100:00100000:1.0:1788530450.462348:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555898496 00000100:00100000:1.0:1788530450.462350:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555898496 00000100:00100000:1.0:1788530450.462360:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555899264 00000100:00100000:1.0:1788530450.462362:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555899264 00000100:00100000:1.0:1788530450.462376:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788530450.462382:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f05f45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875409555899136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530450.462418:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f05f45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875409555899136:12345-0@lo:400:kworker.0 Request processed in 36us (786us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530450.462434:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788530450.462446:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788530450.462451:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f05f47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875409555899008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530450.462476:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f05f47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875409555899008:12345-0@lo:400:kworker.0 Request processed in 25us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530450.462481:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788530450.462490:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788530450.462495:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f05f46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875409555898496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530450.462519:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f05f46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875409555898496:12345-0@lo:400:kworker.0 Request processed in 24us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530450.462525:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788530450.462534:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788530450.462540:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f05f47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875409555899264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530450.462586:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f05f47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875409555899264:12345-0@lo:400:kworker.0 Request processed in 47us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530450.462593:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1788530450.462645:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9f05f45880 x1875409555899008/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530466 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530450.462663:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f05f45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875409555899008:0@lo:400:kworker.0 00000100:00100000:1.0:1788530450.462676:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37377800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555898368:0@lo:400:kworker.0 00010000:00080000:1.0:1788530450.462685:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9f05f44380 x1875409555899136/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530466 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530450.462693:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f05f44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875409555899136:0@lo:400:kworker.0 00000100:00100000:1.0:1788530450.462735:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37374e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555898624:0@lo:400:kworker.0 00010000:00080000:1.0:1788530450.462745:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9f37374a80 x1875409555898496/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530466 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530450.462753:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37374a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875409555898496:0@lo:400:kworker.0 00010000:00080000:1.0:1788530450.462762:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9f05f44e00 x1875409555899264/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530466 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530450.462770:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f05f44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875409555899264:0@lo:400:kworker.0 00000100:00080000:1.0:1788530450.462787:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788530450.462791:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788530450.462941:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555898240 00000100:00100000:2.0:1788530450.462947:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555898240 00000100:00100000:2.0:1788530450.463012:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788530450.463020:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f051ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+24:3648:x1875409555898240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530450.463061:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f051ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+24:3648:x1875409555898240:12345-0@lo:400:kworker.0 Request processed in 43us (1360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530450.463068:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788530450.463116:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37377480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875409555898752:0@lo:8:kworker.0 00000100:00100000:2.0:1788530450.463144:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530450.463172:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f05f44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875409555898880:0@lo:8:kworker.0 00000100:00100000:2.0:1788530450.463193:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530450.463220:0:18667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555898752 00000100:00100000:2.0:1788530450.463224:0:18667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555898752 00000100:00100000:2.0:1788530450.463238:0:18667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555898880 00000100:00100000:2.0:1788530450.463240:0:18667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555898880 00000100:00100000:2.0:1788530450.463250:0:18667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788530450.463255:0:18667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3646:x1875409555898752:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788530450.463280:0:18667:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 658 last 0 00000020:00000080:2.0:1788530450.463312:0:18667:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb28d70e125751980 00002000:00100000:2.0:1788530450.463335:0:18667:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9a9f274bc800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a05 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:2.0:1788530450.463340:0:18667:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:2.0:1788530450.463342:0:18667:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788530450.463534:0:18667:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:2.0:1788530450.463578:0:18667:0:(import.c:65:import_set_state_nolock()) ffff9a9f274b8000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788530450.463625:0:18667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3646:x1875409555898752:12345-0@lo:8:kworker.0 Request processed in 369us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530450.463632:0:18667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788530450.463646:0:18667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788530450.463651:0:18667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3646:x1875409555898880:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1788530450.463663:0:18667:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788530450.466289:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37376300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:3648:1875409555898240:0@lo:400:kworker.0 00010000:00080000:3.0:1788530450.476890:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9f37377480 x1875409555898752/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788530470 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530450.476909:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788530450.476922:0:3646:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1788530450.476934:0:3646:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788530450.476941:0:3646:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788530450.476945:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9f08ce8000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788530450.476965:0:3646:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788530450.476972:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37377480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875409555898752:0@lo:8:kworker.0 00000004:00080000:3.0:1788530450.477036:0:17901:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:3.0:1788530450.477066:0:17901:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037e4a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17901:1875409555899520:0@lo:7:osp-pre-0-1.0 00000100:00100000:3.0:1788530450.477161:0:17901:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530450.477193:0:17901:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f02f27300 going to sleep for 11 seconds 00000100:00100000:3.0:1788530450.477214:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555899392:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788530450.477242:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530450.477299:0:18666:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788530450.477334:0:18666:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1788530450.477365:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555899392 00000100:00100000:3.0:1788530450.477373:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555899392 00000100:00100000:3.0:1788530450.477440:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788530450.477450:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3650:x1875409555899392:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788530450.477484:0:18670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788530450.477528:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3650:x1875409555899392:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530450.477535:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1788530450.477688:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788530450.477716:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9e037e5180 x1875409555899392/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530466 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530450.477733:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555899392:0@lo:13:osp-pre-0-1.0 00000004:00080000:1.0:1788530450.478227:0:17900:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788530450.478343:0:17900:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 658380781620ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788530450.478351:0:17900:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:3.0:1788530450.483374:0:17891:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:1.0:1788530450.487029:0:18666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555899520 00000100:00100000:1.0:1788530450.487046:0:18666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555899520 00000100:00100000:3.0:1788530450.487439:0:18966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788530450.487452:0:18966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17901:x1875409555899520:12345-0@lo:7:osp-pre-0-1.0 00000100:00100000:2.0:1788530450.499908:0:18667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3646:x1875409555898880:12345-0@lo:8:kworker.0 Request processed in 36249us (36707us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788530450.499923:0:18667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1788530450.499976:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9f0d6f0800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788530450.499982:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788530450.499985:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f05f44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875409555898880:0@lo:8:kworker.0 00010000:00010000:1.0:1788530450.501057:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1788530450.502150:0:18966:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:3.0:1788530450.502158:0:18966:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:3.0:1788530450.502243:0:18966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17901:x1875409555899520:12345-0@lo:7:osp-pre-0-1.0 Request processed in 14789us (25079us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530450.502253:0:18966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788530450.502438:0:17901:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9e037e4a80 x1875409555899520/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788530466 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530450.502455:0:17901:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037e4a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17901:1875409555899520:0@lo:7:osp-pre-0-1.0 00000004:00080000:1.0:1788530450.502470:0:17901:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:1.0:1788530450.502518:0:17901:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f05f44e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17901:1875409555899648:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1788530450.502594:0:17901:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530450.502622:0:17901:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e0247fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788530450.503047:0:18666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555899648 00000100:00100000:3.0:1788530450.503055:0:18666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555899648 00000100:00100000:3.0:1788530450.503107:0:18666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788530450.503118:0:18666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f05f44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17901:x1875409555899648:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1788530450.503151:0:18666:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:3.0:1788530450.503198:0:18666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f05f44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17901:x1875409555899648:12345-0@lo:5:osp-pre-0-1.0 Request processed in 81us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530450.504098:0:18666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788530450.504158:0:17901:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9f05f44e00 x1875409555899648/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788530466 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530450.504174:0:17901:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f05f44e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17901:1875409555899648:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1788530450.504187:0:17901:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:3.0:1788530450.504230:0:17901:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037e5180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17901:1875409555899776:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1788530450.505907:0:17901:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530450.505956:0:17901:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f02f276c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788530450.508179:0:18667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555899776 00000100:00100000:2.0:1788530450.508196:0:18667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555899776 00000100:00100000:2.0:1788530450.508274:0:18667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788530450.508285:0:18667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17901:x1875409555899776:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1788530450.508349:0:18667:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000001:00080000:2.0:1788530450.560034:0:18663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:2.0:1788530450.560053:0:18663:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1788530450.560841:0:18667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:17901:x1875409555899776:12345-0@lo:5:osp-pre-0-1.0 Request processed in 52549us (54931us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788530450.560856:0:18667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788530450.566524:0:17901:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9e037e5180 x1875409555899776/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788530466 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530450.566545:0:17901:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1788530450.566553:0:17901:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037e5180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17901:1875409555899776:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1788530450.566629:0:17901:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:2.0:1788530450.568352:0:17901:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03736a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17901:1875409555899904:0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1788530450.568459:0:17901:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530450.568509:0:17901:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f32a53240 going to sleep for 11 seconds 00000100:00100000:0.0:1788530450.568534:0:17169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555899904 00000100:00100000:0.0:1788530450.568546:0:17169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555899904 00000100:00100000:0.0:1788530450.568624:0:17169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788530450.568633:0:17169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17901:x1875409555899904:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1788530450.568707:0:17169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17901:x1875409555899904:12345-0@lo:900:osp-pre-0-1.0 Request processed in 75us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530450.568716:0:17169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788530450.573423:0:17901:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9e03736a00 x1875409555899904/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788530466 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530450.573460:0:17901:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03736a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17901:1875409555899904:0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1788530451.008729:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788530451.008756:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03735180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555900032:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788530451.008855:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530451.008919:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555900032 00000100:00100000:0.0:1788530451.008929:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555900032 00000100:00100000:0.0:1788530451.009007:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788530451.009018:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03736300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555900032:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788530451.009068:0:17164:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788530451.009124:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03736300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555900032:12345-0@lo:41:osp-pre-0-1.0 Request processed in 107us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530451.009132:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788530451.009193:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03735180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555900032:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788530451.010707:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555900160:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788530451.010793:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530451.013118:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555900160 00000100:00100000:1.0:1788530451.013140:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555900160 00000100:00100000:1.0:1788530451.013228:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788530451.013241:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03735180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555900160:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788530451.013300:0:17163:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788530451.013447:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03735180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555900160:12345-0@lo:41:osp-pre-1-0.0 Request processed in 208us (2651us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530451.013455:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788530451.013627:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555900160:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788530451.525787:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788530451.525914:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788530431/real 1788530431] req@ffff9a9f328e7800 x1875409555888256/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788530451 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530451.525969:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a9f328e7800 x1875409555888256/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788530451 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530451.525981:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788530431/real 1788530431] req@ffff9a9f37375c00 x1875409555887744/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788530451 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530451.525994:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a9f37375c00 x1875409555887744/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788530451 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788530451.526024:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9f37411800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788530451.526071:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788530451.526076:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875409555888256:0@lo:8:kworker.0 00000100:00080000:0.0:1788530451.526083:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9e024dd000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788530451.526089:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788530451.526092:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37375c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875409555887744:0@lo:8:kworker.0 00000100:00080000:1.0:1788530451.526377:0:12493:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788530451.526381:0:12493:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788530451.526384:0:12493:0:(import.c:65:import_set_state_nolock()) ffff9a9e024dd000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788530451.526390:0:12493:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 639 00000100:00080000:1.0:1788530451.526398:0:12493:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788530451.526409:0:12493:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9a9e024dd000 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:1.0:1788530451.526437:0:12493:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9f05f47100 x1875409555900544/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788530451.526453:0:12493:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788530451.526456:0:12493:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788530451.526458:0:12493:0:(import.c:65:import_set_state_nolock()) ffff9a9f37411800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788530451.526461:0:12493:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 639 00000100:00080000:1.0:1788530451.526464:0:12493:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788530451.526467:0:12493:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a9f37411800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:1.0:1788530451.526494:0:12493:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9f05f45500 x1875409555900672/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788530451.526541:0:12493:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788530451.526546:0:12493:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788530451.526547:0:12493:0:(import.c:65:import_set_state_nolock()) ffff9a9f0d6f0800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788530451.526551:0:12493:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 658 00000100:00080000:1.0:1788530451.526554:0:12493:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788530451.526557:0:12493:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9a9f0d6f0800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:1.0:1788530451.526611:0:12493:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9f05f44700 x1875409555901184/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788530451.526665:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f05f45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555900416:0@lo:400:kworker.0 00000100:00100000:1.0:1788530451.526759:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530451.526794:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f05f45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875409555901312:0@lo:400:kworker.0 00000100:00100000:1.0:1788530451.526823:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530451.526847:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788530451.526852:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f05f45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:3650:1875409555900288:0@lo:400:kworker.0 00000100:00100000:1.0:1788530451.526880:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530451.526908:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f05f44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555901056:0@lo:400:kworker.0 00000100:00100000:1.0:1788530451.526933:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530451.526963:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f05f46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875409555900800:0@lo:400:kworker.0 00000100:00100000:1.0:1788530451.526987:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530451.527019:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f05f44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875409555901440:0@lo:400:kworker.0 00000100:00100000:1.0:1788530451.527040:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530451.527057:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788530451.527072:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f05f46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555900928:0@lo:400:kworker.0 00000100:00100000:1.0:1788530451.527096:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530451.527114:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f05f44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875409555901568:0@lo:400:kworker.0 00000100:00100000:1.0:1788530451.527149:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530451.527185:0:17899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555900416 00000100:00100000:1.0:1788530451.527193:0:17899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555900416 00000100:00100000:1.0:1788530451.527228:0:17899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555900928 00000100:00100000:1.0:1788530451.527231:0:17899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555900928 00000100:00100000:1.0:1788530451.527248:0:17899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788530451.527256:0:17899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37375c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555900416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530451.527311:0:17899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37375c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555900416:12345-0@lo:400:kworker.0 Request processed in 55us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530451.527330:0:17899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788530451.527348:0:17899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788530451.527354:0:17899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37377800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555900928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530451.527390:0:17899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37377800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555900928:12345-0@lo:400:kworker.0 Request processed in 36us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530451.527397:0:17899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788530451.527415:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555901312 00000100:00100000:1.0:1788530451.527419:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555901312 00000100:00100000:1.0:1788530451.527438:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555900800 00000100:00100000:1.0:1788530451.527441:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555900800 00000100:00100000:1.0:1788530451.527451:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555901440 00000100:00100000:1.0:1788530451.527453:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555901440 00000100:00100000:1.0:1788530451.527465:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555901568 00000100:00100000:1.0:1788530451.527467:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555901568 00000100:00100000:1.0:1788530451.527478:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788530451.527484:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37377480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875409555901312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530451.527525:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37377480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875409555901312:12345-0@lo:400:kworker.0 Request processed in 40us (701us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530451.527531:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788530451.527543:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788530451.527548:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37374a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875409555900800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530451.527603:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37374a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875409555900800:12345-0@lo:400:kworker.0 Request processed in 55us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530451.527609:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788530451.527621:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788530451.527626:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37374e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875409555901440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530451.527673:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37374e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875409555901440:12345-0@lo:400:kworker.0 Request processed in 45us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530451.527678:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788530451.527691:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788530451.527697:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f2b92e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875409555901568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530451.527722:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f2b92e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875409555901568:12345-0@lo:400:kworker.0 Request processed in 25us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530451.527728:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788530451.527748:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555900288 00000100:00100000:1.0:1788530451.527751:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555900288 00000100:00100000:1.0:1788530451.527780:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788530451.527786:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f051ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+24:3650:x1875409555900288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530451.527817:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f051ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+24:3650:x1875409555900288:12345-0@lo:400:kworker.0 Request processed in 30us (935us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530451.527822:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788530451.527865:0:18666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555901056 00000100:00100000:1.0:1788530451.527869:0:18666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555901056 00000100:00100000:1.0:1788530451.527897:0:18666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788530451.527904:0:18666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37376300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555901056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530451.527934:0:18666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37376300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555901056:12345-0@lo:400:kworker.0 Request processed in 30us (1000us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530451.527940:0:18666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788530451.528004:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f05f46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555900928:0@lo:400:kworker.0 00010000:00080000:1.0:1788530451.528016:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9f05f44000 x1875409555901568/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530467 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530451.528026:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f05f44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875409555901568:0@lo:400:kworker.0 00010000:00080000:1.0:1788530451.528035:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9f05f46300 x1875409555900800/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530467 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530451.528042:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f05f46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875409555900800:0@lo:400:kworker.0 00010000:00080000:1.0:1788530451.528052:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9f05f44e00 x1875409555901440/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530467 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530451.528058:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f05f44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875409555901440:0@lo:400:kworker.0 00000100:00100000:1.0:1788530451.528086:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f05f47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875409555900544:0@lo:8:kworker.0 00000100:00100000:1.0:1788530451.528123:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530451.528143:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f05f45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875409555900672:0@lo:8:kworker.0 00000100:00100000:1.0:1788530451.528168:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530451.528183:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f05f44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875409555901184:0@lo:8:kworker.0 00000100:00100000:1.0:1788530451.528201:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530451.528238:0:18666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555900544 00000100:00100000:1.0:1788530451.528242:0:18666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555900544 00000100:00100000:1.0:1788530451.528256:0:18666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555900672 00000100:00100000:1.0:1788530451.528259:0:18666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555900672 00000100:00100000:1.0:1788530451.528265:0:18666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555901184 00000100:00100000:1.0:1788530451.528267:0:18666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555901184 00000100:00100000:1.0:1788530451.528276:0:18666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788530451.528280:0:18666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f2b92dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3646:x1875409555900544:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788530451.528305:0:18666:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 659 last 0 00000020:00000080:1.0:1788530451.528343:0:18666:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb28d70e125751987 00002000:00100000:1.0:1788530451.528357:0:18666:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9a9f33b6d800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a05 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788530451.528361:0:18666:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1788530451.528364:0:18666:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788530451.528459:0:18666:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788530451.528490:0:18666:0:(import.c:65:import_set_state_nolock()) ffff9a9f33b6f000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788530451.528529:0:18666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f2b92dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1875409555900544:12345-0@lo:8:kworker.0 Request processed in 246us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530451.528535:0:18666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788530451.528548:0:18666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788530451.528551:0:18666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f2b92f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3646:x1875409555900672:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788530451.528597:0:18666:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788530451.528625:0:18666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f2b92f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3646:x1875409555900672:12345-0@lo:8:kworker.0 Request processed in 72us (456us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788530451.528631:0:18666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788530451.528642:0:18666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788530451.528645:0:18666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f2b92c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3646:x1875409555901184:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788530451.528655:0:18666:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788530451.528689:0:18666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f2b92c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3646:x1875409555901184:12345-0@lo:8:kworker.0 Request processed in 41us (487us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788530451.528694:0:18666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788530451.528726:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f05f45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:3650:1875409555900288:0@lo:400:kworker.0 00010000:00080000:1.0:1788530451.528741:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9f05f44a80 x1875409555901056/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788530467 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530451.528749:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f05f44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555901056:0@lo:400:kworker.0 00000100:00100000:1.0:1788530451.528760:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f05f45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555900416:0@lo:400:kworker.0 00010000:00080000:1.0:1788530451.528770:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9f05f45f80 x1875409555901312/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530467 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530451.528778:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f05f45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875409555901312:0@lo:400:kworker.0 00010000:00080000:1.0:1788530451.528807:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9f05f47100 x1875409555900544/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788530476 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530451.528815:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788530451.528825:0:3646:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1788530451.528836:0:3646:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788530451.528844:0:3646:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788530451.528847:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9e024dd000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788530451.528863:0:3646:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788530451.528869:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f05f47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875409555900544:0@lo:8:kworker.0 00000100:00080000:1.0:1788530451.528882:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9f37411800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788530451.528887:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788530451.528890:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f05f45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875409555900672:0@lo:8:kworker.0 00000100:00080000:1.0:1788530451.528912:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9f0d6f0800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788530451.528916:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788530451.528919:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f05f44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875409555901184:0@lo:8:kworker.0 00000004:00080000:1.0:1788530451.528950:0:17182:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788530451.529034:0:17182:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 659431472390ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788530451.529040:0:17182:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:3.0:1788530451.533768:0:17183:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x5:0x0] 00000100:00100000:3.0:1788530451.533796:0:17183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037e5500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17183:1875409555901824:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788530451.533879:0:17183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530451.533913:0:17183:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f02f279c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788530451.537629:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555901696:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788530451.537746:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530451.538118:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555901696 00000100:00100000:3.0:1788530451.538145:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555901696 00000100:00100000:3.0:1788530451.538225:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788530451.538237:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03734a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1875409555901696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788530451.538263:0:18670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788530451.538329:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03734a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1875409555901696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530451.538336:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1788530451.538467:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788530451.538503:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9e037e5c00 x1875409555901696/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530467 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530451.538525:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555901696:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788530451.540648:0:18666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555901824 00000100:00100000:1.0:1788530451.540667:0:18666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555901824 00000100:00100000:1.0:1788530451.540741:0:18666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788530451.540751:0:18666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17183:x1875409555901824:12345-0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788530451.573445:0:17139:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:0.0:1788530451.575294:0:18666:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:0.0:1788530451.575309:0:18666:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1788530451.575328:0:18666:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:6 to 0x280000401:33) 00002000:00010000:0.0:1788530451.609215:0:18666:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788530451.609229:0:18666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000740adb52/0xb28d70e12575198e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530451.609252:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=659s v=(0 0) 00010000:00010000:0.0:1788530451.609258:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788530451.609266:0:18666:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000740adb52/0xb28d70e12575198e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530451.609287:0:18666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000740adb52/0xb28d70e12575198e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530451.609339:0:18666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000740adb52/0xb28d70e12575198e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530451.609357:0:18666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000740adb52/0xb28d70e12575198e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530451.609387:0:18666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788530451.610249:0:17147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788530451.610256:0:17147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000740adb52/0xb28d70e12575198e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530451.610275:0:17147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d101c00 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:2.0:1788530451.610279:0:17147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000740adb52/0xb28d70e12575198e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530451.610286:0:17147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000740adb52/0xb28d70e12575198e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530451.610302:0:17147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000740adb52/0xb28d70e12575198e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530451.610306:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000740adb52/0xb28d70e12575198e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530451.610334:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530451.610335:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530451.610337:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788530451.611206:0:18666:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788530451.611214:0:18666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e140aa82/0xb28d70e125751995 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530451.611225:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=659s v=(0 0) 00010000:00010000:0.0:1788530451.611228:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788530451.611232:0:18666:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e140aa82/0xb28d70e125751995 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530451.611241:0:18666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e140aa82/0xb28d70e125751995 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530451.611247:0:18666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e140aa82/0xb28d70e125751995 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530451.611252:0:18666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e140aa82/0xb28d70e125751995 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530451.611284:0:18666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788530451.611579:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788530451.611585:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e140aa82/0xb28d70e125751995 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530451.611593:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d101000 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:2.0:1788530451.611597:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e140aa82/0xb28d70e125751995 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530451.611606:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e140aa82/0xb28d70e125751995 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530451.611627:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e140aa82/0xb28d70e125751995 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530451.611635:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e140aa82/0xb28d70e125751995 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530451.611653:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530451.611655:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530451.611657:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788530451.611877:0:18666:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788530451.611884:0:18666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8c35e1e/0xb28d70e12575199c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530451.611895:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=659s v=(0 0) 00010000:00010000:0.0:1788530451.611898:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788530451.611904:0:18666:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8c35e1e/0xb28d70e12575199c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530451.611915:0:18666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8c35e1e/0xb28d70e12575199c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530451.611924:0:18666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8c35e1e/0xb28d70e12575199c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530451.611931:0:18666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d8c35e1e/0xb28d70e12575199c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530451.611991:0:18666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788530451.614104:0:18666:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788530451.614122:0:18666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b041fcc7/0xb28d70e1257519a3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530451.614150:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=659s v=(0 0) 00010000:00010000:1.0:1788530451.614156:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788530451.614163:0:18666:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b041fcc7/0xb28d70e1257519a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530451.614180:0:18666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b041fcc7/0xb28d70e1257519a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530451.614191:0:18666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b041fcc7/0xb28d70e1257519a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530451.614200:0:18666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b041fcc7/0xb28d70e1257519a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530451.614223:0:18666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788530451.614406:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788530451.614414:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d8c35e1e/0xb28d70e12575199c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530451.614423:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d101600 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:1.0:1788530451.614427:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8c35e1e/0xb28d70e12575199c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530451.614436:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8c35e1e/0xb28d70e12575199c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530451.614452:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d8c35e1e/0xb28d70e12575199c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530451.614459:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8c35e1e/0xb28d70e12575199c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530451.614481:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788530451.614484:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b041fcc7/0xb28d70e1257519a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530451.614491:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f012eae00 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:1.0:1788530451.614494:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b041fcc7/0xb28d70e1257519a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530451.614513:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b041fcc7/0xb28d70e1257519a3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530451.614525:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b041fcc7/0xb28d70e1257519a3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530451.614531:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b041fcc7/0xb28d70e1257519a3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530451.614687:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788530451.616739:0:18666:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788530451.616753:0:18666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000870096cb/0xb28d70e1257519aa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530451.616772:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=659s v=(0 0) 00010000:00010000:2.0:1788530451.616778:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788530451.616786:0:18666:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000870096cb/0xb28d70e1257519aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530451.616800:0:18666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000870096cb/0xb28d70e1257519aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530451.616813:0:18666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000870096cb/0xb28d70e1257519aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530451.616821:0:18666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000870096cb/0xb28d70e1257519aa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530451.616849:0:18666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788530451.617056:0:17147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:2.0:1788530451.617682:0:18666:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788530451.617691:0:18666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d61a655b/0xb28d70e1257519b1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530451.617898:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=659s v=(0 0) 00010000:00010000:2.0:1788530451.617904:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788530451.617909:0:18666:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d61a655b/0xb28d70e1257519b1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530451.617920:0:18666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d61a655b/0xb28d70e1257519b1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530451.617929:0:18666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d61a655b/0xb28d70e1257519b1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530451.617937:0:18666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d61a655b/0xb28d70e1257519b1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530451.617947:0:18666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788530451.619248:0:18666:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788530451.619261:0:18666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038101456/0xb28d70e1257519b8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530451.619276:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=659s v=(0 0) 00010000:00010000:2.0:1788530451.619292:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788530451.619299:0:18666:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000038101456/0xb28d70e1257519b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530451.619313:0:18666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000038101456/0xb28d70e1257519b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530451.619337:0:18666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038101456/0xb28d70e1257519b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530451.619345:0:18666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000038101456/0xb28d70e1257519b8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530451.619488:0:18666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788530451.620085:0:18666:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788530451.620093:0:18666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e2d8757/0xb28d70e1257519bf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530451.620104:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=659s v=(0 0) 00010000:00010000:2.0:1788530451.620108:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788530451.620113:0:18666:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e2d8757/0xb28d70e1257519bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530451.620137:0:18666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e2d8757/0xb28d70e1257519bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530451.620145:0:18666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e2d8757/0xb28d70e1257519bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530451.620161:0:18666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000e2d8757/0xb28d70e1257519bf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530451.620171:0:18666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1788530451.620718:0:18666:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788530451.620726:0:18666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077558c59/0xb28d70e1257519c6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530451.620735:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=659s v=(0 0) 00010000:00010000:2.0:1788530451.620738:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788530451.620743:0:18666:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000077558c59/0xb28d70e1257519c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530451.620753:0:18666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000077558c59/0xb28d70e1257519c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530451.620761:0:18666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077558c59/0xb28d70e1257519c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530451.620768:0:18666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000077558c59/0xb28d70e1257519c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530451.620776:0:18666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:2.0:1788530451.621189:0:18666:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788530451.621195:0:18666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb885740/0xb28d70e1257519cd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530451.621212:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=659s v=(0 0) 00010000:00010000:2.0:1788530451.621215:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788530451.621219:0:18666:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb885740/0xb28d70e1257519cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530451.621229:0:18666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb885740/0xb28d70e1257519cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530451.621238:0:18666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb885740/0xb28d70e1257519cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530451.621245:0:18666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb885740/0xb28d70e1257519cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530451.621255:0:18666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:2.0:1788530451.622102:0:18666:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788530451.622112:0:18666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e814926/0xb28d70e1257519d4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530451.622134:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=659s v=(0 0) 00010000:00010000:2.0:1788530451.622137:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788530451.622143:0:18666:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e814926/0xb28d70e1257519d4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530451.622153:0:18666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e814926/0xb28d70e1257519d4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530451.622175:0:18666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e814926/0xb28d70e1257519d4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530451.622183:0:18666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e814926/0xb28d70e1257519d4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530451.622192:0:18666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:2.0:1788530451.622814:0:18666:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788530451.622822:0:18666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000474cdc60/0xb28d70e1257519db lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530451.622834:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=659s v=(0 0) 00010000:00010000:2.0:1788530451.622838:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788530451.622844:0:18666:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000474cdc60/0xb28d70e1257519db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530451.622854:0:18666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000474cdc60/0xb28d70e1257519db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530451.622863:0:18666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000474cdc60/0xb28d70e1257519db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530451.622871:0:18666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000474cdc60/0xb28d70e1257519db lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530451.622892:0:18666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:2.0:1788530451.623654:0:18666:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788530451.623666:0:18666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096a6e85c/0xb28d70e1257519e2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530451.623678:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=659s v=(0 0) 00010000:00010000:2.0:1788530451.623682:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788530451.623690:0:18666:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096a6e85c/0xb28d70e1257519e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530451.623702:0:18666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096a6e85c/0xb28d70e1257519e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530451.623723:0:18666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096a6e85c/0xb28d70e1257519e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530451.623730:0:18666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096a6e85c/0xb28d70e1257519e2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530451.623740:0:18666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:2.0:1788530451.626078:0:18666:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788530451.626092:0:18666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df8fdd5c/0xb28d70e1257519e9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530451.626204:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=659s v=(0 0) 00010000:00010000:2.0:1788530451.626216:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788530451.626223:0:18666:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df8fdd5c/0xb28d70e1257519e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530451.626237:0:18666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df8fdd5c/0xb28d70e1257519e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530451.626248:0:18666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df8fdd5c/0xb28d70e1257519e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530451.626257:0:18666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df8fdd5c/0xb28d70e1257519e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530451.626267:0:18666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00010000:00010000:1.0:1788530451.627298:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:1.0:1788530451.627304:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d61a655b/0xb28d70e1257519b1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788530451.627308:0:18666:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788530451.627326:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d20de00 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:2.0:1788530451.627327:0:18666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3b85d67/0xb28d70e1257519f0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530451.627331:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d61a655b/0xb28d70e1257519b1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530451.627337:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=659s v=(0 0) 00010000:00010000:2.0:1788530451.627340:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788530451.627340:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d61a655b/0xb28d70e1257519b1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530451.627346:0:18666:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3b85d67/0xb28d70e1257519f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530451.627357:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d61a655b/0xb28d70e1257519b1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530451.627365:0:18666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e3b85d67/0xb28d70e1257519f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530451.627365:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d61a655b/0xb28d70e1257519b1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530451.627375:0:18666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3b85d67/0xb28d70e1257519f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530451.627387:0:18666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e3b85d67/0xb28d70e1257519f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530451.627396:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:2.0:1788530451.627397:0:18666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00010000:00010000:1.0:1788530451.627400:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000038101456/0xb28d70e1257519b8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530451.627406:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d20d600 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:1.0:1788530451.627409:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000038101456/0xb28d70e1257519b8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530451.627417:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000038101456/0xb28d70e1257519b8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530451.627426:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000038101456/0xb28d70e1257519b8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530451.627433:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000038101456/0xb28d70e1257519b8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530451.627445:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:1.0:1788530451.627449:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e2d8757/0xb28d70e1257519bf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530451.627456:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d20da00 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:1.0:1788530451.627459:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e2d8757/0xb28d70e1257519bf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530451.627477:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e2d8757/0xb28d70e1257519bf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530451.627488:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e2d8757/0xb28d70e1257519bf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530451.627496:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e2d8757/0xb28d70e1257519bf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530451.627510:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1788530451.627514:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000077558c59/0xb28d70e1257519c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530451.627520:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f18141c00 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:1.0:1788530451.627523:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000077558c59/0xb28d70e1257519c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530451.627530:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000077558c59/0xb28d70e1257519c6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530451.627538:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000077558c59/0xb28d70e1257519c6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530451.627544:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000077558c59/0xb28d70e1257519c6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530451.627603:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1788530451.627607:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb885740/0xb28d70e1257519cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530451.627614:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f18141200 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:1.0:1788530451.627618:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb885740/0xb28d70e1257519cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530451.627626:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb885740/0xb28d70e1257519cd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530451.627636:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb885740/0xb28d70e1257519cd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530451.627643:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb885740/0xb28d70e1257519cd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530451.627653:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1788530451.627657:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e814926/0xb28d70e1257519d4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530451.627664:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f18140c00 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:1.0:1788530451.627667:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e814926/0xb28d70e1257519d4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530451.627685:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e814926/0xb28d70e1257519d4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530451.627696:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e814926/0xb28d70e1257519d4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530451.627704:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e814926/0xb28d70e1257519d4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530451.627718:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788530451.627721:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000474cdc60/0xb28d70e1257519db lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530451.627728:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f18140600 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:1.0:1788530451.627732:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000474cdc60/0xb28d70e1257519db lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530451.627739:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000474cdc60/0xb28d70e1257519db lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530451.627749:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000474cdc60/0xb28d70e1257519db lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530451.627755:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000474cdc60/0xb28d70e1257519db lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530451.627779:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788530451.627783:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096a6e85c/0xb28d70e1257519e2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530451.627790:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f18140400 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:1.0:1788530451.627793:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096a6e85c/0xb28d70e1257519e2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530451.627800:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096a6e85c/0xb28d70e1257519e2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530451.627809:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096a6e85c/0xb28d70e1257519e2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530451.627817:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096a6e85c/0xb28d70e1257519e2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530451.627827:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788530451.627831:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df8fdd5c/0xb28d70e1257519e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530451.627837:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f18141e00 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:1.0:1788530451.627841:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df8fdd5c/0xb28d70e1257519e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530451.627859:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df8fdd5c/0xb28d70e1257519e9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530451.627869:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df8fdd5c/0xb28d70e1257519e9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530451.627877:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df8fdd5c/0xb28d70e1257519e9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530451.627889:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788530451.627892:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e3b85d67/0xb28d70e1257519f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530451.627898:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f18141000 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:1.0:1788530451.627902:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3b85d67/0xb28d70e1257519f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530451.627909:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3b85d67/0xb28d70e1257519f0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530451.627918:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e3b85d67/0xb28d70e1257519f0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530451.627926:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e3b85d67/0xb28d70e1257519f0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530451.627946:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530451.627948:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530451.627951:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530451.628083:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530451.628085:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530451.628087:0:17147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000870096cb/0xb28d70e1257519aa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530451.628087:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530451.628095:0:17147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d20d400 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:2.0:1788530451.628099:0:17147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000870096cb/0xb28d70e1257519aa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530451.628125:0:17147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000870096cb/0xb28d70e1257519aa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530451.628136:0:17147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000870096cb/0xb28d70e1257519aa lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530451.628143:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000870096cb/0xb28d70e1257519aa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530451.628158:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530451.628160:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530451.628162:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788530451.629367:0:18666:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788530451.629381:0:18666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea38b712/0xb28d70e1257519f7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530451.629419:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=659s v=(0 0) 00010000:00010000:2.0:1788530451.629425:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788530451.629434:0:18666:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea38b712/0xb28d70e1257519f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530451.629450:0:18666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea38b712/0xb28d70e1257519f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530451.629461:0:18666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea38b712/0xb28d70e1257519f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530451.629468:0:18666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ea38b712/0xb28d70e1257519f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530451.629488:0:18666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788530451.629498:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788530451.629505:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ea38b712/0xb28d70e1257519f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530451.629513:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f18141a00 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:2.0:1788530451.629517:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea38b712/0xb28d70e1257519f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530451.629525:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea38b712/0xb28d70e1257519f7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530451.629553:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ea38b712/0xb28d70e1257519f7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530451.629578:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea38b712/0xb28d70e1257519f7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530451.629669:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530451.629670:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530451.629672:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788530451.630251:0:18666:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788530451.630258:0:18666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059be8a01/0xb28d70e1257519fe lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530451.630267:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=659s v=(0 0) 00010000:00010000:2.0:1788530451.630271:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788530451.630276:0:18666:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059be8a01/0xb28d70e1257519fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530451.630285:0:18666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059be8a01/0xb28d70e1257519fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530451.630293:0:18666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059be8a01/0xb28d70e1257519fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530451.630301:0:18666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059be8a01/0xb28d70e1257519fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530451.630399:0:18666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788530451.631265:0:18666:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788530451.631273:0:18666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004faa34d6/0xb28d70e125751a05 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530451.631285:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=659s v=(0 0) 00010000:00010000:0.0:1788530451.631296:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788530451.631302:0:18666:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004faa34d6/0xb28d70e125751a05 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530451.631327:0:18666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004faa34d6/0xb28d70e125751a05 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530451.631337:0:18666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004faa34d6/0xb28d70e125751a05 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530451.631346:0:18666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004faa34d6/0xb28d70e125751a05 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530451.631522:0:18991:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788530451.631532:0:18991:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059be8a01/0xb28d70e1257519fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530451.631540:0:18991:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f18141600 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:1.0:1788530451.631545:0:18991:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059be8a01/0xb28d70e1257519fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530451.631555:0:18991:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059be8a01/0xb28d70e1257519fe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530451.631607:0:18991:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059be8a01/0xb28d70e1257519fe lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530451.631616:0:18991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059be8a01/0xb28d70e1257519fe lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530451.631639:0:18991:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788530451.631643:0:18991:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004faa34d6/0xb28d70e125751a05 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530451.631663:0:18991:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f0c91d000 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:1.0:1788530451.631667:0:18991:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004faa34d6/0xb28d70e125751a05 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530451.631674:0:18991:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004faa34d6/0xb28d70e125751a05 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530451.631686:0:18991:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004faa34d6/0xb28d70e125751a05 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530451.631694:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530451.631696:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530451.631698:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530451.631979:0:18666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788530451.631985:0:18666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004faa34d6/0xb28d70e125751a05 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788530451.633040:0:18666:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788530451.633050:0:18666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083712434/0xb28d70e125751a0c lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530451.633063:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=659s v=(0 0) 00010000:00010000:0.0:1788530451.633067:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788530451.633073:0:18666:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083712434/0xb28d70e125751a0c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530451.633084:0:18666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000083712434/0xb28d70e125751a0c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530451.633098:0:18666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083712434/0xb28d70e125751a0c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530451.633115:0:18666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000083712434/0xb28d70e125751a0c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530451.633205:0:17147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788530451.633212:0:17147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000083712434/0xb28d70e125751a0c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530451.633220:0:17147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f0c91d800 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:2.0:1788530451.633224:0:17147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000083712434/0xb28d70e125751a0c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530451.633233:0:17147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000083712434/0xb28d70e125751a0c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530451.633248:0:17147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000083712434/0xb28d70e125751a0c lrc: 2/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530451.633255:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530451.633257:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530451.633258:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530451.633338:0:18666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788530451.633344:0:18666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000083712434/0xb28d70e125751a0c lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788530451.634166:0:18666:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788530451.634177:0:18666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089f84ccb/0xb28d70e125751a13 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530451.634190:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=659s v=(0 0) 00010000:00010000:1.0:1788530451.634194:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788530451.634200:0:18666:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089f84ccb/0xb28d70e125751a13 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530451.634212:0:18666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089f84ccb/0xb28d70e125751a13 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530451.634221:0:18666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089f84ccb/0xb28d70e125751a13 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530451.634234:0:18666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089f84ccb/0xb28d70e125751a13 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530451.634249:0:18666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788530451.634674:0:18991:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788530451.634682:0:18991:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089f84ccb/0xb28d70e125751a13 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530451.634690:0:18991:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f012eba00 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:0.0:1788530451.634693:0:18991:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089f84ccb/0xb28d70e125751a13 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530451.634701:0:18991:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089f84ccb/0xb28d70e125751a13 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530451.634797:0:18991:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089f84ccb/0xb28d70e125751a13 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530451.634804:0:18991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089f84ccb/0xb28d70e125751a13 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530451.634828:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530451.634830:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530451.634832:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530451.634899:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788530451.635037:0:18666:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788530451.635044:0:18666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e0e8e377/0xb28d70e125751a1a lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530451.635054:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=659s v=(0 0) 00010000:00010000:1.0:1788530451.635057:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788530451.635061:0:18666:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e0e8e377/0xb28d70e125751a1a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530451.635071:0:18666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e0e8e377/0xb28d70e125751a1a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530451.635079:0:18666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e0e8e377/0xb28d70e125751a1a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530451.635088:0:18666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e0e8e377/0xb28d70e125751a1a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530451.635948:0:18666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788530451.637043:0:17147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788530451.637065:0:17147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e0e8e377/0xb28d70e125751a1a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530451.637079:0:17147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f012ea200 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:3.0:1788530451.637084:0:17147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0e8e377/0xb28d70e125751a1a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530451.637097:0:17147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0e8e377/0xb28d70e125751a1a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530451.637125:0:17147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e0e8e377/0xb28d70e125751a1a lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530451.637412:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e0e8e377/0xb28d70e125751a1a lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530451.637444:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530451.637446:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530451.637448:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788530451.639763:0:18666:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788530451.639774:0:18666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cedc4b85/0xb28d70e125751a21 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530451.639791:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=659s v=(0 0) 00010000:00010000:3.0:1788530451.639796:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788530451.639803:0:18666:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cedc4b85/0xb28d70e125751a21 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530451.639829:0:18666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cedc4b85/0xb28d70e125751a21 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530451.639840:0:18666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cedc4b85/0xb28d70e125751a21 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530451.639848:0:18666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cedc4b85/0xb28d70e125751a21 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530451.639873:0:18666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788530451.640512:0:18991:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788530451.640521:0:18991:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cedc4b85/0xb28d70e125751a21 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530451.640537:0:18991:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d36a000 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:1.0:1788530451.640542:0:18991:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cedc4b85/0xb28d70e125751a21 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530451.640551:0:18991:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cedc4b85/0xb28d70e125751a21 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530451.640596:0:18991:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cedc4b85/0xb28d70e125751a21 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530451.640605:0:18991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cedc4b85/0xb28d70e125751a21 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530451.640625:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530451.640627:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530451.640628:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788530451.641114:0:18666:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788530451.641122:0:18666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f16dc6d0/0xb28d70e125751a28 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530451.641495:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=659s v=(0 0) 00010000:00010000:3.0:1788530451.641500:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788530451.641508:0:18666:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f16dc6d0/0xb28d70e125751a28 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530451.641521:0:18666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f16dc6d0/0xb28d70e125751a28 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530451.641531:0:18666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f16dc6d0/0xb28d70e125751a28 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530451.641554:0:18666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f16dc6d0/0xb28d70e125751a28 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530451.641600:0:18666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788530451.641608:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788530451.641615:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f16dc6d0/0xb28d70e125751a28 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530451.641623:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d36a200 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:2.0:1788530451.641626:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f16dc6d0/0xb28d70e125751a28 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530451.641648:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f16dc6d0/0xb28d70e125751a28 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530451.641663:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f16dc6d0/0xb28d70e125751a28 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530451.641670:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f16dc6d0/0xb28d70e125751a28 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530451.641687:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530451.641689:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530451.641691:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788530451.642277:0:18666:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788530451.642284:0:18666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000489a5f2e/0xb28d70e125751a2f lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530451.642293:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=659s v=(0 0) 00010000:00010000:3.0:1788530451.642296:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788530451.642301:0:18666:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000489a5f2e/0xb28d70e125751a2f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530451.642311:0:18666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000489a5f2e/0xb28d70e125751a2f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530451.642330:0:18666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000489a5f2e/0xb28d70e125751a2f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530451.642337:0:18666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000489a5f2e/0xb28d70e125751a2f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530451.643033:0:18666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788530451.643047:0:17147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788530451.643053:0:17147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000489a5f2e/0xb28d70e125751a2f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530451.643067:0:17147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d36aa00 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:3.0:1788530451.643071:0:17147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000489a5f2e/0xb28d70e125751a2f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530451.643079:0:17147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000489a5f2e/0xb28d70e125751a2f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530451.643095:0:17147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000489a5f2e/0xb28d70e125751a2f lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530451.643102:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000489a5f2e/0xb28d70e125751a2f lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530451.643120:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530451.643122:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530451.643124:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788530451.644727:0:18666:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788530451.644737:0:18666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9d467d1/0xb28d70e125751a36 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530451.644752:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=659s v=(0 0) 00010000:00010000:3.0:1788530451.644757:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788530451.644764:0:18666:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9d467d1/0xb28d70e125751a36 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530451.644776:0:18666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9d467d1/0xb28d70e125751a36 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530451.644794:0:18666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9d467d1/0xb28d70e125751a36 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530451.644801:0:18666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9d467d1/0xb28d70e125751a36 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530451.644824:0:18666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788530451.645622:0:18991:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788530451.645632:0:18991:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9d467d1/0xb28d70e125751a36 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530451.645641:0:18991:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d36ae00 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:0.0:1788530451.645646:0:18991:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9d467d1/0xb28d70e125751a36 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530451.645654:0:18991:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9d467d1/0xb28d70e125751a36 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530451.645671:0:18991:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9d467d1/0xb28d70e125751a36 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530451.645678:0:18991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9d467d1/0xb28d70e125751a36 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530451.645699:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530451.645701:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530451.645713:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788530451.647247:0:18666:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788530451.647259:0:18666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033f0b190/0xb28d70e125751a3d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530451.647274:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=659s v=(0 0) 00010000:00010000:3.0:1788530451.647279:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788530451.647285:0:18666:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033f0b190/0xb28d70e125751a3d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530451.647298:0:18666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000033f0b190/0xb28d70e125751a3d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530451.647308:0:18666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033f0b190/0xb28d70e125751a3d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530451.647328:0:18666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000033f0b190/0xb28d70e125751a3d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530451.647373:0:18666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788530451.647384:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788530451.647390:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000033f0b190/0xb28d70e125751a3d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530451.647397:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d36b000 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:3.0:1788530451.647400:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000033f0b190/0xb28d70e125751a3d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530451.647408:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000033f0b190/0xb28d70e125751a3d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530451.647423:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000033f0b190/0xb28d70e125751a3d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530451.647429:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033f0b190/0xb28d70e125751a3d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530451.647444:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530451.647446:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530451.647447:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788530451.648022:0:18666:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788530451.648028:0:18666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d357767d/0xb28d70e125751a44 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530451.648038:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=659s v=(0 0) 00010000:00010000:3.0:1788530451.648048:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788530451.648053:0:18666:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d357767d/0xb28d70e125751a44 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530451.648063:0:18666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d357767d/0xb28d70e125751a44 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530451.648071:0:18666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d357767d/0xb28d70e125751a44 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530451.648077:0:18666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d357767d/0xb28d70e125751a44 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530451.648091:0:18666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788530451.648098:0:17147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788530451.648103:0:17147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d357767d/0xb28d70e125751a44 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530451.648110:0:17147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d36b200 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:3.0:1788530451.648113:0:17147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d357767d/0xb28d70e125751a44 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530451.648120:0:17147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d357767d/0xb28d70e125751a44 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530451.648467:0:17147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d357767d/0xb28d70e125751a44 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530451.648488:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d357767d/0xb28d70e125751a44 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530451.648505:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530451.648506:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530451.648508:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788530451.649050:0:18666:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788530451.649057:0:18666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b086dd2/0xb28d70e125751a4b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530451.649070:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=659s v=(0 0) 00010000:00010000:3.0:1788530451.649074:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788530451.649080:0:18666:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b086dd2/0xb28d70e125751a4b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530451.649090:0:18666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007b086dd2/0xb28d70e125751a4b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530451.649099:0:18666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b086dd2/0xb28d70e125751a4b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530451.649106:0:18666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007b086dd2/0xb28d70e125751a4b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530451.649126:0:18666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788530451.649285:0:18991:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788530451.649298:0:18991:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007b086dd2/0xb28d70e125751a4b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530451.649307:0:18991:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d36a600 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:3.0:1788530451.649311:0:18991:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007b086dd2/0xb28d70e125751a4b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530451.649333:0:18991:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007b086dd2/0xb28d70e125751a4b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530451.649397:0:18991:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007b086dd2/0xb28d70e125751a4b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530451.649406:0:18991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b086dd2/0xb28d70e125751a4b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530451.649424:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530451.649426:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530451.649427:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1788530451.649477:0:18666:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:5 00000100:00100000:3.0:1788530451.649711:0:18666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17183:x1875409555901824:12345-0@lo:5:osp-pre-0-0.0 Request processed in 108954us (115825us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530451.649723:0:18666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788530451.649809:0:17183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037e5500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17183:1875409555901824:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788530451.649833:0:17183:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x5:0x0] 00000100:00100000:3.0:1788530451.649894:0:17183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037e5500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17183:1875409555901952:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788530451.650026:0:17183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530451.650055:0:17183:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f17635000 going to sleep for 11 seconds 00000100:00100000:3.0:1788530451.650080:0:18966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555901952 00000100:00100000:3.0:1788530451.650088:0:18966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555901952 00000100:00100000:3.0:1788530451.650417:0:18966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788530451.650428:0:18966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17183:x1875409555901952:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1788530451.650484:0:18966:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00000001:00080000:2.0:1788530451.663523:0:18663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:2.0:1788530451.663603:0:18663:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1788530451.663869:0:18966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:17183:x1875409555901952:12345-0@lo:5:osp-pre-0-0.0 Request processed in 13437us (13837us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788530451.663881:0:18966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788530451.663944:0:17183:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:2.0:1788530451.663952:0:17183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037e5500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17183:1875409555901952:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788530451.663970:0:17183:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00000001:02000400:2.0:1788530452.305853:0:19033:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg241-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788530452.559759:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788530453.411888:0:19085:0:(tgt_mount.c:2429:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788530453.413012:0:19085:0:(tgt_mount.c:2444:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788530453.568930:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530454.593392:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788530454.731023:0:19135:0:(tgt_mount.c:2429:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788530454.731249:0:19135:0:(tgt_mount.c:2444:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788530455.617220:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788530455.617254:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555902080:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788530455.617352:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788530455.617429:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788530455.617522:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555902080 00000100:00100000:2.0:1788530455.617532:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555902080 00000100:00100000:2.0:1788530455.617632:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788530455.617642:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03736a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555902080:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788530455.617678:0:18670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788530455.617728:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03736a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555902080:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530455.617735:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1788530455.617801:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788530455.617845:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555902080:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788530456.129838:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555902208:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788530456.129951:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530456.130075:0:17899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555902208 00000100:00100000:3.0:1788530456.130086:0:17899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555902208 00000100:00100000:3.0:1788530456.130149:0:17899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788530456.130161:0:17899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555902208:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788530456.130208:0:17899:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788530456.130265:0:17899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555902208:12345-0@lo:41:osp-pre-1-0.0 Request processed in 106us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530456.130281:0:17899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788530456.130347:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555902208:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788530456.142619:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555902336:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788530456.142715:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530456.146938:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555902336 00000100:00100000:1.0:1788530456.146968:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555902336 00000100:00100000:1.0:1788530456.147135:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788530456.147150:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555902336:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788530456.147212:0:17163:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788530456.147350:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555902336:12345-0@lo:41:osp-pre-0-1.0 Request processed in 204us (4634us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530456.147359:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788530456.147458:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555902336:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788530456.644216:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555902464:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788530456.644313:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530456.644369:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555902464 00000100:00100000:2.0:1788530456.644378:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555902464 00000100:00100000:2.0:1788530456.644439:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788530456.644449:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555902464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788530456.644473:0:18670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788530456.644513:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555902464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530456.644520:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1788530456.644542:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788530456.644588:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555902464:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788530456.650740:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788530456.650884:0:12493:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788530456.650889:0:12493:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788530456.650892:0:12493:0:(import.c:65:import_set_state_nolock()) ffff9a9f37411800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788530456.650900:0:12493:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 659 00000100:00080000:3.0:1788530456.650905:0:12493:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788530456.650922:0:12493:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a9f37411800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:3.0:1788530456.650946:0:12493:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9e037e5500 x1875409555902720/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788530456.650991:0:12493:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788530456.650995:0:12493:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788530456.650997:0:12493:0:(import.c:65:import_set_state_nolock()) ffff9a9f0d6f0800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788530456.651001:0:12493:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 659 00000100:00080000:3.0:1788530456.651003:0:12493:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788530456.651006:0:12493:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9a9f0d6f0800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:3.0:1788530456.651018:0:12493:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9e037e5180 x1875409555903104/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788530456.651064:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875409555902848:0@lo:400:kworker.0 00000100:00100000:3.0:1788530456.651155:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530456.651193:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875409555903488:0@lo:400:kworker.0 00000100:00100000:3.0:1788530456.651214:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530456.651235:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788530456.651241:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555902976:0@lo:400:kworker.0 00000100:00100000:3.0:1788530456.651265:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530456.651404:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875409555903232:0@lo:400:kworker.0 00000100:00100000:2.0:1788530456.651437:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530456.651467:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788530456.651474:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:3649:1875409555902592:0@lo:400:kworker.0 00000100:00100000:2.0:1788530456.651503:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530456.651526:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875409555903360:0@lo:400:kworker.0 00000100:00100000:2.0:1788530456.651618:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530456.651711:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555902848 00000100:00100000:3.0:1788530456.651719:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555902848 00000100:00100000:3.0:1788530456.651754:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555903488 00000100:00100000:3.0:1788530456.651757:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555903488 00000100:00100000:3.0:1788530456.651792:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555903232 00000100:00100000:3.0:1788530456.651795:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555903232 00000100:00100000:3.0:1788530456.651804:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555903360 00000100:00100000:3.0:1788530456.651807:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555903360 00000100:00100000:3.0:1788530456.651822:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788530456.651838:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f328e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875409555902848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530456.651893:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f328e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875409555902848:12345-0@lo:400:kworker.0 Request processed in 58us (738us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530456.651900:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788530456.651917:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788530456.651924:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f328e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875409555903488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530456.651951:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f328e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875409555903488:12345-0@lo:400:kworker.0 Request processed in 28us (737us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530456.651957:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788530456.651968:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788530456.651973:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875409555903232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530456.652005:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875409555903232:12345-0@lo:400:kworker.0 Request processed in 32us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530456.652011:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788530456.652022:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788530456.652028:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875409555903360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530456.652053:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875409555903360:12345-0@lo:400:kworker.0 Request processed in 25us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530456.652059:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788530456.652077:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555902592 00000100:00100000:3.0:1788530456.652081:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555902592 00000100:00100000:3.0:1788530456.652120:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788530456.652126:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f051ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+24:3649:x1875409555902592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530456.652155:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f051ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+24:3649:x1875409555902592:12345-0@lo:400:kworker.0 Request processed in 30us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530456.652170:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00010000:00080000:3.0:1788530456.652222:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9e037e5c00 x1875409555902848/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530472 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530456.652236:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875409555902848:0@lo:400:kworker.0 00010000:00080000:3.0:1788530456.652247:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9f328e5880 x1875409555903488/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530472 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530456.652256:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875409555903488:0@lo:400:kworker.0 00000100:00100000:3.0:1788530456.652300:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:3649:1875409555902592:0@lo:400:kworker.0 00010000:00080000:3.0:1788530456.652309:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9f328e7800 x1875409555903360/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530472 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530456.652318:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875409555903360:0@lo:400:kworker.0 00010000:00080000:3.0:1788530456.652326:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9e037e4a80 x1875409555903232/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530472 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530456.652335:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875409555903232:0@lo:400:kworker.0 00000100:00080000:2.0:1788530456.652467:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788530456.652472:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788530456.653584:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875409555902720:0@lo:8:kworker.0 00000100:00100000:1.0:1788530456.653646:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530456.653685:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875409555903104:0@lo:8:kworker.0 00000100:00100000:1.0:1788530456.653708:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530456.653761:0:18669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555902976 00000100:00100000:1.0:1788530456.653767:0:18669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555902976 00000100:00100000:1.0:1788530456.653803:0:18669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555902720 00000100:00100000:1.0:1788530456.653805:0:18669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555902720 00000100:00100000:1.0:1788530456.653813:0:18669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555903104 00000100:00100000:1.0:1788530456.653815:0:18669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555903104 00000100:00100000:1.0:1788530456.653824:0:18669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788530456.653832:0:18669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f328e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555902976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530456.653883:0:18669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f328e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555902976:12345-0@lo:400:kworker.0 Request processed in 52us (2616us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530456.653889:0:18669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788530456.653904:0:18669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788530456.653907:0:18669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f2b92d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3646:x1875409555902720:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788530456.653926:0:18669:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788530456.653958:0:18669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f2b92d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3646:x1875409555902720:12345-0@lo:8:kworker.0 Request processed in 48us (312us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788530456.653965:0:18669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788530456.653976:0:18669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788530456.653979:0:18669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f2b92f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3646:x1875409555903104:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788530456.653988:0:18669:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788530456.654024:0:18669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f2b92f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3646:x1875409555903104:12345-0@lo:8:kworker.0 Request processed in 43us (315us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788530456.654030:0:18669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1788530456.654071:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9f37411800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788530456.654077:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788530456.654080:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875409555902720:0@lo:8:kworker.0 00000100:00080000:1.0:1788530456.654103:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9f0d6f0800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788530456.654106:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788530456.654109:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875409555903104:0@lo:8:kworker.0 00000100:00100000:1.0:1788530456.654142:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555902976:0@lo:400:kworker.0 00010000:00010000:0.0:1788530457.664726:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788530458.115506:0:17192:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1788530458.242525:0:17913:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788530458.692719:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530459.714495:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530460.738151:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788530460.748035:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555903616:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788530460.748110:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530460.748190:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555903616 00000100:00100000:2.0:1788530460.748198:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555903616 00000100:00100000:2.0:1788530460.748267:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788530460.748277:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555903616:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788530460.748313:0:18670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788530460.748362:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555903616:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530460.748369:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1788530460.748391:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788530460.748430:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555903616:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788530461.251790:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788530461.251833:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555903744:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788530461.252033:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530461.252174:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555903744 00000100:00100000:3.0:1788530461.252185:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555903744 00000100:00100000:3.0:1788530461.252251:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788530461.252260:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f328e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555903744:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788530461.252302:0:17164:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788530461.252370:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f328e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555903744:12345-0@lo:41:osp-pre-0-1.0 Request processed in 111us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530461.252377:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788530461.252425:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555903744:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788530461.254163:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03734380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555903872:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788530461.254245:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530461.257971:0:17899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555903872 00000100:00100000:0.0:1788530461.257997:0:17899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555903872 00000100:00100000:0.0:1788530461.258087:0:17899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788530461.258100:0:17899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f328e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555903872:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788530461.258152:0:17899:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788530461.258285:0:17899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f328e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555903872:12345-0@lo:41:osp-pre-1-0.0 Request processed in 187us (4039us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530461.258294:0:17899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788530461.258372:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03734380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555903872:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788530461.760893:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788530461.760916:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555904000:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788530461.760982:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788530461.761033:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788530461.761203:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555904000 00000100:00100000:2.0:1788530461.761213:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555904000 00000100:00100000:2.0:1788530461.761295:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788530461.761305:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03734380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555904000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788530461.761330:0:18670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788530461.761375:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03734380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555904000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530461.761382:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1788530461.761428:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788530461.761553:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555904000:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788530461.761790:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788530461.761794:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788530461.761799:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a9f37411800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788530461.761805:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 664 00000100:00080000:0.0:1788530461.761834:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788530461.761839:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a9f37411800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:0.0:1788530461.761861:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9e03736d80 x1875409555904256/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788530461.761972:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788530461.761982:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03737800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:3647:1875409555904128:0@lo:400:kworker.0 00000100:00100000:3.0:1788530461.762033:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530461.762069:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555904128 00000100:00100000:3.0:1788530461.762073:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555904128 00000100:00100000:3.0:1788530461.762099:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788530461.762105:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f051ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+24:3647:x1875409555904128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530461.762136:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f051ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+24:3647:x1875409555904128:12345-0@lo:400:kworker.0 Request processed in 31us (102us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530461.762142:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788530461.762172:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03737800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:3647:1875409555904128:0@lo:400:kworker.0 00000100:00080000:0.0:1788530461.762352:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788530461.762355:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788530461.762357:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a9f0d6f0800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788530461.762362:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 664 00000100:00080000:0.0:1788530461.762364:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788530461.762368:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9a9f0d6f0800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:0.0:1788530461.762379:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9e03764a80 x1875409555904640/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788530461.762439:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03735f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875409555904384:0@lo:400:kworker.0 00000100:00100000:0.0:1788530461.762471:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530461.762490:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03767b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875409555905024:0@lo:400:kworker.0 00000100:00100000:0.0:1788530461.762509:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530461.762524:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788530461.762529:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03737800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555904512:0@lo:400:kworker.0 00000100:00100000:0.0:1788530461.762546:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530461.762596:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555904384 00000100:00100000:0.0:1788530461.762599:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555904384 00000100:00100000:0.0:1788530461.762622:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555905024 00000100:00100000:0.0:1788530461.762624:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555905024 00000100:00100000:0.0:1788530461.762645:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788530461.762651:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03767100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875409555904384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530461.762681:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03767100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875409555904384:12345-0@lo:400:kworker.0 Request processed in 30us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530461.762695:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788530461.762707:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788530461.762713:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03765500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875409555905024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530461.762735:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03765500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875409555905024:12345-0@lo:400:kworker.0 Request processed in 23us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530461.762741:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788530461.762760:0:18669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555904512 00000100:00100000:0.0:1788530461.762763:0:18669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555904512 00000100:00100000:0.0:1788530461.762783:0:18669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788530461.762788:0:18669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03766d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555904512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530461.762810:0:18669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03766d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555904512:12345-0@lo:400:kworker.0 Request processed in 23us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530461.762815:0:18669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788530461.763114:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03764380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875409555904896:0@lo:400:kworker.0 00000100:00100000:2.0:1788530461.763140:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530461.763157:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788530461.763161:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03764700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875409555904768:0@lo:400:kworker.0 00000100:00100000:2.0:1788530461.763187:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530461.764230:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555904896 00000100:00100000:0.0:1788530461.764243:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555904896 00000100:00100000:0.0:1788530461.764279:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555904768 00000100:00100000:0.0:1788530461.764282:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555904768 00000100:00100000:0.0:1788530461.764299:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788530461.764308:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875409555904896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530461.764386:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875409555904896:12345-0@lo:400:kworker.0 Request processed in 79us (1244us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530461.764393:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788530461.764408:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788530461.764414:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875409555904768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530461.764439:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875409555904768:12345-0@lo:400:kworker.0 Request processed in 26us (1252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530461.764456:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1788530461.764484:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788530461.764488:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788530461.764527:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03737800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555904512:0@lo:400:kworker.0 00010000:00080000:0.0:1788530461.764542:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9e03735f80 x1875409555904384/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530477 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530461.764553:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03735f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875409555904384:0@lo:400:kworker.0 00010000:00080000:0.0:1788530461.764581:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9e03767b80 x1875409555905024/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530477 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530461.764590:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03767b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875409555905024:0@lo:400:kworker.0 00010000:00080000:0.0:1788530461.764638:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9e03764700 x1875409555904768/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530477 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530461.764646:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03764700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875409555904768:0@lo:400:kworker.0 00010000:00080000:0.0:1788530461.764660:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9e03764380 x1875409555904896/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530477 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530461.764667:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03764380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875409555904896:0@lo:400:kworker.0 00000100:00100000:3.0:1788530461.764823:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03736d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875409555904256:0@lo:8:kworker.0 00000100:00100000:3.0:1788530461.764867:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530461.764914:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03764a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875409555904640:0@lo:8:kworker.0 00000100:00100000:3.0:1788530461.764938:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530461.764966:0:18666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555904256 00000100:00100000:3.0:1788530461.764970:0:18666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555904256 00000100:00100000:3.0:1788530461.764987:0:18666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555904640 00000100:00100000:3.0:1788530461.764989:0:18666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555904640 00000100:00100000:3.0:1788530461.765026:0:18666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788530461.765031:0:18666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f328e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3646:x1875409555904256:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788530461.765050:0:18666:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788530461.767161:0:18667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788530461.767173:0:18667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f328e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3646:x1875409555904640:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788530461.767196:0:18667:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788530461.767323:0:18667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f328e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3646:x1875409555904640:12345-0@lo:8:kworker.0 Request processed in 150us (2383us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788530461.767331:0:18667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1788530461.767961:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9f0d6f0800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788530461.767969:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788530461.767974:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03764a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875409555904640:0@lo:8:kworker.0 00000100:00100000:3.0:1788530461.825713:0:18666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f328e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3646:x1875409555904256:12345-0@lo:8:kworker.0 Request processed in 60674us (60839us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788530461.825728:0:18666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1788530461.826215:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9f37411800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788530461.826236:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788530461.826241:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03736d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875409555904256:0@lo:8:kworker.0 00010000:00010000:2.0:1788530462.795903:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788530463.568155:0:19494:0:(obd_mount.c:925:lmd_print()) mount data: 00000020:01000004:3.0:1788530463.568160:0:19494:0:(obd_mount.c:928:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:3.0:1788530463.568161:0:19494:0:(obd_mount.c:931:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1788530463.568298:0:19494:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9a9e025ec800 00000020:01000004:3.0:1788530463.568319:0:19494:0:(tgt_mount.c:2585:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788530463.568337:0:19494:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788530463.568352:0:19494:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9a9f39654c98) 00000020:00000080:3.0:1788530463.568370:0:19494:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788530463.672077:0:19494:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788530463.673113:0:19494:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1788530463.674079:0:19494:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788530463.675405:0:19494:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1788530463.675878:0:19494:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1788530463.676161:0:19494:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788530463.676744:0:19494:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:01000000:0.0:1788530463.694055:0:19494:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788530463.695116:0:19494:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1788530463.695132:0:19494:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788530463.695147:0:19494:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xb28d70e125751a59 00000020:01000004:0.0:1788530463.695156:0:19494:0:(tgt_mount.c:2670:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:0.0:1788530463.695184:0:19494:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.141@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788530463.695187:0:19494:0:(mgc_request.c:1372:mgc_set_info_async()) InitRecov MGC192.168.202.141@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788530463.695193:0:19494:0:(tgt_mount.c:1882:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1788530463.695245:0:19494:0:(tgt_mount.c:1482:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.141@tcp, index=0001, flags=0x20002 00000020:01000004:0.0:1788530463.695249:0:19494:0:(tgt_mount.c:1239:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788530463.695251:0:19494:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788530463.695252:0:19494:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788530463.695253:0:19494:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:0.0:1788530463.695254:0:19494:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:0.0:1788530463.695255:0:19494:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:0.0:1788530463.695314:0:19494:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788530463.695317:0:19494:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788530463.695318:0:19494:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788530463.695322:0:19494:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:0.0:1788530463.695324:0:19494:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788530463.695326:0:19494:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788530463.695327:0:19494:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788530463.695328:0:19494:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:0.0:1788530463.695329:0:19494:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:0.0:1788530463.695330:0:19494:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:0.0:1788530463.695331:0:19494:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788530463.695332:0:19494:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788530463.695333:0:19494:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788530463.695368:0:19494:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788530463.695390:0:19494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03764380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:19494:1875409555905152:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788530463.695724:0:19494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530463.695870:0:19494:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f17dad480 going to sleep for 11 seconds 00000100:00100000:1.0:1788530463.707890:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555905152 00000100:00100000:1.0:1788530463.707910:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555905152 00000100:00100000:1.0:1788530463.707995:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788530463.708014:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f051af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+24:19494:x1875409555905152:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788530463.708063:0:17153:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788530463.708066:0:17153:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1788530463.708070:0:17153:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1788530463.709223:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f051af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+24:19494:x1875409555905152:12345-0@lo:253:mount.lustre.0 Request processed in 1213us (13495us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530463.709237:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788530463.709400:0:19494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03764380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:19494:1875409555905152:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788530463.709419:0:19494:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788530463.709423:0:19494:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788530463.709424:0:19494:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788530463.709426:0:19494:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788530463.709427:0:19494:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:2.0:1788530463.709428:0:19494:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:2.0:1788530463.709429:0:19494:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:2.0:1788530463.709431:0:19494:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788530463.709433:0:19494:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788530463.709435:0:19494:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788530463.709459:0:19494:0:(tgt_mount.c:115:server_register_mount()) register mount ffff9a9e025ec800 from lustre-OST0001 10000000:01000000:2.0:1788530463.709493:0:19494:0:(mgc_request.c:2342:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1788530463.709497:0:19494:0:(mgc_request.c:424:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788530463.709524:0:19494:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9a9e025ec800 10000000:01000000:2.0:1788530463.709529:0:19494:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788530463.709549:0:19494:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.202.141@tcp: setup lustre-OST0001-osd 00000040:01000000:3.0:1788530463.720142:0:19494:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.141@tcp ctxt 1 is initialized 00000040:01000000:3.0:1788530463.728822:0:19494:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.141@tcp ctxt 0 is initialized 10000000:01000000:3.0:1788530463.728863:0:19494:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-sptlrpc-ffff9a9e025ec800 from 1 10000000:01000000:3.0:1788530463.728868:0:19494:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788530463.728932:0:19494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b200/0xb28d70e125751a60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530463.728946:0:19494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b200/0xb28d70e125751a60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530463.728959:0:19494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b200/0xb28d70e125751a60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530463.728988:0:19494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:19494:1875409555905280:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788530463.729081:0:19494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530463.729218:0:19494:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f32b9f600 going to sleep for 11 seconds 00000100:00100000:1.0:1788530463.735416:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555905280 00000100:00100000:1.0:1788530463.735439:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555905280 00000100:00100000:1.0:1788530463.735672:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788530463.735827:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f051af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+24:19494:x1875409555905280:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788530463.735849:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530463.735874:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f012eba00/0xb28d70e125751a67 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e125751a60 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530463.735913:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f012eba00/0xb28d70e125751a67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e125751a60 expref: 25 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530463.735926:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f012eba00/0xb28d70e125751a67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125751a60 expref: 25 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530463.735937:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f012eba00, rc 0) 00000100:00100000:1.0:1788530463.736076:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f051af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+25:19494:x1875409555905280:12345-0@lo:101:mount.lustre.0 Request processed in 253us (6995us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530463.736085:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788530463.741056:0:19494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:19494:1875409555905280:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788530463.741094:0:19494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b200/0xb28d70e125751a60 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751a67 expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530463.741108:0:19494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b200/0xb28d70e125751a60 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e125751a67 expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530463.741703:0:19494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:19494:1875409555905408:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788530463.741779:0:19494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530463.741832:0:19494:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f03e8b840 going to sleep for 11 seconds 00000100:00100000:3.0:1788530463.741894:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555905408 00000100:00100000:3.0:1788530463.741902:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555905408 00000100:00100000:3.0:1788530463.741996:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788530463.742006:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f051ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+25:19494:x1875409555905408:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788530463.742113:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f051ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+25:19494:x1875409555905408:12345-0@lo:501:mount.lustre.0 Request processed in 108us (334us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788530463.742121:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788530463.743398:0:19494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:19494:1875409555905408:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788530463.743434:0:19494:0:(mgc_request_server.c:748:mgc_llog_local_copy()) MGC192.168.202.141@tcp: no remote llog for lustre-sptlrpc, check MGS config 00000100:00100000:0.0:1788530463.743546:0:19494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03764700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:19494:1875409555905536:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788530463.743622:0:19494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530463.743656:0:19494:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f1f502840 going to sleep for 11 seconds 00000100:00100000:3.0:1788530463.743965:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555905536 00000100:00100000:3.0:1788530463.743972:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555905536 00000100:00100000:3.0:1788530463.744016:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788530463.744025:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f051aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+25:19494:x1875409555905536:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788530463.744111:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f051aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+25:19494:x1875409555905536:12345-0@lo:501:mount.lustre.0 Request processed in 87us (488us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788530463.744120:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788530463.744823:0:19494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03764700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:19494:1875409555905536:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788530463.744867:0:19494:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788530463.744895:0:19494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b200/0xb28d70e125751a60 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751a67 expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530463.744907:0:19494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b200/0xb28d70e125751a60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751a67 expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788530463.744922:0:19494:0:(mgc_request.c:206:do_config_log_add()) do adding config log params-ffff9a9e025ec800 10000000:01000000:0.0:1788530463.744930:0:19494:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788530463.744966:0:19494:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.202.141@tcp: setup lustre-OST0001-osd 00000040:01000000:0.0:1788530463.745078:0:19494:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.141@tcp ctxt 1 is initialized 00000040:01000000:0.0:1788530463.745090:0:19494:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.141@tcp ctxt 0 is initialized 10000000:01000000:0.0:1788530463.745106:0:19494:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788530463.745110:0:19494:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788530463.745150:0:19494:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.202.141@tcp: setup lustre-OST0001-osd 00000040:01000000:0.0:1788530463.745183:0:19494:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.141@tcp ctxt 1 is initialized 00000040:01000000:0.0:1788530463.745187:0:19494:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.141@tcp ctxt 0 is initialized 10000000:01000000:0.0:1788530463.745194:0:19494:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-mdtir-ffff9a9e025ec800 10000000:01000000:0.0:1788530463.745222:0:19494:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788530463.745249:0:19494:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1788530463.745253:0:19494:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788530463.745501:0:19494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d000/0xb28d70e125751a6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530463.745510:0:19494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d000/0xb28d70e125751a6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530463.745528:0:19494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d000/0xb28d70e125751a6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530463.745548:0:19494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03764700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:19494:1875409555905664:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788530463.745748:0:19494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530463.745831:0:19494:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e0247ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1788530463.749679:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555905664 00000100:00100000:3.0:1788530463.749699:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555905664 00000100:00100000:3.0:1788530463.749789:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788530463.749802:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f051ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+25:19494:x1875409555905664:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788530463.749825:0:17151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788530463.749851:0:17151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f3d36a600/0xb28d70e125751a75 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e125751a6e expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530463.749909:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f3d36a600/0xb28d70e125751a75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e125751a6e expref: 26 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530463.749922:0:17151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f3d36a600/0xb28d70e125751a75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125751a6e expref: 26 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530463.749933:0:17151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d36a600, rc 0) 00000100:00100000:3.0:1788530463.750021:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f051ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+26:19494:x1875409555905664:12345-0@lo:101:mount.lustre.0 Request processed in 221us (4272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530463.750028:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788530463.750379:0:19494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03764700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:19494:1875409555905664:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788530463.750409:0:19494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d000/0xb28d70e125751a6e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751a75 expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530463.750421:0:19494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d000/0xb28d70e125751a6e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e125751a75 expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788530463.753757:0:19494:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:1.0:1788530463.754796:0:19494:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788530463.760528:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:0.0:1788530463.761513:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 128 off8544 00000040:00080000:0.0:1788530463.761540:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 112 off8656 00000040:00080000:0.0:1788530463.761553:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8880 00000040:00080000:0.0:1788530463.761686:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9104 00000040:00080000:0.0:1788530463.761702:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 80 off9184 00000040:00080000:0.0:1788530463.761717:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9408 00000040:00080000:0.0:1788530463.761732:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9632 00000040:00080000:0.0:1788530463.761747:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 120 off9752 00000040:00080000:0.0:1788530463.761783:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off9976 00000040:00080000:0.0:1788530463.761790:0:19494:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 11 00000100:00100000:0.0:1788530463.761947:0:19494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03764700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:19494:1875409555905792:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788530463.762019:0:19494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530463.762137:0:19494:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f0d6dbc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788530463.762728:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555905792 00000100:00100000:3.0:1788530463.762738:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555905792 00000100:00100000:3.0:1788530463.762886:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788530463.762898:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f051ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+26:19494:x1875409555905792:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788530463.763102:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f051ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+26:19494:x1875409555905792:12345-0@lo:501:mount.lustre.0 Request processed in 206us (1082us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530463.763111:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788530463.763211:0:19494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03764700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:19494:1875409555905792:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788530463.763282:0:19494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03764700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:19494:1875409555905920:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788530463.763330:0:19494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530463.769123:0:19494:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f0d6dbc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788530463.769874:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555905920 00000100:00100000:1.0:1788530463.769888:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555905920 00000100:00100000:0.0:1788530463.770019:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788530463.770032:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f051acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+26:19494:x1875409555905920:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788530463.774610:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f051acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+26:19494:x1875409555905920:12345-0@lo:503:mount.lustre.0 Request processed in 4568us (11266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530463.774626:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788530463.774720:0:19494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03764700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:19494:1875409555905920:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788530463.775213:0:19494:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788530463.775337:0:19494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03764700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:19494:1875409555906048:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788530463.775390:0:19494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530463.775424:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555906048 00000100:00100000:0.0:1788530463.775431:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555906048 00000100:00100000:0.0:1788530463.775461:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788530463.775469:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03752c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+26:19494:x1875409555906048:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788530463.775630:0:19494:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f0a96b840 going to sleep for 11 seconds 00000100:00100000:0.0:1788530463.776475:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03752c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+26:19494:x1875409555906048:12345-0@lo:502:mount.lustre.0 Request processed in 995us (1074us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530463.776485:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788530463.777549:0:19494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03764700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:19494:1875409555906048:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788530463.777847:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:1.0:1788530463.777879:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 128 off8544 00000040:00080000:1.0:1788530463.777895:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 112 off8656 00000040:00080000:1.0:1788530463.777907:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8880 00000040:00080000:1.0:1788530463.777920:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9104 00000040:00080000:1.0:1788530463.777934:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 80 off9184 00000040:00080000:1.0:1788530463.777946:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9408 00000040:00080000:1.0:1788530463.777959:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9632 00000040:00080000:1.0:1788530463.777972:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 120 off9752 00000100:00100000:1.0:1788530463.778014:0:19494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f2b92df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:19494:1875409555906176:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788530463.778082:0:19494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530463.778182:0:19494:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f32a53540 going to sleep for 11 seconds 00000100:00100000:3.0:1788530463.783227:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555906176 00000100:00100000:3.0:1788530463.783250:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555906176 00000100:00100000:0.0:1788530463.788619:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788530463.788649:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03750850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+26:19494:x1875409555906176:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788530463.788941:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03750850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+26:19494:x1875409555906176:12345-0@lo:502:mount.lustre.0 Request processed in 303us (10857us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530463.788962:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788530463.789125:0:19494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f2b92df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:19494:1875409555906176:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788530463.789265:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off9976 00000040:00080000:1.0:1788530463.789284:0:19494:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:0.0:1788530463.797919:0:19498:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788530463.797933:0:19498:0:(obd_mount.c:963:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:0.0:1788530463.797941:0:19498:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788530463.797943:0:19498:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1788530463.797950:0:19498:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788530463.797986:0:19498:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9a9e03779988) 00000020:00000080:0.0:1788530463.798016:0:19498:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788530463.798024:0:19498:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788530463.798102:0:19498:0:(tgt_mount.c:167:server_get_mount()) get mount ffff9a9e025ec800 from lustre-OST0001, refs=2 00080000:01000000:0.0:1788530463.798112:0:19498:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788530463.798121:0:19498:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xb28d70e125751a83 00010000:00010000:1.0:1788530463.811459:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530463.812943:0:19498:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:0.0:1788530463.813555:0:19498:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967326 00080000:10000000:2.0:1788530463.819544:0:19498:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:2.0:1788530463.823805:0:19498:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1788530463.823821:0:19498:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788530463.823827:0:19498:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788530463.823830:0:19498:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1788530463.823833:0:19498:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788530463.823837:0:19498:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788530463.823838:0:19498:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788530463.823842:0:19498:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788530463.823844:0:19498:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788530463.823846:0:19498:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788530463.823849:0:19498:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788530463.823850:0:19498:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788530463.823852:0:19498:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788530463.823855:0:19498:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788530463.823856:0:19498:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788530463.823860:0:19498:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788530463.823890:0:19498:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788530463.823893:0:19498:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788530463.823894:0:19498:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788530463.823898:0:19498:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 11 count 11 00000020:01000000:3.0:1788530463.824725:0:19494:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1788530463.824744:0:19494:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788530463.824769:0:19494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d000/0xb28d70e125751a6e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751a75 expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530463.824782:0:19494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91d000/0xb28d70e125751a6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751a75 expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788530463.824803:0:19494:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-mdtir-ffff9a9e025ec800 from 1 10000000:01000000:3.0:1788530463.824807:0:19494:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788530463.824857:0:19494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b000/0xb28d70e125751a8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530463.824866:0:19494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b000/0xb28d70e125751a8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530463.824880:0:19494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b000/0xb28d70e125751a8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530463.824908:0:19494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:19494:1875409555906304:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788530463.825069:0:19494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530463.825112:0:19494:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e02382cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788530463.826179:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555906304 00000100:00100000:2.0:1788530463.826196:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555906304 00000100:00100000:2.0:1788530463.826308:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788530463.826320:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03752850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+26:19494:x1875409555906304:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788530463.826346:0:17153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530463.826384:0:17153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f18140600/0xb28d70e125751a91 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e125751a8a expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530463.826421:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f18140600/0xb28d70e125751a91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e125751a8a expref: 27 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530463.826435:0:17153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f18140600/0xb28d70e125751a91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125751a8a expref: 27 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530463.826446:0:17153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f18140600, rc 0) 00000100:00100000:2.0:1788530463.826532:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03752850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+27:19494:x1875409555906304:12345-0@lo:101:mount.lustre.0 Request processed in 214us (1556us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530463.826540:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788530463.827219:0:19494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:19494:1875409555906304:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788530463.827253:0:19494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b000/0xb28d70e125751a8a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751a91 expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530463.827266:0:19494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b000/0xb28d70e125751a8a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e125751a91 expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530463.827891:0:19494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:19494:1875409555906432:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1788530463.827949:0:19494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530463.828672:0:19494:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e02382cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788530463.828934:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555906432 00000100:00100000:0.0:1788530463.828941:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555906432 00000100:00100000:0.0:1788530463.828991:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788530463.829000:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03751c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+27:19494:x1875409555906432:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1788530463.829020:0:17154:0:(mgs_nids.c:1159:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788530463.829039:0:17154:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788530463.829043:0:17154:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788530463.829046:0:17154:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788530463.829048:0:17154:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 9 00000100:00100000:0.0:1788530463.829171:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03751c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+27:19494:x1875409555906432:12345-0@lo:256:mount.lustre.0 Request processed in 171us (1221us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530463.829180:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788530463.830097:0:19494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:19494:1875409555906432:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1788530463.830888:0:19494:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788530463.830922:0:19494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b000/0xb28d70e125751a8a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751a91 expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530463.830934:0:19494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b000/0xb28d70e125751a8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751a91 expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788530463.830942:0:19494:0:(mgc_request.c:2194:mgc_process_log()) Process log params-ffff9a9e025ec800 from 1 10000000:01000000:3.0:1788530463.830946:0:19494:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788530463.833297:0:19494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36aa00/0xb28d70e125751a98 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530463.833322:0:19494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36aa00/0xb28d70e125751a98 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530463.833340:0:19494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36aa00/0xb28d70e125751a98 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530463.833381:0:19494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:19494:1875409555906560:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788530463.833475:0:19494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530463.833544:0:19494:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e02382cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788530463.833903:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555906560 00000100:00100000:1.0:1788530463.833913:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555906560 00000100:00100000:1.0:1788530463.833969:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788530463.833986:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03753050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+27:19494:x1875409555906560:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788530463.833999:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530463.834012:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f012eae00/0xb28d70e125751a9f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e125751a98 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530463.834038:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f012eae00/0xb28d70e125751a9f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e125751a98 expref: 28 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530463.834050:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f012eae00/0xb28d70e125751a9f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125751a98 expref: 28 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530463.834059:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f012eae00, rc 0) 00000100:00100000:1.0:1788530463.834102:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03753050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+28:19494:x1875409555906560:12345-0@lo:101:mount.lustre.0 Request processed in 118us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530463.834109:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788530463.834621:0:19494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:19494:1875409555906560:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788530463.834643:0:19494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36aa00/0xb28d70e125751a98 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751a9f expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530463.834653:0:19494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36aa00/0xb28d70e125751a98 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e125751a9f expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788530463.838226:0:19494:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000040:00080000:2.0:1788530463.839393:0:19494:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788530463.842385:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:2.0:1788530463.842457:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 112 off8528 00000040:00080000:2.0:1788530463.843126:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 224 off8752 00000040:00080000:2.0:1788530463.843149:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8976 00000040:00080000:2.0:1788530463.843163:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 112 off9088 00000040:00080000:2.0:1788530463.843178:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 224 off9312 00000040:00080000:2.0:1788530463.843193:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 224 off9536 00000040:00080000:2.0:1788530463.843237:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 128 off9664 00000040:00080000:2.0:1788530463.843254:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:2.0:1788530463.843268:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 224 off10112 00000040:00080000:2.0:1788530463.843280:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 128 off10240 00000040:00080000:2.0:1788530463.843311:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10464 00000040:00080000:2.0:1788530463.843317:0:19494:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 12 count 13 00000100:00100000:2.0:1788530463.843621:0:19494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d3fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:19494:1875409555906688:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788530463.843713:0:19494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530463.843759:0:19494:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f0d6dbc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788530463.844297:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555906688 00000100:00100000:0.0:1788530463.844310:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555906688 00000100:00100000:0.0:1788530463.844375:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788530463.844395:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03752050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+28:19494:x1875409555906688:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788530463.844555:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03752050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+28:19494:x1875409555906688:12345-0@lo:501:mount.lustre.0 Request processed in 163us (842us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530463.844583:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788530463.844834:0:19494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d3fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:19494:1875409555906688:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788530463.844875:0:19494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d3fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:19494:1875409555906816:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788530463.844917:0:19494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530463.844945:0:19494:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f0d6dbc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788530463.844988:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555906816 00000100:00100000:1.0:1788530463.844993:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555906816 00000100:00100000:1.0:1788530463.845023:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788530463.845029:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03750450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+28:19494:x1875409555906816:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788530463.845106:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03750450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+28:19494:x1875409555906816:12345-0@lo:503:mount.lustre.0 Request processed in 77us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530463.845113:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788530463.845243:0:19494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d3fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:19494:1875409555906816:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788530463.845700:0:19494:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788530463.845760:0:19494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d3fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:19494:1875409555906944:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788530463.845800:0:19494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530463.845822:0:19494:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f0ab363c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788530463.845973:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555906944 00000100:00100000:1.0:1788530463.845978:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555906944 00000100:00100000:1.0:1788530463.846018:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788530463.846024:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03751050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+28:19494:x1875409555906944:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788530463.846095:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03751050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+28:19494:x1875409555906944:12345-0@lo:502:mount.lustre.0 Request processed in 71us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530463.846102:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788530463.846298:0:19494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d3fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:19494:1875409555906944:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788530463.846619:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:2.0:1788530463.846643:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 112 off8528 00000040:00080000:2.0:1788530463.846655:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 224 off8752 00000040:00080000:2.0:1788530463.846666:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8976 00000040:00080000:2.0:1788530463.846676:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 112 off9088 00000040:00080000:2.0:1788530463.846687:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 224 off9312 00000040:00080000:2.0:1788530463.846698:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 224 off9536 00000040:00080000:2.0:1788530463.846709:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 128 off9664 00000040:00080000:2.0:1788530463.846734:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:2.0:1788530463.846746:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 224 off10112 00000040:00080000:2.0:1788530463.846757:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 128 off10240 00000100:00100000:2.0:1788530463.846782:0:19494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d3fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:19494:1875409555907072:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788530463.846823:0:19494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530463.846853:0:19494:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f0d6dbc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788530463.847053:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555907072 00000100:00100000:1.0:1788530463.847059:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555907072 00000100:00100000:1.0:1788530463.847100:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788530463.847108:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03751450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+28:19494:x1875409555907072:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788530463.847217:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03751450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+28:19494:x1875409555907072:12345-0@lo:502:mount.lustre.0 Request processed in 108us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530463.847224:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788530463.847454:0:19494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d3fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:19494:1875409555907072:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788530463.847685:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10464 00000040:00080000:2.0:1788530463.847704:0:19494:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1788530463.851847:0:19502:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788530463.851862:0:19502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788530463.851864:0:19502:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788530463.851872:0:19502:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a9e025ec800 00000020:00000080:2.0:1788530463.851875:0:19502:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788530463.851883:0:19502:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788530463.851886:0:19502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788530463.851887:0:19502:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788530463.851889:0:19502:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788530463.851891:0:19502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788530463.851893:0:19502:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788530463.851896:0:19502:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a9e025ec800 00000020:00000080:2.0:1788530463.851899:0:19502:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788530463.851943:0:19502:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788530463.851947:0:19502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788530463.851948:0:19502:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788530463.851951:0:19502:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788530463.851953:0:19502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788530463.851954:0:19502:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788530463.851958:0:19502:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a9e025ec800 00000020:00000080:2.0:1788530463.851960:0:19502:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788530463.852549:0:19502:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788530463.852555:0:19502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788530463.852557:0:19502:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788530463.852632:0:19502:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788530463.852637:0:19502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788530463.852638:0:19502:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788530463.852642:0:19502:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a9e025ec800 00000020:00000080:2.0:1788530463.852644:0:19502:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788530463.852679:0:19502:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788530463.852682:0:19502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788530463.852683:0:19502:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788530463.852686:0:19502:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 13 count 13 00000020:01000000:3.0:1788530463.853381:0:19494:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1788530463.853397:0:19494:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788530463.853419:0:19494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36aa00/0xb28d70e125751a98 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751a9f expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530463.853440:0:19494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36aa00/0xb28d70e125751a98 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751a9f expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788530463.853951:0:19494:0:(mgc_request.c:2342:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788530463.853955:0:19494:0:(mgc_request.c:424:config_log_add()) add config log lustre-client-ffff9a9e025ec800 10000000:01000000:3.0:1788530463.853958:0:19494:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-client-ffff9a9e025ec800 10000000:01000000:3.0:1788530463.853964:0:19494:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788530463.854651:0:19494:0:(mgc_request_server.c:106:mgc_fs_setup()) MGC192.168.202.141@tcp: setup lustre-OST0001-osd 00000040:01000000:3.0:1788530463.854758:0:19494:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.141@tcp ctxt 1 is initialized 00000040:01000000:3.0:1788530463.854768:0:19494:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.141@tcp ctxt 0 is initialized 10000000:01000000:3.0:1788530463.854786:0:19494:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-client-ffff9a9e025ec800 from 1 10000000:01000000:3.0:1788530463.854791:0:19494:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788530463.854841:0:19494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b600/0xb28d70e125751aa6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530463.854851:0:19494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b600/0xb28d70e125751aa6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530463.854865:0:19494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b600/0xb28d70e125751aa6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530463.854892:0:19494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:19494:1875409555907200:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788530463.856118:0:19494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530463.856235:0:19494:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e02382180 going to sleep for 11 seconds 00000100:00100000:1.0:1788530463.860529:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555907200 00000100:00100000:1.0:1788530463.860548:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555907200 00000100:00100000:1.0:1788530463.860631:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788530463.860643:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03753c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+28:19494:x1875409555907200:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788530463.860661:0:17153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530463.860684:0:17153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f012ea200/0xb28d70e125751aad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e125751aa6 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530463.860719:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f012ea200/0xb28d70e125751aad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e125751aa6 expref: 29 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530463.860740:0:17153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f012ea200/0xb28d70e125751aad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125751aa6 expref: 29 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530463.860750:0:17153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f012ea200, rc 0) 00000100:00100000:1.0:1788530463.860838:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03753c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+29:19494:x1875409555907200:12345-0@lo:101:mount.lustre.0 Request processed in 197us (5864us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530463.860844:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788530463.863240:0:19494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:19494:1875409555907200:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788530463.863269:0:19494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b600/0xb28d70e125751aa6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751aad expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530463.863292:0:19494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b600/0xb28d70e125751aa6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e125751aad expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788530463.873048:0:19494:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 52 count 51 00000040:00080000:0.0:1788530463.873432:0:19494:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788530463.873704:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].1, 224 off8416 00000040:00080000:0.0:1788530463.873747:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].2, 120 off8536 00000040:00080000:0.0:1788530463.873763:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].3, 168 off8704 00000040:00080000:0.0:1788530463.873778:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].4, 224 off8928 00000040:00080000:0.0:1788530463.873791:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].5, 224 off9152 00000040:00080000:0.0:1788530463.873805:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].6, 120 off9272 00000040:00080000:0.0:1788530463.873817:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].7, 168 off9440 00000040:00080000:0.0:1788530463.873830:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].8, 224 off9664 00000040:00080000:0.0:1788530463.873841:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].9, 224 off9888 00000040:00080000:0.0:1788530463.873853:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].10, 120 off10008 00000040:00080000:0.0:1788530463.873867:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].11, 224 off10232 00000040:00080000:0.0:1788530463.873879:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].12, 224 off10456 00000040:00080000:0.0:1788530463.873891:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].13, 88 off10544 00000040:00080000:0.0:1788530463.873903:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].14, 128 off10672 00000040:00080000:0.0:1788530463.873916:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].15, 144 off10816 00000040:00080000:0.0:1788530463.873928:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].16, 160 off10976 00000040:00080000:0.0:1788530463.873940:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].17, 224 off11200 00000040:00080000:0.0:1788530463.873965:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].18, 224 off11424 00000040:00080000:0.0:1788530463.873981:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].19, 80 off11504 00000040:00080000:0.0:1788530463.873994:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].20, 224 off11728 00000040:00080000:0.0:1788530463.874006:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].21, 224 off11952 00000040:00080000:0.0:1788530463.874020:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].22, 88 off12040 00000040:00080000:0.0:1788530463.874032:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].23, 128 off12168 00000040:00080000:0.0:1788530463.874045:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].24, 144 off12312 00000040:00080000:0.0:1788530463.874059:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].25, 160 off12472 00000040:00080000:0.0:1788530463.874083:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].26, 224 off12696 00000040:00080000:0.0:1788530463.874096:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].27, 224 off12920 00000040:00080000:0.0:1788530463.874109:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].28, 80 off13000 00000040:00080000:0.0:1788530463.874122:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].29, 224 off13224 00000040:00080000:0.0:1788530463.874134:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].30, 224 off13448 00000040:00080000:0.0:1788530463.874145:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].31, 88 off13536 00000040:00080000:0.0:1788530463.874157:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].32, 128 off13664 00000040:00080000:0.0:1788530463.874171:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].33, 144 off13808 00000040:00080000:0.0:1788530463.874211:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].34, 128 off13936 00000040:00080000:0.0:1788530463.874230:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].35, 224 off14160 00000040:00080000:0.0:1788530463.874243:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].36, 224 off14384 00000040:00080000:0.0:1788530463.874254:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].37, 80 off14464 00000040:00080000:0.0:1788530463.874267:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].38, 224 off14688 00000040:00080000:0.0:1788530463.874281:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].39, 224 off14912 00000040:00080000:0.0:1788530463.874292:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].40, 88 off15000 00000040:00080000:0.0:1788530463.874304:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].41, 128 off15128 00000040:00080000:0.0:1788530463.874318:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].42, 144 off15272 00000040:00080000:0.0:1788530463.874332:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].43, 128 off15400 00000040:00080000:0.0:1788530463.874345:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].44, 224 off15624 00000040:00080000:0.0:1788530463.874358:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].45, 224 off15848 00000040:00080000:0.0:1788530463.874370:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].46, 80 off15928 00000040:00080000:0.0:1788530463.874381:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].47, 224 off16152 00000040:00080000:0.0:1788530463.874392:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].48, 232 off16384 00000040:00080000:0.0:1788530463.874526:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].49, 224 off16608 00000040:00080000:0.0:1788530463.874547:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].50, 120 off16728 00000040:00080000:0.0:1788530463.874592:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].51, 224 off16952 00000040:00080000:0.0:1788530463.874598:0:19494:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 51 count 51 00000100:00100000:0.0:1788530463.874702:0:19494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03767b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:19494:1875409555907328:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788530463.874783:0:19494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530463.874824:0:19494:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f176a40c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788530463.874919:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555907328 00000100:00100000:1.0:1788530463.874926:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555907328 00000100:00100000:1.0:1788530463.874982:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788530463.874993:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03751850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+29:19494:x1875409555907328:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788530463.875112:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03751850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+29:19494:x1875409555907328:12345-0@lo:501:mount.lustre.0 Request processed in 121us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530463.875120:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788530463.875167:0:19494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03767b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:19494:1875409555907328:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788530463.875212:0:19494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f2b92df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:19494:1875409555907456:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788530463.875254:0:19494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530463.875277:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555907456 00000100:00100000:1.0:1788530463.875280:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555907456 00000100:00100000:1.0:1788530463.875303:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788530463.875309:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03cff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+29:19494:x1875409555907456:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788530463.875378:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03cff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+29:19494:x1875409555907456:12345-0@lo:503:mount.lustre.0 Request processed in 68us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530463.875384:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788530463.875427:0:19494:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f09214cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788530463.875440:0:19494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f2b92df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:19494:1875409555907456:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788530463.875837:0:19494:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788530463.875896:0:19494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f2b92df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:19494:1875409555907584:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788530463.875931:0:19494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530463.875954:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555907584 00000100:00100000:1.0:1788530463.875958:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555907584 00000100:00100000:1.0:1788530463.875980:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788530463.875986:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03cfec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+29:19494:x1875409555907584:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788530463.876057:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03cfec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+29:19494:x1875409555907584:12345-0@lo:502:mount.lustre.0 Request processed in 70us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530463.876064:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788530463.876098:0:19494:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f18143540 going to sleep for 11 seconds 00000100:00100000:1.0:1788530463.876114:0:19494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f2b92df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:19494:1875409555907584:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788530463.876308:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].1, 224 off8416 00000040:00080000:1.0:1788530463.876335:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].2, 120 off8536 00000040:00080000:1.0:1788530463.876351:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].3, 168 off8704 00000040:00080000:1.0:1788530463.876364:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].4, 224 off8928 00000040:00080000:1.0:1788530463.876379:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].5, 224 off9152 00000040:00080000:1.0:1788530463.876392:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].6, 120 off9272 00000040:00080000:1.0:1788530463.876404:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].7, 168 off9440 00000040:00080000:1.0:1788530463.876418:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].8, 224 off9664 00000040:00080000:1.0:1788530463.876430:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].9, 224 off9888 00000040:00080000:1.0:1788530463.876443:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].10, 120 off10008 00000040:00080000:1.0:1788530463.876457:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].11, 224 off10232 00000040:00080000:1.0:1788530463.876471:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].12, 224 off10456 00000040:00080000:1.0:1788530463.876484:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].13, 88 off10544 00000040:00080000:1.0:1788530463.876499:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].14, 128 off10672 00000040:00080000:1.0:1788530463.876525:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].15, 144 off10816 00000040:00080000:1.0:1788530463.876539:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].16, 160 off10976 00000040:00080000:1.0:1788530463.876552:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].17, 224 off11200 00000040:00080000:1.0:1788530463.876595:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].18, 224 off11424 00000040:00080000:1.0:1788530463.876609:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].19, 80 off11504 00000040:00080000:1.0:1788530463.876624:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].20, 224 off11728 00000040:00080000:1.0:1788530463.876638:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].21, 224 off11952 00000040:00080000:1.0:1788530463.876653:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].22, 88 off12040 00000040:00080000:1.0:1788530463.876665:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].23, 128 off12168 00000040:00080000:1.0:1788530463.876679:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].24, 144 off12312 00000040:00080000:1.0:1788530463.876691:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].25, 160 off12472 00000040:00080000:1.0:1788530463.876704:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].26, 224 off12696 00000040:00080000:1.0:1788530463.876717:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].27, 224 off12920 00000040:00080000:1.0:1788530463.876730:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].28, 80 off13000 00000040:00080000:1.0:1788530463.876743:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].29, 224 off13224 00000040:00080000:1.0:1788530463.876769:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].30, 224 off13448 00000040:00080000:1.0:1788530463.876784:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].31, 88 off13536 00000040:00080000:1.0:1788530463.876797:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].32, 128 off13664 00000040:00080000:1.0:1788530463.876808:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].33, 144 off13808 00000040:00080000:1.0:1788530463.876821:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].34, 128 off13936 00000040:00080000:1.0:1788530463.876832:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].35, 224 off14160 00000040:00080000:1.0:1788530463.876844:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].36, 224 off14384 00000040:00080000:1.0:1788530463.876858:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].37, 80 off14464 00000040:00080000:1.0:1788530463.876871:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].38, 224 off14688 00000040:00080000:1.0:1788530463.876885:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].39, 224 off14912 00000040:00080000:1.0:1788530463.876897:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].40, 88 off15000 00000040:00080000:1.0:1788530463.876910:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].41, 128 off15128 00000040:00080000:1.0:1788530463.876923:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].42, 144 off15272 00000040:00080000:1.0:1788530463.876935:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].43, 128 off15400 00000040:00080000:1.0:1788530463.876948:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].44, 224 off15624 00000040:00080000:1.0:1788530463.876962:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].45, 224 off15848 00000040:00080000:1.0:1788530463.876989:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].46, 80 off15928 00000040:00080000:1.0:1788530463.877003:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].47, 224 off16152 00000040:00080000:1.0:1788530463.877026:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].48, 232 off16384 00000100:00100000:1.0:1788530463.877062:0:19494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f2b92df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:19494:1875409555907712:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788530463.877105:0:19494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530463.877139:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555907712 00000100:00100000:1.0:1788530463.877143:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555907712 00000100:00100000:1.0:1788530463.877171:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788530463.877177:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03cffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+29:19494:x1875409555907712:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788530463.877270:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03cffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+29:19494:x1875409555907712:12345-0@lo:502:mount.lustre.0 Request processed in 92us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530463.877277:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788530463.877314:0:19494:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f18143540 going to sleep for 11 seconds 00000100:00100000:1.0:1788530463.877331:0:19494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f2b92df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:19494:1875409555907712:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788530463.877455:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].49, 224 off16608 00000040:00080000:1.0:1788530463.877475:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].50, 120 off16728 00000100:00100000:1.0:1788530463.877494:0:19494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f2b92df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:19494:1875409555907840:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788530463.877526:0:19494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530463.877544:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555907840 00000100:00100000:1.0:1788530463.877548:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555907840 00000100:00100000:1.0:1788530463.877590:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788530463.877597:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03cfe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+29:19494:x1875409555907840:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788530463.877657:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03cfe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+29:19494:x1875409555907840:12345-0@lo:502:mount.lustre.0 Request processed in 60us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530463.877664:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788530463.877695:0:19494:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f18143540 going to sleep for 11 seconds 00000100:00100000:1.0:1788530463.877707:0:19494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f2b92df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:19494:1875409555907840:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788530463.877738:0:19494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].51, 224 off16952 00000040:00080000:1.0:1788530463.877751:0:19494:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1788530463.878859:0:19506:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788530463.878875:0:19506:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9a9e0377b310) 00000020:00000080:0.0:1788530463.878906:0:19506:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:0.0:1788530463.879066:0:19506:0:(tgt_mount.c:167:server_get_mount()) get mount ffff9a9e025ec800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788530463.879071:0:19506:0:(tgt_mount.c:201:server_put_mount()) put mount ffff9a9e025ec800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788530463.879074:0:19506:0:(obd_mount.c:712:lustre_put_lsi()) put ffff9a9e025ec800 3 00010000:00080000:0.0:1788530463.879112:0:19506:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a9e01b16800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.141@tcp at head 00010000:00010000:1.0:1788530463.882734:0:19506:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:1.0:1788530463.883095:0:19506:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1788530463.883162:0:19506:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788530463.883178:0:19506:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xb28d70e125751abb 00000100:00080000:1.0:1788530463.883190:0:19506:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788530463.883196:0:19506:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9a9e01b16800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:1.0:1788530463.883715:0:19506:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9f2b92df80 x1875409555907968/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788530463.883739:0:19506:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788530463.883820:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f2b92d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555908096:0@lo:400:kworker.0 00000100:00100000:0.0:1788530463.883898:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788530463.884060:0:476:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788530463.884065:0:476:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788530463.884068:0:476:0:(import.c:65:import_set_state_nolock()) ffff9a9f37411800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788530463.884075:0:476:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 669 00000100:00080000:1.0:1788530463.884078:0:476:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788530463.884083:0:476:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a9f37411800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:1.0:1788530463.884101:0:476:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9f2b92e680 x1875409555908352/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788530463.884152:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788530463.884159:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f2b92ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555908608:0@lo:400:kworker.0 00000100:00100000:0.0:1788530463.884191:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530463.884236:0:17899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555908096 00000100:00100000:0.0:1788530463.884244:0:17899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555908096 00000100:00100000:0.0:1788530463.884282:0:17899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555908608 00000100:00100000:0.0:1788530463.884285:0:17899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555908608 00000100:00100000:0.0:1788530463.884303:0:17899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788530463.884312:0:17899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03767480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555908096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530463.884369:0:17899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03767480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555908096:12345-0@lo:400:kworker.0 Request processed in 58us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530463.884376:0:17899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788530463.884393:0:17899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788530463.884399:0:17899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03765c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555908608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530463.884424:0:17899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03765c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555908608:12345-0@lo:400:kworker.0 Request processed in 26us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530463.884429:0:17899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788530463.884459:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f2b92ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555908608:0@lo:400:kworker.0 00000100:00100000:0.0:1788530463.884541:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f2b92d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555908096:0@lo:400:kworker.0 00000100:00080000:1.0:1788530463.884640:0:476:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788530463.884643:0:476:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788530463.884645:0:476:0:(import.c:65:import_set_state_nolock()) ffff9a9f0d6f0800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788530463.884649:0:476:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 669 00000100:00080000:1.0:1788530463.884651:0:476:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788530463.884655:0:476:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9a9f0d6f0800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:1.0:1788530463.884669:0:476:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9f2b92c700 x1875409555908864/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788530463.884726:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f2b92fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875409555909248:0@lo:400:kworker.0 00000100:00100000:1.0:1788530463.884757:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530463.884780:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788530463.884786:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f2b92c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555908736:0@lo:400:kworker.0 00000100:00100000:1.0:1788530463.884816:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530463.884960:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f2b92ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875409555908480:0@lo:400:kworker.0 00000100:00100000:1.0:1788530463.885060:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530463.885119:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f2b92f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875409555909120:0@lo:400:kworker.0 00000100:00100000:2.0:1788530463.885134:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f2b92df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1875409555907968:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788530463.885145:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530463.885186:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f2b92d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555908224:0@lo:400:kworker.0 00000100:00100000:2.0:1788530463.885228:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530463.885251:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f2b92ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875409555908992:0@lo:400:kworker.0 00000100:00100000:2.0:1788530463.885298:0:18966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555908736 00000100:00100000:2.0:1788530463.885303:0:18966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555908736 00000100:00100000:2.0:1788530463.885347:0:18966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555908224 00000100:00100000:2.0:1788530463.885350:0:18966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555908224 00000100:00100000:2.0:1788530463.885678:0:18966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788530463.885769:0:18966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f2b92d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555908736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530463.885830:0:18966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f2b92d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555908736:12345-0@lo:400:kworker.0 Request processed in 64us (1012us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530463.885837:0:18966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788530463.885853:0:18966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788530463.885860:0:18966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555908224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530463.885892:0:18966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555908224:12345-0@lo:400:kworker.0 Request processed in 33us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530463.885898:0:18966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1788530463.885914:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788530463.890023:0:18163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555909248 00000100:00100000:0.0:1788530463.890044:0:18163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555909248 00000100:00080000:2.0:1788530463.890080:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788530463.890111:0:18163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555908480 00000100:00100000:0.0:1788530463.890116:0:18163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555908480 00000100:00100000:0.0:1788530463.890131:0:18163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555909120 00000100:00100000:0.0:1788530463.890133:0:18163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555909120 00000100:00100000:0.0:1788530463.890170:0:18163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788530463.890180:0:18163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f2b92ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875409555909248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530463.890276:0:18163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f2b92ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875409555909248:12345-0@lo:400:kworker.0 Request processed in 98us (5517us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530463.890284:0:18163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788530463.890302:0:18163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788530463.890308:0:18163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f2b92ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875409555908480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530463.890346:0:18163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f2b92ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875409555908480:12345-0@lo:400:kworker.0 Request processed in 38us (5286us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530463.890352:0:18163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788530463.890366:0:18163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788530463.890372:0:18163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f05f44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875409555909120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530463.890397:0:18163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f05f44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875409555909120:12345-0@lo:400:kworker.0 Request processed in 26us (5253us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530463.890403:0:18163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:3.0:1788530463.890724:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788530463.890761:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f2b92c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555908736:0@lo:400:kworker.0 00010000:00080000:0.0:1788530463.890778:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9f2b92fb80 x1875409555909248/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530479 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530463.890788:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f2b92fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875409555909248:0@lo:400:kworker.0 00000100:00100000:0.0:1788530463.893195:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530463.893268:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f2b92e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875409555908352:0@lo:8:kworker.0 00000100:00100000:0.0:1788530463.893339:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530463.893374:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f2b92c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875409555908864:0@lo:8:kworker.0 00000100:00100000:0.0:1788530463.893399:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530463.893443:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530463.893505:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f2b92d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555908224:0@lo:400:kworker.0 00000100:00100000:0.0:1788530463.893537:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555907968 00000100:00100000:0.0:1788530463.893543:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555907968 00000100:00100000:0.0:1788530463.893602:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555908992 00000100:00100000:0.0:1788530463.893605:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555908992 00000100:00100000:0.0:1788530463.893633:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788530463.893642:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03765180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875409555908992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530463.893673:0:18669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555908352 00000100:00100000:2.0:1788530463.893679:0:18669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555908352 00000100:00100000:0.0:1788530463.893698:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03765180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875409555908992:12345-0@lo:400:kworker.0 Request processed in 56us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530463.893705:0:18669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555908864 00000100:00100000:0.0:1788530463.893707:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788530463.893709:0:18669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555908864 00000100:00100000:2.0:1788530463.893730:0:18669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788530463.893734:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788530463.893740:0:18669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03766680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3646:x1875409555908352:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1788530463.893745:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03766a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1875409555907968:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788530463.893800:0:18669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03766680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3646:x1875409555908352:12345-0@lo:8:kworker.0 Request processed in 61us (459us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788530463.893813:0:18669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788530463.893822:0:18966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788530463.893831:0:18966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03767800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3646:x1875409555908864:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1788530463.893851:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788530463.893859:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9f37411800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788530463.893863:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788530463.893867:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f2b92e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875409555908352:0@lo:8:kworker.0 00010000:00080000:1.0:1788530463.895302:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9f2b92ce00 x1875409555908480/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530479 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530463.895321:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f2b92ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875409555908480:0@lo:400:kworker.0 00010000:00080000:1.0:1788530463.895337:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9f2b92f100 x1875409555909120/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530479 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530463.895347:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f2b92f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875409555909120:0@lo:400:kworker.0 00010000:00080000:1.0:1788530463.897053:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9f2b92ed80 x1875409555908992/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530479 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530463.897072:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f2b92ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875409555908992:0@lo:400:kworker.0 00010000:00080000:0.0:1788530463.897926:0:17159:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 671 last 0 00000020:00000080:0.0:1788530463.898087:0:17159:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xb28d70e125751ac2 00000004:00100000:0.0:1788530463.898103:0:17159:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788530463.898140:0:17159:0:(import.c:65:import_set_state_nolock()) ffff9a9e01b13000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788530463.898243:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03766a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875409555907968:12345-0@lo:38:llog_process_th.0 Request processed in 4498us (5053us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530463.898254:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788530463.898270:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9f2b92df80 x1875409555907968/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788530473 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530463.898282:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788530463.898290:0:3646:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1788530463.898297:0:3646:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788530463.898302:0:3646:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788530463.898304:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9e01b16800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788530463.898311:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f2b92df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1875409555907968:0@lo:38:llog_process_th.0 00000020:01000004:1.0:1788530463.898827:0:19506:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788530463.898844:0:19506:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9a9f04533310) 00000100:00100000:3.0:1788530463.898941:0:18966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03767800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3646:x1875409555908864:12345-0@lo:8:kworker.0 Request processed in 5108us (5539us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788530463.898951:0:18966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788530463.899006:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788530463.899013:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9f0d6f0800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788530463.899016:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788530463.899020:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f2b92c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875409555908864:0@lo:8:kworker.0 00000020:00000080:1.0:1788530463.902180:0:19506:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:1.0:1788530463.902361:0:19506:0:(tgt_mount.c:167:server_get_mount()) get mount ffff9a9e025ec800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788530463.902367:0:19506:0:(tgt_mount.c:201:server_put_mount()) put mount ffff9a9e025ec800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788530463.902377:0:19506:0:(obd_mount.c:712:lustre_put_lsi()) put ffff9a9e025ec800 3 00010000:00080000:1.0:1788530463.902429:0:19506:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a9f047fa800@lustre-MDT0001-lwp-OST0001: add connection 192.168.202.141@tcp at head 00010000:00010000:1.0:1788530463.905876:0:19506:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:1.0:1788530463.906732:0:19506:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:1.0:1788530463.906776:0:19506:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788530463.906790:0:19506:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xb28d70e125751ad0 00000100:00080000:1.0:1788530463.906800:0:19506:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788530463.906806:0:19506:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9a9f047fa800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:1.0:1788530463.906841:0:19506:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9f05f45500 x1875409555909376/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788530463.906879:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f05f45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3646:1875409555909376:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788530463.906950:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788530463.907119:0:19506:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000040:00080000:1.0:1788530463.910736:0:19506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x14:0x0] index 52 count 51 00000020:01000000:1.0:1788530463.910816:0:19494:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1788530463.910835:0:19494:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788530463.910869:0:19494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b600/0xb28d70e125751aa6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751aad expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530463.910881:0:19494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b600/0xb28d70e125751aa6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751aad expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788530463.910952:0:19494:0:(tgt_mount.c:1239:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788530463.910955:0:19494:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788530463.910956:0:19494:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788530463.910958:0:19494:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:1.0:1788530463.911164:0:19494:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:1.0:1788530463.911167:0:19494:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:1.0:1788530463.911169:0:19494:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788530463.911172:0:19494:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788530463.911181:0:19494:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788530463.911187:0:19494:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1788530463.911189:0:19494:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788530463.911191:0:19494:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788530463.911192:0:19494:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788530463.911193:0:19494:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:1.0:1788530463.911195:0:19494:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:1.0:1788530463.911195:0:19494:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:1.0:1788530463.911196:0:19494:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788530463.911197:0:19494:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788530463.911207:0:19494:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788530463.911241:0:19494:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788530463.911268:0:19494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f05f45f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:19494:1875409555909504:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788530463.911368:0:19494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530463.911416:0:19494:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f18143600 going to sleep for 11 seconds 00000100:00100000:1.0:1788530463.911445:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555909504 00000100:00100000:1.0:1788530463.911454:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555909504 00000100:00100000:1.0:1788530463.911699:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788530463.911709:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03cfc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+29:19494:x1875409555909504:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788530463.911745:0:17154:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788530463.911764:0:17154:0:(mgs_nids.c:468:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1788530463.913169:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555909376 00000100:00100000:0.0:1788530463.913182:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555909376 00000100:00100000:0.0:1788530463.913238:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788530463.913245:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f05f47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1875409555909376:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788530463.913284:0:17158:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 671 last 0 00000020:00000080:0.0:1788530463.913319:0:17158:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xb28d70e125751ad7 00000004:00100000:0.0:1788530463.913334:0:17158:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788530463.913367:0:17158:0:(import.c:65:import_set_state_nolock()) ffff9a9e01b14800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788530463.913443:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f05f47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875409555909376:12345-0@lo:38:llog_process_th.0 Request processed in 196us (6491us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530463.913450:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788530463.913764:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a9f05f45500 x1875409555909376/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788530473 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530463.913778:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788530463.913790:0:3646:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1788530463.913799:0:3646:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788530463.913804:0:3646:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788530463.913807:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9f047fa800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788530463.913816:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f05f45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3646:1875409555909376:0@lo:38:llog_process_th.0 20000000:01000000:2.0:1788530463.929910:0:17154:0:(mgs_nids.c:833:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788530463.929924:0:17154:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1788530463.930288:0:17174:0:(mgs_nids.c:730:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788530463.930295:0:17174:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788530463.930323:0:17174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a9f18140400/0xb28d70e125751ade lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530463.930343:0:17174:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a9f012eb600/0xb28d70e12575195d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125751956 expref: 29 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530463.930351:0:17174:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a9f3d100a00/0xb28d70e12575196b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125751964 expref: 29 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530463.930358:0:17174:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a9f3d100400/0xb28d70e125751979 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125751972 expref: 29 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530463.930372:0:17174:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a9f18140600/0xb28d70e125751a91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125751a8a expref: 29 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530463.930381:0:17174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a9f18140400/0xb28d70e125751ade lrc: 7/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530463.930424:0:17174:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a9f18140600/0xb28d70e125751a91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb28d70e125751a8a expref: 29 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530463.930438:0:17174:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a9f18140600/0xb28d70e125751a91 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb28d70e125751a8a expref: 29 pid: 17153 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530463.930451:0:17174:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d3c380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17174:1875409555909632:0@lo:104: 00000100:00100000:2.0:1788530463.931316:0:17174:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788530463.931374:0:17174:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a9f3d100400/0xb28d70e125751979 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb28d70e125751972 expref: 29 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530463.931383:0:17174:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a9f3d100400/0xb28d70e125751979 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb28d70e125751972 expref: 29 pid: 17154 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530463.931393:0:17174:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2b8a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17174:1875409555909760:0@lo:104: 00000100:00100000:2.0:1788530463.931412:0:17174:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788530463.931437:0:17174:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a9f3d100a00/0xb28d70e12575196b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb28d70e125751964 expref: 29 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530463.931445:0:17174:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a9f3d100a00/0xb28d70e12575196b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb28d70e125751964 expref: 29 pid: 17154 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530463.931453:0:17174:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2ba680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17174:1875409555909888:0@lo:104: 00000100:00100000:3.0:1788530463.933557:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555909632 00000100:00100000:3.0:1788530463.933580:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555909632 00000100:00100000:3.0:1788530463.933623:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555909760 00000100:00100000:3.0:1788530463.933625:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555909760 00000100:00100000:3.0:1788530463.933639:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788530463.933648:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d3e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+4:17174:x1875409555909632:12345-0@lo:104: 00010000:00010000:3.0:1788530463.933664:0:17143:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b000/0xb28d70e125751a8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e125751a91 expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530463.933747:0:17143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788530463.933753:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d3e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+4:17174:x1875409555909632:12345-0@lo:104: Request processed in 106us (2440us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530463.933760:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788530463.933790:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788530463.933797:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+3:17174:x1875409555909760:12345-0@lo:104: 00010000:00010000:3.0:1788530463.933807:0:17143:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff9a9f3d20c400/0xb28d70e125751972 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e125751979 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530463.933848:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788530463.933862:0:17143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788530463.933867:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+3:17174:x1875409555909760:12345-0@lo:104: Request processed in 72us (2454us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530463.933873:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788530463.933951:0:17174:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788530463.934009:0:17174:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a9f012eb600/0xb28d70e12575195d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb28d70e125751956 expref: 29 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530463.934021:0:17174:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a9f012eb600/0xb28d70e12575195d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb28d70e125751956 expref: 29 pid: 17151 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530463.934034:0:17174:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2b8000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17174:1875409555910016:0@lo:104: 00000100:00100000:2.0:1788530463.934059:0:17174:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530463.934069:0:17174:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e03330180 going to sleep for 11 seconds 00000100:00100000:2.0:1788530463.934089:0:17174:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d3c380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17174:1875409555909632:0@lo:104: 00000100:00100000:3.0:1788530463.934092:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555909888 00000100:00100000:3.0:1788530463.934097:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555909888 00000100:00100000:2.0:1788530463.934101:0:17174:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2b8a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17174:1875409555909760:0@lo:104: 00000100:00100000:3.0:1788530463.934114:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555910016 00000100:00100000:3.0:1788530463.934117:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555910016 00000100:00100000:2.0:1788530463.934130:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788530463.934143:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+4:17174:x1875409555909888:12345-0@lo:104: 00010000:00010000:2.0:1788530463.934153:0:17142:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff9a9f3d20ce00/0xb28d70e125751964 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e12575196b expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530463.934277:0:17174:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2ba680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17174:1875409555909888:0@lo:104: 00010000:00010000:0.0:1788530463.937790:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b000/0xb28d70e125751a8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e125751a91 expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530463.937812:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d36b000 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:0.0:1788530463.937817:0:17148:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b000/0xb28d70e125751a8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xb28d70e125751a91 expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530463.937828:0:17148:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b000/0xb28d70e125751a8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xb28d70e125751a91 expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788530463.937835:0:17148:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b000/0xb28d70e125751a8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xb28d70e125751a91 expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788530463.937839:0:17148:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:1.0:1788530463.937895:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03cfc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+29:19494:x1875409555909504:12345-0@lo:253:mount.lustre.0 Request processed in 26181us (26523us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530463.937917:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788530463.937930:0:19494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f05f45f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:19494:1875409555909504:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788530463.937943:0:19494:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788530463.937946:0:19494:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788530463.937948:0:19494:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788530463.937949:0:19494:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788530463.937950:0:19494:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:0.0:1788530463.937951:0:19494:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:0.0:1788530463.937957:0:19494:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:0.0:1788530463.937959:0:19494:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788530463.937968:0:19494:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788530463.937970:0:19494:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788530463.937987:0:19494:0:(tgt_mount.c:2823:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1788530463.938143:0:17148:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b000/0xb28d70e125751a8a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125751a91 expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530463.938152:0:17148:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788530463.938178:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b000/0xb28d70e125751a8a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125751a91 expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530463.938185:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b000/0xb28d70e125751a8a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125751a91 expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530463.938224:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f05f45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:3650:1875409555910144:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788530463.938262:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530463.938311:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555910144 00000100:00100000:1.0:1788530463.938317:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555910144 00010000:00010000:1.0:1788530463.938342:0:17145:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a9f18140600/0xb28d70e125751a91 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e125751a8a expref: 29 pid: 17153 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530463.938371:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788530463.938379:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f05f45c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+29:3650:x1875409555910144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788530463.938390:0:17145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788530463.938396:0:17145:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a9f18140600/0xb28d70e125751a91 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e125751a8a expref: 29 pid: 17153 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530463.938409:0:17145:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a9f18140600/0xb28d70e125751a91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb28d70e125751a8a expref: 29 pid: 17153 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530463.938427:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f18140600/0xb28d70e125751a91 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb28d70e125751a8a expref: 29 pid: 17153 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530463.938454:0:17145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788530463.939725:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f05f45c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+28:3650:x1875409555910144:12345-0@lo:103:ldlm_bl.0 Request processed in 1341us (1457us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530463.939736:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1788530463.939900:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788530463.939908:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f3d20c400/0xb28d70e125751972 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e125751979 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530463.939916:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d20c400 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:1.0:1788530463.939920:0:17148:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f3d20c400/0xb28d70e125751972 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb28d70e125751979 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530463.939928:0:17148:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f3d20c400/0xb28d70e125751972 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb28d70e125751979 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788530463.939934:0:17148:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f3d20c400/0xb28d70e125751972 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb28d70e125751979 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788530463.939939:0:17148:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788530463.941228:0:17148:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9f3d20c400/0xb28d70e125751972 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125751979 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530463.941240:0:17148:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788530463.941272:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f3d20c400/0xb28d70e125751972 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125751979 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530463.941279:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f3d20c400/0xb28d70e125751972 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125751979 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530463.941338:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f05f44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:3647:1875409555910272:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788530463.941405:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530463.941628:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f05f45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:3650:1875409555910144:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788530463.941843:0:17142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788530463.941855:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+4:17174:x1875409555909888:12345-0@lo:104: Request processed in 7714us (7903us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530463.941867:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788530463.941901:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788530463.941912:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d80380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+3:17174:x1875409555910016:12345-0@lo:104: 00010000:00010000:2.0:1788530463.941925:0:17142:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff9a9f3d20c600/0xb28d70e125751956 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e12575195d expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530463.942000:0:17142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788530463.942013:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d80380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+3:17174:x1875409555910016:12345-0@lo:104: Request processed in 105us (7953us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530463.942019:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1788530463.942041:0:17147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788530463.942047:0:17147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f3d20ce00/0xb28d70e125751964 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e12575196b expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530463.942055:0:17147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d20ce00 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:2.0:1788530463.942059:0:17147:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f3d20ce00/0xb28d70e125751964 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb28d70e12575196b expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530463.942068:0:17147:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f3d20ce00/0xb28d70e125751964 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb28d70e12575196b expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788530463.942076:0:17147:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f3d20ce00/0xb28d70e125751964 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb28d70e12575196b expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788530463.942082:0:17147:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788530463.942122:0:17147:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9f3d20ce00/0xb28d70e125751964 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e12575196b expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530463.942129:0:17147:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788530463.942144:0:17147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f3d20ce00/0xb28d70e125751964 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e12575196b expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530463.942150:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f3d20ce00/0xb28d70e125751964 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e12575196b expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530463.942161:0:17147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788530463.942164:0:17147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f3d20c600/0xb28d70e125751956 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e12575195d expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530463.942179:0:17147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d20c600 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:2.0:1788530463.942182:0:17147:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f3d20c600/0xb28d70e125751956 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb28d70e12575195d expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530463.942189:0:17147:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f3d20c600/0xb28d70e125751956 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb28d70e12575195d expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788530463.942194:0:17147:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f3d20c600/0xb28d70e125751956 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb28d70e12575195d expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788530463.942210:0:17147:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788530463.942225:0:17147:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9f3d20c600/0xb28d70e125751956 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e12575195d expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530463.942232:0:17147:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788530463.942248:0:17147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f3d20c600/0xb28d70e125751956 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e12575195d expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530463.942254:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f3d20c600/0xb28d70e125751956 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e12575195d expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530463.942270:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530463.942271:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530463.942273:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788530463.942279:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788530463.942289:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:3650:1875409555910528:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788530463.942316:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788530463.943642:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788530463.943660:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555910272 00000100:00100000:2.0:1788530463.943680:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555910272 00010000:00010000:2.0:1788530463.943725:0:17146:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a9f3d100400/0xb28d70e125751979 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e125751972 expref: 28 pid: 17154 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530463.943771:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555910528 00000100:00100000:2.0:1788530463.943775:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555910528 00010000:00010000:2.0:1788530463.943789:0:17146:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a9f012eb600/0xb28d70e12575195d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e125751956 expref: 29 pid: 17151 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530463.943803:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788530463.943810:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f05f45880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+29:3647:x1875409555910272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788530463.943827:0:17146:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788530463.943833:0:17146:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a9f3d100400/0xb28d70e125751979 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e125751972 expref: 29 pid: 17154 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530463.943846:0:17146:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a9f3d100400/0xb28d70e125751979 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb28d70e125751972 expref: 29 pid: 17154 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530463.943866:0:17146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f3d100400/0xb28d70e125751979 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb28d70e125751972 expref: 29 pid: 17154 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530463.943883:0:17146:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788530463.943944:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f05f45880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+28:3647:x1875409555910272:12345-0@lo:103:ldlm_bl.0 Request processed in 133us (2539us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530463.943951:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788530463.944232:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788530463.944247:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d82d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+28:3650:x1875409555910528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788530463.944259:0:17144:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788530463.944267:0:17144:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a9f012eb600/0xb28d70e12575195d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e125751956 expref: 28 pid: 17151 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530463.944280:0:17144:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a9f012eb600/0xb28d70e12575195d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb28d70e125751956 expref: 28 pid: 17151 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530463.944294:0:17144:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788530463.944336:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d82d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+28:3650:x1875409555910528:12345-0@lo:103:ldlm_bl.0 Request processed in 95us (2019us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530463.944343:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1788530463.944416:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788530463.944418:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:3650:1875409555910528:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788530463.944420:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530463.944421:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f012eb600/0xb28d70e12575195d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb28d70e125751956 expref: 26 pid: 17151 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530463.944424:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788530463.944437:0:17174:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2b8000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17174:1875409555910016:0@lo:104: 00010000:00010000:0.0:1788530463.944490:0:17174:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a9f18140400/0xb28d70e125751ade lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530463.944727:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f05f44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:3647:1875409555910272:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788530463.944740:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788530463.944751:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:3647:1875409555910400:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788530463.944795:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530463.944831:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555910400 00000100:00100000:1.0:1788530463.944837:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555910400 00010000:00010000:1.0:1788530463.944864:0:17144:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a9f3d100a00/0xb28d70e12575196b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e125751964 expref: 26 pid: 17154 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530463.944930:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788530463.944939:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03764000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+26:3647:x1875409555910400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788530463.944948:0:17144:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788530463.944952:0:17144:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a9f3d100a00/0xb28d70e12575196b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e125751964 expref: 26 pid: 17154 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530463.944972:0:17144:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a9f3d100a00/0xb28d70e12575196b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb28d70e125751964 expref: 26 pid: 17154 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530463.944992:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f3d100a00/0xb28d70e12575196b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb28d70e125751964 expref: 26 pid: 17154 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530463.945008:0:17144:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a9f18140400/0xb28d70e125751ade lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530463.945017:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f18140400/0xb28d70e125751ade lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788530463.945035:0:17144:0:(mgs_nids.c:706:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.014740373s 00010000:00010000:1.0:1788530463.945040:0:17144:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a9f18140400/0xb28d70e125751ade lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530463.945062:0:17144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a9f18140400/0xb28d70e125751ade lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530463.945070:0:17144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a9f18140400/0xb28d70e125751ade lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530463.945079:0:17144:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a9f18140400/0xb28d70e125751ade lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530463.945086:0:17144:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f18140400 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:1.0:1788530463.945091:0:17144:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a9f18140400/0xb28d70e125751ade lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530463.945100:0:17144:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a9f18140400/0xb28d70e125751ade lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530463.945131:0:17144:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a9f18140400/0xb28d70e125751ade lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530463.945138:0:17174:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a9f18140400/0xb28d70e125751ade lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530463.945140:0:17144:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788530463.945146:0:17174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a9f18140400/0xb28d70e125751ade lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530463.945153:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f18140400/0xb28d70e125751ade lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530463.945175:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03764000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+25:3647:x1875409555910400:12345-0@lo:103:ldlm_bl.0 Request processed in 238us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530463.945182:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000001:00000004:3.0:1788530463.946476:0:19494:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:1.0:1788530463.948154:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:3647:1875409555910400:0@lo:103:ldlm_bl.0 00002000:00080000:0.0:1788530463.954341:0:19494:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1788530463.954350:0:19494:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1788530463.954394:0:19494:0:(tgt_mount.c:2543:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1788530463.954423:0:19494:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1788530463.955421:0:19494:0:(tgt_mount.c:2429:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788530463.956728:0:19494:0:(tgt_mount.c:2444:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788530464.832820:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788530465.029415:0:17156:0:(mgc_request.c:715:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788530465.029428:0:17156:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-mdtir-ffff9a9e025ec800 from 10 10000000:01000000:3.0:1788530465.029436:0:17156:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788530465.029501:0:17156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b800/0xb28d70e125751ae5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530465.029516:0:17156:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b800/0xb28d70e125751ae5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530465.029532:0:17156:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b800/0xb28d70e125751ae5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530465.029592:0:17156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17156:1875409555910656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788530465.029677:0:17156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530465.029720:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e02382c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788530465.029744:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555910656 00000100:00100000:3.0:1788530465.029753:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555910656 00000100:00100000:3.0:1788530465.029808:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788530465.029818:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03cff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+25:17156:x1875409555910656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788530465.029833:0:17153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788530465.029847:0:17153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f3d36bc00/0xb28d70e125751aec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e125751ae5 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530465.029874:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f3d36bc00/0xb28d70e125751aec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e125751ae5 expref: 26 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530465.029886:0:17153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f3d36bc00/0xb28d70e125751aec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125751ae5 expref: 26 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530465.029909:0:17153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d36bc00, rc 0) 00000100:00100000:3.0:1788530465.029953:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03cff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+26:17156:x1875409555910656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530465.029961:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788530465.033020:0:17156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17156:1875409555910656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788530465.033064:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b800/0xb28d70e125751ae5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751aec expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530465.033077:0:17156:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b800/0xb28d70e125751ae5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e125751aec expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530465.033146:0:17156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d82a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17156:1875409555910784:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788530465.033225:0:17156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530465.033279:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f37503f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788530465.033431:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555910784 00000100:00100000:0.0:1788530465.033439:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555910784 00000100:00100000:0.0:1788530465.033494:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788530465.033504:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+26:17156:x1875409555910784:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788530465.033527:0:17154:0:(mgs_nids.c:1159:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788530465.033550:0:17154:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788530465.033553:0:17154:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:0.0:1788530465.033687:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+26:17156:x1875409555910784:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 184us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530465.033695:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788530465.033740:0:17156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d82a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17156:1875409555910784:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788530465.033780:0:17156:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788530465.033788:0:17156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b800/0xb28d70e125751ae5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751aec expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530465.033797:0:17156:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b800/0xb28d70e125751ae5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751aec expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788530465.033813:0:17156:0:(mgc_request.c:715:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788530465.033816:0:17156:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-mdtir-ffff9a9f0519b800 from 10 10000000:01000000:0.0:1788530465.033819:0:17156:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788530465.033845:0:17156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91c800/0xb28d70e125751af3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530465.033853:0:17156:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91c800/0xb28d70e125751af3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530465.033862:0:17156:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91c800/0xb28d70e125751af3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530465.033882:0:17156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03764e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17156:1875409555910912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788530465.033910:0:17156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530465.033932:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f02f27cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788530465.033945:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555910912 00000100:00100000:0.0:1788530465.033949:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555910912 00000100:00100000:0.0:1788530465.033973:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788530465.033980:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+26:17156:x1875409555910912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788530465.033989:0:17151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530465.034003:0:17151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f0c91d400/0xb28d70e125751afa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e125751af3 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530465.034022:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f0c91d400/0xb28d70e125751afa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e125751af3 expref: 27 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530465.034032:0:17151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f0c91d400/0xb28d70e125751afa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125751af3 expref: 27 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530465.034042:0:17151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f0c91d400, rc 0) 00000100:00100000:0.0:1788530465.034070:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+27:17156:x1875409555910912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 90us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530465.034076:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788530465.034104:0:17156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03764e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17156:1875409555910912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788530465.034114:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91c800/0xb28d70e125751af3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751afa expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530465.034121:0:17156:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91c800/0xb28d70e125751af3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e125751afa expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530465.034164:0:17156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03764e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17156:1875409555911040:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788530465.034204:0:17156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530465.034217:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f02f27cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788530465.034227:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555911040 00000100:00100000:0.0:1788530465.034230:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555911040 00000100:00100000:0.0:1788530465.034665:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788530465.034674:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+27:17156:x1875409555911040:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788530465.034686:0:17151:0:(mgs_nids.c:1159:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788530465.034701:0:17151:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788530465.034704:0:17151:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:0.0:1788530465.037788:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+27:17156:x1875409555911040:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 3102us (3570us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530465.037807:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788530465.039738:0:17156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03764e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17156:1875409555911040:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788530465.039798:0:17156:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788530465.039809:0:17156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91c800/0xb28d70e125751af3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751afa expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530465.039821:0:17156:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91c800/0xb28d70e125751af3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751afa expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788530465.039839:0:17156:0:(mgc_request.c:715:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788530465.039842:0:17156:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-mdtir-ffff9a9e03637800 from 10 10000000:01000000:3.0:1788530465.039845:0:17156:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788530465.039887:0:17156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b400/0xb28d70e125751b01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530465.039895:0:17156:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b400/0xb28d70e125751b01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530465.039906:0:17156:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b400/0xb28d70e125751b01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530465.039930:0:17156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17156:1875409555911168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788530465.040010:0:17156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530465.040351:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e02382b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788530465.042360:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555911168 00000100:00100000:0.0:1788530465.042379:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555911168 00000100:00100000:0.0:1788530465.042469:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788530465.042482:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+27:17156:x1875409555911168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788530465.042509:0:17153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530465.042529:0:17153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f0c91d200/0xb28d70e125751b08 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e125751b01 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530465.042581:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f0c91d200/0xb28d70e125751b08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e125751b01 expref: 28 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530465.042595:0:17153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f0c91d200/0xb28d70e125751b08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125751b01 expref: 28 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530465.042619:0:17153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f0c91d200, rc 0) 00000100:00100000:0.0:1788530465.042722:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+28:17156:x1875409555911168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 241us (2711us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530465.042729:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788530465.042799:0:17156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17156:1875409555911168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788530465.042824:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b400/0xb28d70e125751b01 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751b08 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530465.042833:0:17156:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b400/0xb28d70e125751b01 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e125751b08 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530465.042912:0:17156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03766300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17156:1875409555911296:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788530465.042961:0:17156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530465.042997:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f02f273c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788530465.043012:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555911296 00000100:00100000:0.0:1788530465.043016:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555911296 00000100:00100000:0.0:1788530465.043043:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788530465.043050:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+28:17156:x1875409555911296:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788530465.043065:0:17151:0:(mgs_nids.c:1159:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788530465.043086:0:17151:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788530465.043089:0:17151:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:0.0:1788530465.043165:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+28:17156:x1875409555911296:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 115us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530465.043172:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788530465.043216:0:17156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03766300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17156:1875409555911296:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788530465.043498:0:17156:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788530465.043506:0:17156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b400/0xb28d70e125751b01 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751b08 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530465.043515:0:17156:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36b400/0xb28d70e125751b01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751b08 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788530465.043528:0:17156:0:(mgc_request.c:715:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788530465.043531:0:17156:0:(mgc_request.c:2194:mgc_process_log()) Process log lustre-mdtir-ffff9a9f202a8800 from 10 10000000:01000000:0.0:1788530465.043533:0:17156:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788530465.043554:0:17156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91de00/0xb28d70e125751b0f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530465.043854:0:17156:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91de00/0xb28d70e125751b0f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530465.043864:0:17156:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91de00/0xb28d70e125751b0f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530465.044116:0:17156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03766300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17156:1875409555911424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788530465.044155:0:17156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530465.044202:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f18143b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788530465.044369:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555911424 00000100:00100000:0.0:1788530465.044375:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555911424 00000100:00100000:0.0:1788530465.044414:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788530465.044421:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f04d59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+28:17156:x1875409555911424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788530465.044431:0:17151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530465.044442:0:17151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f0c91ce00/0xb28d70e125751b16 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e125751b0f expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530465.044460:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f0c91ce00/0xb28d70e125751b16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e125751b0f expref: 29 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530465.044482:0:17151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f0c91ce00/0xb28d70e125751b16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125751b0f expref: 29 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530465.044492:0:17151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f0c91ce00, rc 0) 00000100:00100000:0.0:1788530465.044637:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f04d59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+29:17156:x1875409555911424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 216us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530465.044644:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788530465.046620:0:17156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03766300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17156:1875409555911424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788530465.046655:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91de00/0xb28d70e125751b0f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751b16 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530465.046667:0:17156:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91de00/0xb28d70e125751b0f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e125751b16 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530465.046745:0:17156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d80e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17156:1875409555911552:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788530465.046820:0:17156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530465.046863:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f37503840 going to sleep for 11 seconds 00000100:00100000:3.0:1788530465.046933:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555911552 00000100:00100000:3.0:1788530465.046940:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555911552 00000100:00100000:3.0:1788530465.047025:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788530465.047036:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f04d5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+29:17156:x1875409555911552:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788530465.047056:0:17154:0:(mgs_nids.c:1159:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788530465.047075:0:17154:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788530465.047078:0:17154:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:3.0:1788530465.047175:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f04d5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+29:17156:x1875409555911552:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 140us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530465.047183:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788530465.049912:0:17156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d80e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17156:1875409555911552:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788530465.049996:0:17156:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788530465.050009:0:17156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91de00/0xb28d70e125751b0f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751b16 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530465.050020:0:17156:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f0c91de00/0xb28d70e125751b0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751b16 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000004:2.0:1788530465.076425:0:19561:0:(tgt_mount.c:2429:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788530465.076768:0:19561:0:(tgt_mount.c:2444:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788530465.857442:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788530465.857676:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555911680:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788530465.857785:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530465.858116:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555911680 00000100:00100000:2.0:1788530465.858127:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555911680 00000100:00100000:2.0:1788530465.858213:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788530465.858226:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03765880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555911680:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788530465.858269:0:18670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788530465.858331:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03765880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555911680:12345-0@lo:13:osp-pre-0-1.0 Request processed in 109us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530465.858339:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1788530465.858367:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788530465.858698:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555911680:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788530466.369188:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03765f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555911808:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788530466.369351:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530466.369457:0:17899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555911808 00000100:00100000:1.0:1788530466.369471:0:17899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555911808 00000100:00100000:1.0:1788530466.369552:0:17899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788530466.369586:0:17899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f05f44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555911808:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788530466.369649:0:17899:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788530466.369711:0:17899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f05f44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555911808:12345-0@lo:41:osp-pre-1-0.0 Request processed in 149us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530466.369720:0:17899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788530466.369791:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03765f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555911808:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788530466.370805:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788530466.370821:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555911936:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788530466.370872:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530466.370911:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555911936 00000100:00100000:2.0:1788530466.370917:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555911936 00000100:00100000:2.0:1788530466.370956:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788530466.370965:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555911936:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788530466.370998:0:17164:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788530466.371039:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555911936:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530466.371046:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788530466.371086:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555911936:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788530466.880687:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788530466.889705:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788530466.889729:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555912064:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788530466.889806:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530466.893923:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555912064 00000100:00100000:2.0:1788530466.893984:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555912064 00000100:00100000:2.0:1788530466.894075:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788530466.894088:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f328e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555912064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788530466.894121:0:18670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788530466.894224:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f328e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555912064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 140us (4419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530466.894232:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788530466.894294:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555912064:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788530466.894405:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788530467.904725:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788530468.356513:0:17192:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1788530468.482494:0:17913:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788530468.929326:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788530468.936426:0:476:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788530468.936436:0:476:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788530468.936440:0:476:0:(import.c:65:import_set_state_nolock()) ffff9a9f37411800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788530468.936457:0:476:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a9f37411800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:2.0:1788530468.936487:0:476:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9e03d81880 x1875409555912576/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788530468.936525:0:476:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788530468.936528:0:476:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788530468.936530:0:476:0:(import.c:65:import_set_state_nolock()) ffff9a9f0d6f0800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788530468.936535:0:476:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9a9f0d6f0800 using connection 192.168.202.141@tcp/0@lo 00000100:00100000:2.0:1788530468.936544:0:476:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a9e03d80000 x1875409555913088/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788530468.936627:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:3650:1875409555912192:0@lo:400:kworker.0 00000100:00100000:2.0:1788530468.936712:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530468.936772:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555912832:0@lo:400:kworker.0 00000100:00100000:2.0:1788530468.936820:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530468.936844:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875409555913472:0@lo:400:kworker.0 00000100:00100000:2.0:1788530468.936872:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530468.936900:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788530468.936906:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875409555912704:0@lo:400:kworker.0 00000100:00100000:2.0:1788530468.936928:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530468.936943:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875409555913344:0@lo:400:kworker.0 00000100:00100000:2.0:1788530468.936962:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530468.936994:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555912320:0@lo:400:kworker.0 00000100:00100000:2.0:1788530468.937017:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530468.937037:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555912960:0@lo:400:kworker.0 00000100:00100000:2.0:1788530468.937062:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530468.937096:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875409555913600:0@lo:400:kworker.0 00000100:00100000:2.0:1788530468.937116:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530468.937131:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788530468.937137:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555912448:0@lo:400:kworker.0 00000100:00100000:2.0:1788530468.937167:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530468.937183:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875409555913216:0@lo:400:kworker.0 00000100:00100000:2.0:1788530468.937201:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530468.937209:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875409555913728:0@lo:400:kworker.0 00000100:00100000:2.0:1788530468.937230:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530468.937251:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875409555912576:0@lo:8:kworker.0 00000100:00100000:2.0:1788530468.937271:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530468.937289:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875409555913088:0@lo:8:kworker.0 00000100:00100000:2.0:1788530468.937316:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530468.937359:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555912832 00000100:00100000:2.0:1788530468.937367:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555912832 00000100:00100000:2.0:1788530468.937408:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555912320 00000100:00100000:2.0:1788530468.937413:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555912320 00000100:00100000:2.0:1788530468.937430:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788530468.937439:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555912832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530468.937490:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555912832:12345-0@lo:400:kworker.0 Request processed in 50us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530468.937497:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788530468.937513:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788530468.937518:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555912320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530468.937549:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555912320:12345-0@lo:400:kworker.0 Request processed in 31us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530468.937556:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788530468.937595:0:18163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555913472 00000100:00100000:2.0:1788530468.937599:0:18163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555913472 00000100:00100000:2.0:1788530468.937625:0:18163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555912704 00000100:00100000:2.0:1788530468.937628:0:18163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555912704 00000100:00100000:2.0:1788530468.937639:0:18163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555913344 00000100:00100000:2.0:1788530468.937641:0:18163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555913344 00000100:00100000:2.0:1788530468.937653:0:18163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555913600 00000100:00100000:2.0:1788530468.937656:0:18163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555913600 00000100:00100000:2.0:1788530468.937666:0:18163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555913216 00000100:00100000:2.0:1788530468.937669:0:18163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555913216 00000100:00100000:2.0:1788530468.937678:0:18163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555913728 00000100:00100000:2.0:1788530468.937680:0:18163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555913728 00000100:00100000:2.0:1788530468.937709:0:18163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788530468.937716:0:18163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875409555913472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530468.937755:0:18163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875409555913472:12345-0@lo:400:kworker.0 Request processed in 40us (882us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530468.937761:0:18163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788530468.937773:0:18163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788530468.937780:0:18163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875409555912704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530468.937805:0:18163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875409555912704:12345-0@lo:400:kworker.0 Request processed in 27us (876us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530468.937811:0:18163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788530468.937822:0:18163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788530468.937828:0:18163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875409555913344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530468.937853:0:18163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875409555913344:12345-0@lo:400:kworker.0 Request processed in 25us (890us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530468.937858:0:18163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788530468.937869:0:18163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788530468.937875:0:18163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875409555913600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530468.937902:0:18163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875409555913600:12345-0@lo:400:kworker.0 Request processed in 28us (785us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530468.937909:0:18163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788530468.937919:0:18163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788530468.937925:0:18163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875409555913216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530468.937951:0:18163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875409555913216:12345-0@lo:400:kworker.0 Request processed in 27us (749us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530468.937957:0:18163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788530468.937967:0:18163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788530468.937974:0:18163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875409555913728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530468.938012:0:18163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875409555913728:12345-0@lo:400:kworker.0 Request processed in 39us (781us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530468.938018:0:18163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788530468.938046:0:18669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555912960 00000100:00100000:2.0:1788530468.938050:0:18669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555912960 00000100:00100000:2.0:1788530468.938070:0:18669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555912448 00000100:00100000:2.0:1788530468.938072:0:18669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555912448 00000100:00100000:2.0:1788530468.938084:0:18669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555912576 00000100:00100000:2.0:1788530468.938087:0:18669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555912576 00000100:00100000:2.0:1788530468.938095:0:18669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555913088 00000100:00100000:2.0:1788530468.938097:0:18669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555913088 00000100:00100000:2.0:1788530468.938105:0:18669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788530468.938112:0:18669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555912960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530468.938141:0:18669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555912960:12345-0@lo:400:kworker.0 Request processed in 29us (1078us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530468.938147:0:18669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788530468.938173:0:18669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788530468.938180:0:18669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555912448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530468.938206:0:18669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555912448:12345-0@lo:400:kworker.0 Request processed in 28us (1039us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530468.938212:0:18669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788530468.938223:0:18669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788530468.938227:0:18669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3646:x1875409555912576:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788530468.938254:0:18669:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 676 last 0 00000020:00000080:2.0:1788530468.938281:0:18669:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb28d70e125751b1d 00002000:00100000:2.0:1788530468.938293:0:18669:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9a9f274fe000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a05 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1788530468.938297:0:18669:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1788530468.938307:0:18669:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788530468.938510:0:18669:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788530468.938535:0:18669:0:(import.c:65:import_set_state_nolock()) ffff9a9f274fd000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788530468.938600:0:18669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3646:x1875409555912576:12345-0@lo:8:kworker.0 Request processed in 370us (1327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530468.938606:0:18669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788530468.938619:0:18669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788530468.938622:0:18669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3646:x1875409555913088:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788530468.938637:0:18669:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 676 last 0 00000020:00000080:2.0:1788530468.938652:0:18669:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb28d70e125751b24 00002000:00100000:2.0:1788530468.938658:0:18669:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9a9f274f8800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a05 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:2.0:1788530468.938661:0:18669:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:2.0:1788530468.938663:0:18669:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788530468.938684:0:18669:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:2.0:1788530468.938696:0:18669:0:(import.c:65:import_set_state_nolock()) ffff9a9f274f9000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788530468.938722:0:18669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3646:x1875409555913088:12345-0@lo:8:kworker.0 Request processed in 97us (1404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530468.938728:0:18669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1788530468.938777:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e03d81880 x1875409555912576/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788530493 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788530468.938792:0:3646:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788530468.938799:0:3646:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788530468.938804:0:3646:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788530468.938806:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9f37411800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788530468.938828:0:3646:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788530468.938833:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875409555912576:0@lo:8:kworker.0 00010000:00080000:2.0:1788530468.938856:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e03d80000 x1875409555913088/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788530493 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788530468.938866:0:3646:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1788530468.938872:0:3646:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788530468.938875:0:3646:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788530468.938877:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a9f0d6f0800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788530468.938890:0:3646:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788530468.938893:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875409555913088:0@lo:8:kworker.0 00000004:00080000:2.0:1788530468.938945:0:17185:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x6:0x0] 00000100:00100000:2.0:1788530468.938962:0:17185:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d42680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17185:1875409555913984:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788530468.938990:0:17185:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530468.939008:0:17185:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f061a2180 going to sleep for 11 seconds 00000004:00080000:2.0:1788530468.939030:0:17903:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1788530468.939042:0:17903:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d43100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17903:1875409555914240:0@lo:7:osp-pre-1-1.0 00000100:00100000:2.0:1788530468.939061:0:17903:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530468.939075:0:17903:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f061a2600 going to sleep for 11 seconds 00000100:00100000:2.0:1788530468.939087:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555913856:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788530468.939109:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530468.939127:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788530468.939132:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555914112:0@lo:13:osp-pre-1-1.0 00000004:00080000:1.0:1788530468.939314:0:17184:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788530468.939383:0:17184:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 676841822021ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788530468.939391:0:17184:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1788530468.940423:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555912192 00000100:00100000:0.0:1788530468.940435:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555912192 00000100:00100000:0.0:1788530468.940482:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788530468.940491:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f04d5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+29:3650:x1875409555912192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530468.940552:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f04d5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+29:3650:x1875409555912192:12345-0@lo:400:kworker.0 Request processed in 63us (3840us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530468.940575:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00080000:0.0:1788530468.940613:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788530468.940619:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788530468.940621:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788530468.941202:0:18666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555913984 00000100:00100000:3.0:1788530468.941208:0:18666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555913984 00000100:00100000:3.0:1788530468.941258:0:18666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555914240 00000100:00100000:3.0:1788530468.941261:0:18666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555914240 00000100:00100000:3.0:1788530468.941277:0:18666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788530468.941283:0:18666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17185:x1875409555913984:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788530468.941526:0:17902:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788530468.941666:0:17902:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 676844104672ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788530468.941674:0:17902:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00080000:0.0:1788530468.941986:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788530468.942746:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555913856 00000100:00100000:0.0:1788530468.942756:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555913856 00000100:00100000:0.0:1788530468.942806:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788530468.942815:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3649:x1875409555913856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788530468.942860:0:18670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788530468.942935:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3649:x1875409555913856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 122us (3825us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530468.942942:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788530468.942971:0:18667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788530468.942979:0:18667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17903:x1875409555914240:12345-0@lo:7:osp-pre-1-1.0 00000100:00100000:0.0:1788530468.943046:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555912448:0@lo:400:kworker.0 00010000:00080000:0.0:1788530468.943063:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e03d83100 x1875409555913216/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530484 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530468.943084:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875409555913216:0@lo:400:kworker.0 00010000:00080000:0.0:1788530468.943102:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e03d82a00 x1875409555913728/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530484 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530468.943110:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875409555913728:0@lo:400:kworker.0 00000100:00100000:0.0:1788530468.943120:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555912320:0@lo:400:kworker.0 00000100:00100000:0.0:1788530468.943132:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555912960:0@lo:400:kworker.0 00010000:00080000:0.0:1788530468.943145:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e03d80e00 x1875409555913600/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530484 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530468.943163:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875409555913600:0@lo:400:kworker.0 00010000:00080000:0.0:1788530468.943208:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e03d80a80 x1875409555912704/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530484 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530468.943218:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875409555912704:0@lo:400:kworker.0 00010000:00080000:0.0:1788530468.943241:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e03d81500 x1875409555913344/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530484 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530468.943249:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875409555913344:0@lo:400:kworker.0 00000100:00100000:0.0:1788530468.943260:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:3650:1875409555912192:0@lo:400:kworker.0 00000100:00100000:0.0:1788530468.943271:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555912832:0@lo:400:kworker.0 00010000:00080000:0.0:1788530468.943281:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e03d83b80 x1875409555913472/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530484 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530468.943289:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875409555913472:0@lo:400:kworker.0 00000100:00100000:2.0:1788530468.947181:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788530468.947282:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e03d40e00 x1875409555913856/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530484 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530468.947315:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555913856:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788530468.949289:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555914112 00000100:00100000:0.0:1788530468.949305:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555914112 00000100:00100000:0.0:1788530468.949371:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788530468.949381:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3649:x1875409555914112:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788530468.949413:0:18670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788530468.949507:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3649:x1875409555914112:12345-0@lo:13:osp-pre-1-1.0 Request processed in 127us (10354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530468.949514:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1788530468.949578:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e03d42a00 x1875409555914112/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788530484 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530468.949598:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555914112:0@lo:13:osp-pre-1-1.0 00000004:00080000:2.0:1788530468.952227:0:17891:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000004:00080000:2.0:1788530468.956317:0:17139:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00080000:2.0:1788530468.960759:0:18667:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:2.0:1788530468.960770:0:18667:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1788530468.960870:0:18667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17903:x1875409555914240:12345-0@lo:7:osp-pre-1-1.0 Request processed in 17887us (21803us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530468.960881:0:18667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1788530468.960993:0:17903:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e03d43100 x1875409555914240/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788530484 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530468.961009:0:17903:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d43100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17903:1875409555914240:0@lo:7:osp-pre-1-1.0 00000004:00080000:0.0:1788530468.961034:0:17903:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1788530468.961092:0:17903:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03765f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17903:1875409555914368:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1788530468.961128:0:17903:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530468.961166:0:17903:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f329c3cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788530468.961267:0:18669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555914368 00000100:00100000:2.0:1788530468.961274:0:18669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555914368 00000100:00100000:2.0:1788530468.961314:0:18669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788530468.961323:0:18669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03766300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17903:x1875409555914368:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1788530468.961347:0:18669:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:2.0:1788530468.961389:0:18669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03766300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17903:x1875409555914368:12345-0@lo:5:osp-pre-1-1.0 Request processed in 66us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530468.961394:0:18669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:0.0:1788530468.962211:0:17903:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e03765f80 x1875409555914368/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788530484 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530468.962225:0:17903:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03765f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17903:1875409555914368:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1788530468.962237:0:17903:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1788530468.962274:0:17903:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03765f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17903:1875409555914496:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1788530468.962310:0:17903:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530468.962342:0:17903:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f329c3cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788530468.962391:0:18667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555914496 00000100:00100000:2.0:1788530468.962397:0:18667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555914496 00000100:00100000:2.0:1788530468.962446:0:18667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788530468.962455:0:18667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03764e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17903:x1875409555914496:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1788530468.962485:0:18667:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00002000:00080000:1.0:1788530468.966197:0:18666:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1788530468.966269:0:18666:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:0.0:1788530468.966277:0:18666:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:7 to 0x2c0000401:33) 00002000:00010000:0.0:1788530468.993051:0:18666:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788530468.993066:0:18666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000253a95a9/0xb28d70e125751b2b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530468.993103:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=676s v=(0 0) 00010000:00010000:0.0:1788530468.993109:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788530468.993117:0:18666:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000253a95a9/0xb28d70e125751b2b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530468.993139:0:18666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000253a95a9/0xb28d70e125751b2b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530468.993177:0:18666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000253a95a9/0xb28d70e125751b2b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530468.993184:0:18666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000253a95a9/0xb28d70e125751b2b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530468.993207:0:18666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788530468.993547:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788530468.993555:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000253a95a9/0xb28d70e125751b2b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530468.993637:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f0c91cc00 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:2.0:1788530468.993644:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000253a95a9/0xb28d70e125751b2b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530468.993666:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000253a95a9/0xb28d70e125751b2b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530468.993689:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000253a95a9/0xb28d70e125751b2b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530468.993697:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000253a95a9/0xb28d70e125751b2b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530468.993722:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530468.993724:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530468.993726:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788530468.994294:0:18666:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788530468.994302:0:18666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059cf28cc/0xb28d70e125751b32 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530468.994316:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=676s v=(0 0) 00010000:00010000:0.0:1788530468.994319:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788530468.994325:0:18666:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059cf28cc/0xb28d70e125751b32 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530468.994334:0:18666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000059cf28cc/0xb28d70e125751b32 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530468.994343:0:18666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059cf28cc/0xb28d70e125751b32 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530468.994351:0:18666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000059cf28cc/0xb28d70e125751b32 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530468.994385:0:18666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788530468.994536:0:17147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788530468.994542:0:17147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000059cf28cc/0xb28d70e125751b32 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530468.994551:0:17147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f0c91ca00 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:2.0:1788530468.994554:0:17147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000059cf28cc/0xb28d70e125751b32 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530468.994690:0:17147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000059cf28cc/0xb28d70e125751b32 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530468.994705:0:17147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000059cf28cc/0xb28d70e125751b32 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530468.994724:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000059cf28cc/0xb28d70e125751b32 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530468.994742:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530468.994744:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530468.994746:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788530468.995131:0:18666:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788530468.995138:0:18666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083712434/0xb28d70e125751b39 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530468.995148:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=676s v=(0 0) 00010000:00010000:0.0:1788530468.995159:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788530468.995164:0:18666:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000083712434/0xb28d70e125751b39 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530468.995174:0:18666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000083712434/0xb28d70e125751b39 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530468.995182:0:18666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083712434/0xb28d70e125751b39 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530468.995190:0:18666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000083712434/0xb28d70e125751b39 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530468.995210:0:18666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788530468.995406:0:18991:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788530468.995413:0:18991:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000083712434/0xb28d70e125751b39 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530468.995438:0:18991:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f0c91d800 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:3.0:1788530468.995442:0:18991:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000083712434/0xb28d70e125751b39 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530468.995449:0:18991:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000083712434/0xb28d70e125751b39 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530468.995466:0:18991:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000083712434/0xb28d70e125751b39 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530468.995473:0:18991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000083712434/0xb28d70e125751b39 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530468.995491:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530468.995492:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530468.995494:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788530469.000524:0:18666:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788530469.000542:0:18666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9617d7b/0xb28d70e125751b40 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.000593:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=676s v=(0 0) 00010000:00010000:0.0:1788530469.000608:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788530469.000618:0:18666:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9617d7b/0xb28d70e125751b40 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.000636:0:18666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d9617d7b/0xb28d70e125751b40 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.000651:0:18666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9617d7b/0xb28d70e125751b40 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.000660:0:18666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d9617d7b/0xb28d70e125751b40 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.000693:0:18666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788530469.000985:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788530469.000994:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d9617d7b/0xb28d70e125751b40 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530469.001005:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f0c91c200 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:3.0:1788530469.001011:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9617d7b/0xb28d70e125751b40 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530469.001023:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9617d7b/0xb28d70e125751b40 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530469.001055:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d9617d7b/0xb28d70e125751b40 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530469.001063:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9617d7b/0xb28d70e125751b40 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530469.001102:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530469.001105:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530469.001107:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788530469.002496:0:18666:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788530469.002509:0:18666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc464515/0xb28d70e125751b47 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.002529:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=676s v=(0 0) 00010000:00010000:0.0:1788530469.002535:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788530469.002541:0:18666:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc464515/0xb28d70e125751b47 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.002556:0:18666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fc464515/0xb28d70e125751b47 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.002594:0:18666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc464515/0xb28d70e125751b47 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.002610:0:18666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fc464515/0xb28d70e125751b47 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.002633:0:18666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788530469.003071:0:17147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788530469.003089:0:17147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fc464515/0xb28d70e125751b47 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530469.003098:0:17147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f0c91da00 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:2.0:1788530469.003103:0:17147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc464515/0xb28d70e125751b47 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530469.003114:0:17147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc464515/0xb28d70e125751b47 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530469.003130:0:17147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fc464515/0xb28d70e125751b47 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530469.003138:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fc464515/0xb28d70e125751b47 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530469.003169:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530469.003171:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530469.003173:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788530469.003322:0:18666:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788530469.003328:0:18666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b58ab75/0xb28d70e125751b4e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.003338:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=676s v=(0 0) 00010000:00010000:0.0:1788530469.003342:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788530469.003348:0:18666:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b58ab75/0xb28d70e125751b4e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.003358:0:18666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b58ab75/0xb28d70e125751b4e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.003366:0:18666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b58ab75/0xb28d70e125751b4e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.003374:0:18666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009b58ab75/0xb28d70e125751b4e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.003391:0:18666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788530469.005178:0:18991:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788530469.005192:0:18991:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009b58ab75/0xb28d70e125751b4e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530469.005208:0:18991:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f0c91d600 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:3.0:1788530469.005212:0:18991:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009b58ab75/0xb28d70e125751b4e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530469.005223:0:18991:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009b58ab75/0xb28d70e125751b4e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530469.005241:0:18991:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009b58ab75/0xb28d70e125751b4e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530469.005250:0:18991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b58ab75/0xb28d70e125751b4e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530469.005282:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530469.005284:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530469.005286:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788530469.012837:0:18666:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788530469.012853:0:18666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3c05dba/0xb28d70e125751b55 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.012876:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=676s v=(0 0) 00010000:00010000:0.0:1788530469.012880:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788530469.012887:0:18666:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3c05dba/0xb28d70e125751b55 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.012902:0:18666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b3c05dba/0xb28d70e125751b55 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.012913:0:18666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3c05dba/0xb28d70e125751b55 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.012921:0:18666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b3c05dba/0xb28d70e125751b55 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.012989:0:18666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788530469.016120:0:18666:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788530469.016139:0:18666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2682ce2/0xb28d70e125751b5c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.016168:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=676s v=(0 0) 00010000:00010000:0.0:1788530469.016174:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788530469.016181:0:18666:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a2682ce2/0xb28d70e125751b5c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.016198:0:18666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a2682ce2/0xb28d70e125751b5c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.016222:0:18666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2682ce2/0xb28d70e125751b5c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.016231:0:18666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a2682ce2/0xb28d70e125751b5c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530469.025433:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788530469.025450:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b3c05dba/0xb28d70e125751b55 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530469.025466:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9e010a3400 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:3.0:1788530469.025471:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3c05dba/0xb28d70e125751b55 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530469.025486:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3c05dba/0xb28d70e125751b55 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530469.025508:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b3c05dba/0xb28d70e125751b55 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530469.025526:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3c05dba/0xb28d70e125751b55 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530469.025548:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788530469.025553:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a2682ce2/0xb28d70e125751b5c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530469.025574:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9e010a3200 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:3.0:1788530469.025587:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2682ce2/0xb28d70e125751b5c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530469.025597:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2682ce2/0xb28d70e125751b5c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530469.025608:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a2682ce2/0xb28d70e125751b5c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530469.025615:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530469.025617:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530469.025619:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530469.026702:0:18666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788530469.026717:0:18666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a2682ce2/0xb28d70e125751b5c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530469.027228:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788530469.027355:0:18666:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788530469.027363:0:18666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d17e6d35/0xb28d70e125751b63 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.027377:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=676s v=(0 0) 00010000:00010000:0.0:1788530469.027382:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788530469.027388:0:18666:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d17e6d35/0xb28d70e125751b63 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.027403:0:18666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d17e6d35/0xb28d70e125751b63 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.027412:0:18666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d17e6d35/0xb28d70e125751b63 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.027497:0:18666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d17e6d35/0xb28d70e125751b63 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.027523:0:18666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788530469.027845:0:18991:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788530469.027851:0:18991:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d17e6d35/0xb28d70e125751b63 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530469.027861:0:18991:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9e010a3e00 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:2.0:1788530469.027865:0:18991:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d17e6d35/0xb28d70e125751b63 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530469.027876:0:18991:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d17e6d35/0xb28d70e125751b63 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530469.027895:0:18991:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d17e6d35/0xb28d70e125751b63 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530469.027902:0:18991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d17e6d35/0xb28d70e125751b63 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530469.027921:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530469.027922:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530469.027924:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788530469.027998:0:18666:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788530469.028005:0:18666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a2e63bf/0xb28d70e125751b6a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.028014:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=676s v=(0 0) 00010000:00010000:0.0:1788530469.028017:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788530469.028021:0:18666:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a2e63bf/0xb28d70e125751b6a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.028030:0:18666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a2e63bf/0xb28d70e125751b6a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.028038:0:18666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a2e63bf/0xb28d70e125751b6a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.028045:0:18666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006a2e63bf/0xb28d70e125751b6a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.028402:0:18666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788530469.033523:0:18666:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788530469.033537:0:18666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065e033ab/0xb28d70e125751b71 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.033585:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=676s v=(0 0) 00010000:00010000:0.0:1788530469.033591:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788530469.033599:0:18666:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065e033ab/0xb28d70e125751b71 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.033617:0:18666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000065e033ab/0xb28d70e125751b71 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.033630:0:18666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065e033ab/0xb28d70e125751b71 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.033639:0:18666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000065e033ab/0xb28d70e125751b71 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530469.039623:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788530469.039639:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006a2e63bf/0xb28d70e125751b6a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530469.039655:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9e010a2c00 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:2.0:1788530469.039661:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006a2e63bf/0xb28d70e125751b6a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530469.039698:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006a2e63bf/0xb28d70e125751b6a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530469.039723:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006a2e63bf/0xb28d70e125751b6a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530469.039732:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a2e63bf/0xb28d70e125751b6a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530469.039760:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788530469.039764:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000065e033ab/0xb28d70e125751b71 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530469.039771:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9e010a2e00 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:2.0:1788530469.039774:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000065e033ab/0xb28d70e125751b71 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530469.039783:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000065e033ab/0xb28d70e125751b71 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530469.039793:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000065e033ab/0xb28d70e125751b71 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530469.039800:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530469.039802:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530469.039810:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530469.041529:0:18666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788530469.041542:0:18666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000065e033ab/0xb28d70e125751b71 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530469.041720:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788530469.044053:0:18666:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788530469.044067:0:18666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2682ce2/0xb28d70e125751b78 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.045723:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=676s v=(0 0) 00010000:00010000:0.0:1788530469.045729:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788530469.045739:0:18666:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a2682ce2/0xb28d70e125751b78 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.045777:0:18666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a2682ce2/0xb28d70e125751b78 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.045791:0:18666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2682ce2/0xb28d70e125751b78 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.045801:0:18666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a2682ce2/0xb28d70e125751b78 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.045829:0:18666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788530469.046271:0:18991:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788530469.046281:0:18991:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a2682ce2/0xb28d70e125751b78 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530469.046291:0:18991:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9e010a3200 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:3.0:1788530469.046296:0:18991:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2682ce2/0xb28d70e125751b78 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530469.046306:0:18991:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2682ce2/0xb28d70e125751b78 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530469.046325:0:18991:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a2682ce2/0xb28d70e125751b78 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530469.046333:0:18991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a2682ce2/0xb28d70e125751b78 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530469.046366:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530469.046368:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530469.046370:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788530469.047188:0:19495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:2.0:1788530469.047215:0:19495:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1788530469.047220:0:19495:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:0.0:1788530469.047691:0:18666:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788530469.047705:0:18666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d98f9f2/0xb28d70e125751b7f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.047727:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=676s v=(0 0) 00010000:00010000:0.0:1788530469.047733:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788530469.047741:0:18666:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d98f9f2/0xb28d70e125751b7f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.047756:0:18666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d98f9f2/0xb28d70e125751b7f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.047770:0:18666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d98f9f2/0xb28d70e125751b7f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.047793:0:18666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005d98f9f2/0xb28d70e125751b7f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.047815:0:18666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788530469.048315:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788530469.048324:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005d98f9f2/0xb28d70e125751b7f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530469.048334:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9e010a3000 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:2.0:1788530469.048340:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005d98f9f2/0xb28d70e125751b7f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530469.048349:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005d98f9f2/0xb28d70e125751b7f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530469.048367:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005d98f9f2/0xb28d70e125751b7f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530469.048375:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d98f9f2/0xb28d70e125751b7f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530469.048403:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530469.048405:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530469.048407:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788530469.049506:0:18667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03764e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:17903:x1875409555914496:12345-0@lo:5:osp-pre-1-1.0 Request processed in 87044us (87187us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788530469.049519:0:18667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788530469.050328:0:17903:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1788530469.050348:0:17903:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03765f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17903:1875409555914496:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1788530469.050395:0:17903:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:2.0:1788530469.050474:0:17903:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d40e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17903:1875409555914624:0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1788530469.050532:0:17903:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530469.050599:0:17903:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f329c3cc0 going to sleep for 11 seconds 00002000:00010000:0.0:1788530469.050893:0:18666:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788530469.050906:0:18666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f7c0bf4/0xb28d70e125751b86 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.050929:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=676s v=(0 0) 00010000:00010000:0.0:1788530469.050935:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788530469.050942:0:18666:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f7c0bf4/0xb28d70e125751b86 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.050958:0:18666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008f7c0bf4/0xb28d70e125751b86 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.050970:0:18666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f7c0bf4/0xb28d70e125751b86 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.050979:0:18666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008f7c0bf4/0xb28d70e125751b86 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.051004:0:18666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788530469.051600:0:17170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555914624 00000100:00100000:3.0:1788530469.051611:0:17170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555914624 00000100:00100000:3.0:1788530469.051672:0:17170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788530469.051682:0:17170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17903:x1875409555914624:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1788530469.051774:0:17170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17903:x1875409555914624:12345-0@lo:900:osp-pre-1-1.0 Request processed in 94us (1242us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530469.051782:0:17170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788530469.051828:0:17903:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e03d40e00 x1875409555914624/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788530485 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530469.051845:0:17903:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d40e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17903:1875409555914624:0@lo:900:osp-pre-1-1.0 00010000:00010000:2.0:1788530469.052049:0:17147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788530469.052057:0:17147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008f7c0bf4/0xb28d70e125751b86 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530469.052068:0:17147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9e010a2200 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:2.0:1788530469.052285:0:17147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008f7c0bf4/0xb28d70e125751b86 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530469.052301:0:17147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008f7c0bf4/0xb28d70e125751b86 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530469.052326:0:17147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008f7c0bf4/0xb28d70e125751b86 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530469.052334:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f7c0bf4/0xb28d70e125751b86 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530469.052363:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530469.052365:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530469.052366:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788530469.054724:0:18666:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788530469.054742:0:18666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065e033ab/0xb28d70e125751b8d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.054768:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=676s v=(0 0) 00010000:00010000:0.0:1788530469.054773:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788530469.054780:0:18666:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065e033ab/0xb28d70e125751b8d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.054796:0:18666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000065e033ab/0xb28d70e125751b8d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.054808:0:18666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065e033ab/0xb28d70e125751b8d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.054817:0:18666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000065e033ab/0xb28d70e125751b8d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.054841:0:18666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788530469.056322:0:18991:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788530469.056339:0:18991:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000065e033ab/0xb28d70e125751b8d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530469.056353:0:18991:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9e010a2e00 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:3.0:1788530469.056358:0:18991:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000065e033ab/0xb28d70e125751b8d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530469.056371:0:18991:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000065e033ab/0xb28d70e125751b8d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530469.056417:0:18991:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000065e033ab/0xb28d70e125751b8d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530469.056424:0:18991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000065e033ab/0xb28d70e125751b8d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530469.056673:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530469.056675:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530469.056677:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788530469.056815:0:18666:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788530469.056823:0:18666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000160fa31/0xb28d70e125751b94 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.056836:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=676s v=(0 0) 00010000:00010000:0.0:1788530469.056840:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788530469.056847:0:18666:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000160fa31/0xb28d70e125751b94 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.056859:0:18666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000160fa31/0xb28d70e125751b94 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.056880:0:18666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000160fa31/0xb28d70e125751b94 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.056888:0:18666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000160fa31/0xb28d70e125751b94 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.056907:0:18666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788530469.057333:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788530469.057342:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000160fa31/0xb28d70e125751b94 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530469.057364:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9e010a2a00 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:2.0:1788530469.057369:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000160fa31/0xb28d70e125751b94 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530469.057378:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000160fa31/0xb28d70e125751b94 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530469.057395:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000160fa31/0xb28d70e125751b94 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530469.057404:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000160fa31/0xb28d70e125751b94 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530469.057433:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530469.057435:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530469.057437:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788530469.062782:0:18666:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788530469.062800:0:18666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b587178a/0xb28d70e125751b9b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530469.062821:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=676s v=(0 0) 00010000:00010000:2.0:1788530469.062826:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788530469.062833:0:18666:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b587178a/0xb28d70e125751b9b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530469.062850:0:18666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b587178a/0xb28d70e125751b9b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530469.062870:0:18666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b587178a/0xb28d70e125751b9b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530469.062878:0:18666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b587178a/0xb28d70e125751b9b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530469.062948:0:18666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788530469.063605:0:18666:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788530469.063613:0:18666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000abad94e8/0xb28d70e125751ba2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530469.063624:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=676s v=(0 0) 00010000:00010000:2.0:1788530469.063628:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788530469.063633:0:18666:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000abad94e8/0xb28d70e125751ba2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530469.063642:0:18666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000abad94e8/0xb28d70e125751ba2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530469.063650:0:18666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000abad94e8/0xb28d70e125751ba2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530469.063658:0:18666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000abad94e8/0xb28d70e125751ba2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.069769:0:17147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788530469.069787:0:17147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b587178a/0xb28d70e125751b9b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.069803:0:17147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f18140a00 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:0.0:1788530469.069808:0:17147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b587178a/0xb28d70e125751b9b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.069819:0:17147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b587178a/0xb28d70e125751b9b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.069844:0:17147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b587178a/0xb28d70e125751b9b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.069851:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b587178a/0xb28d70e125751b9b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.069880:0:17147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788530469.069907:0:17147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000abad94e8/0xb28d70e125751ba2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.069915:0:17147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f18141400 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:0.0:1788530469.069919:0:17147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000abad94e8/0xb28d70e125751ba2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.069928:0:17147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000abad94e8/0xb28d70e125751ba2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.069938:0:17147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000abad94e8/0xb28d70e125751ba2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.069945:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530469.069946:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530469.069948:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530469.072255:0:18666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788530469.072272:0:18666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000abad94e8/0xb28d70e125751ba2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.072518:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788530469.072995:0:18666:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788530469.073005:0:18666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000026527966/0xb28d70e125751ba9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530469.073021:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=676s v=(0 0) 00010000:00010000:2.0:1788530469.073025:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788530469.073032:0:18666:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000026527966/0xb28d70e125751ba9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530469.073046:0:18666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000026527966/0xb28d70e125751ba9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530469.073056:0:18666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000026527966/0xb28d70e125751ba9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530469.073064:0:18666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000026527966/0xb28d70e125751ba9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530469.073198:0:18666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788530469.075407:0:18666:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788530469.075437:0:18666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cdfff409/0xb28d70e125751bb0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530469.075468:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=676s v=(0 0) 00010000:00010000:2.0:1788530469.075473:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788530469.075480:0:18666:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cdfff409/0xb28d70e125751bb0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530469.075494:0:18666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cdfff409/0xb28d70e125751bb0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530469.075504:0:18666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cdfff409/0xb28d70e125751bb0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530469.075512:0:18666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cdfff409/0xb28d70e125751bb0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.076876:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788530469.076893:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000026527966/0xb28d70e125751ba9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.076908:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f18141800 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:0.0:1788530469.076913:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000026527966/0xb28d70e125751ba9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.076925:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000026527966/0xb28d70e125751ba9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.076972:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000026527966/0xb28d70e125751ba9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.076981:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000026527966/0xb28d70e125751ba9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530469.077273:0:18666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788530469.078031:0:18666:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788530469.078041:0:18666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000626bb625/0xb28d70e125751bb7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530469.078055:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=676s v=(0 0) 00010000:00010000:2.0:1788530469.078059:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788530469.078064:0:18666:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000626bb625/0xb28d70e125751bb7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530469.078159:0:18666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000626bb625/0xb28d70e125751bb7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530469.078182:0:18666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000626bb625/0xb28d70e125751bb7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530469.078190:0:18666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000626bb625/0xb28d70e125751bb7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530469.078210:0:18666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788530469.078552:0:18666:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788530469.078587:0:18666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007df32e79/0xb28d70e125751bbe lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530469.078597:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=676s v=(0 0) 00010000:00010000:2.0:1788530469.078600:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788530469.078605:0:18666:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007df32e79/0xb28d70e125751bbe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530469.078613:0:18666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007df32e79/0xb28d70e125751bbe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530469.078621:0:18666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007df32e79/0xb28d70e125751bbe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530469.078628:0:18666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007df32e79/0xb28d70e125751bbe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530469.078660:0:18666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1788530469.078931:0:18991:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788530469.078940:0:18991:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cdfff409/0xb28d70e125751bb0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.078950:0:18991:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f18140e00 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:0.0:1788530469.078956:0:18991:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cdfff409/0xb28d70e125751bb0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.078965:0:18991:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cdfff409/0xb28d70e125751bb0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.078986:0:18991:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cdfff409/0xb28d70e125751bb0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.078994:0:18991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cdfff409/0xb28d70e125751bb0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.079019:0:18991:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788530469.079022:0:18991:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000626bb625/0xb28d70e125751bb7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.079036:0:18991:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f18140200 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:0.0:1788530469.079041:0:18991:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000626bb625/0xb28d70e125751bb7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.079049:0:18991:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000626bb625/0xb28d70e125751bb7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.079058:0:18991:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000626bb625/0xb28d70e125751bb7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.079064:0:18991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000626bb625/0xb28d70e125751bb7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.079088:0:18991:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788530469.079091:0:18991:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007df32e79/0xb28d70e125751bbe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.079098:0:18991:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f18140800 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:0.0:1788530469.079101:0:18991:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007df32e79/0xb28d70e125751bbe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.079108:0:18991:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007df32e79/0xb28d70e125751bbe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.079116:0:18991:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007df32e79/0xb28d70e125751bbe lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.079129:0:18991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007df32e79/0xb28d70e125751bbe lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.079141:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530469.079142:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530469.079144:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530469.079163:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788530469.079327:0:18666:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788530469.079335:0:18666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea38b712/0xb28d70e125751bc5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530469.079344:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=676s v=(0 0) 00010000:00010000:2.0:1788530469.079348:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788530469.079353:0:18666:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea38b712/0xb28d70e125751bc5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530469.079363:0:18666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea38b712/0xb28d70e125751bc5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530469.079372:0:18666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea38b712/0xb28d70e125751bc5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530469.079378:0:18666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ea38b712/0xb28d70e125751bc5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530469.079403:0:18666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788530469.079998:0:18991:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788530469.080005:0:18991:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ea38b712/0xb28d70e125751bc5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.080013:0:18991:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f18141a00 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:0.0:1788530469.080017:0:18991:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea38b712/0xb28d70e125751bc5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.080025:0:18991:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea38b712/0xb28d70e125751bc5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.080038:0:18991:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ea38b712/0xb28d70e125751bc5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.080045:0:18991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea38b712/0xb28d70e125751bc5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.080060:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530469.080062:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530469.080070:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788530469.080229:0:18666:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788530469.080235:0:18666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059be8a01/0xb28d70e125751bcc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530469.080245:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=676s v=(0 0) 00010000:00010000:2.0:1788530469.080254:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788530469.080260:0:18666:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059be8a01/0xb28d70e125751bcc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530469.080269:0:18666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000059be8a01/0xb28d70e125751bcc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530469.080276:0:18666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059be8a01/0xb28d70e125751bcc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530469.080282:0:18666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000059be8a01/0xb28d70e125751bcc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530469.080336:0:18666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788530469.080640:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788530469.080646:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000059be8a01/0xb28d70e125751bcc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530469.080655:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f18141600 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:1.0:1788530469.080658:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000059be8a01/0xb28d70e125751bcc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530469.080666:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000059be8a01/0xb28d70e125751bcc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530469.080683:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000059be8a01/0xb28d70e125751bcc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530469.080702:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000059be8a01/0xb28d70e125751bcc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530469.080719:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530469.080721:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788530469.080826:0:18666:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788530469.080832:0:18666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3b85d67/0xb28d70e125751bd3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530469.080841:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=676s v=(0 0) 00010000:00010000:2.0:1788530469.080845:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788530469.080850:0:18666:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3b85d67/0xb28d70e125751bd3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530469.080859:0:18666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e3b85d67/0xb28d70e125751bd3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530469.080868:0:18666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3b85d67/0xb28d70e125751bd3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530469.080881:0:18666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e3b85d67/0xb28d70e125751bd3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.080923:0:17147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788530469.080928:0:17147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e3b85d67/0xb28d70e125751bd3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.080936:0:17147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f18141000 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:0.0:1788530469.080939:0:17147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3b85d67/0xb28d70e125751bd3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.080948:0:17147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3b85d67/0xb28d70e125751bd3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.080958:0:17147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e3b85d67/0xb28d70e125751bd3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.080966:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530469.080968:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530469.080969:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530469.080997:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530469.081056:0:18666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788530469.081061:0:18666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e3b85d67/0xb28d70e125751bd3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788530469.081466:0:18666:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788530469.081471:0:18666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df8fdd5c/0xb28d70e125751bda lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530469.081480:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=676s v=(0 0) 00010000:00010000:2.0:1788530469.081483:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788530469.081487:0:18666:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000df8fdd5c/0xb28d70e125751bda lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530469.081496:0:18666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000df8fdd5c/0xb28d70e125751bda lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530469.081504:0:18666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df8fdd5c/0xb28d70e125751bda lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530469.081512:0:18666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000df8fdd5c/0xb28d70e125751bda lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.081669:0:18991:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788530469.081675:0:18991:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000df8fdd5c/0xb28d70e125751bda lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.081683:0:18991:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f18141e00 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:0.0:1788530469.081687:0:18991:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000df8fdd5c/0xb28d70e125751bda lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.081844:0:18991:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000df8fdd5c/0xb28d70e125751bda lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.081869:0:18991:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000df8fdd5c/0xb28d70e125751bda lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530469.081970:0:18666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788530469.081976:0:18666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000df8fdd5c/0xb28d70e125751bda lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530469.082025:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530469.082048:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530469.082050:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530469.082052:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788530469.082916:0:18666:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788530469.082926:0:18666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d133f55a/0xb28d70e125751be1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530469.082941:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=676s v=(0 0) 00010000:00010000:1.0:1788530469.082946:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788530469.082952:0:18666:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d133f55a/0xb28d70e125751be1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530469.082964:0:18666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d133f55a/0xb28d70e125751be1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530469.082974:0:18666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d133f55a/0xb28d70e125751be1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530469.082982:0:18666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d133f55a/0xb28d70e125751be1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530469.083184:0:18666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1788530469.083244:0:18666:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:6 00000100:00100000:1.0:1788530469.083383:0:18666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:17185:x1875409555913984:12345-0@lo:5:osp-pre-1-0.0 Request processed in 142095us (144387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530469.083394:0:18666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788530469.083589:0:17185:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d42680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17185:1875409555913984:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788530469.083615:0:17185:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x6:0x0] 00000100:00100000:0.0:1788530469.083681:0:17185:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03767b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17185:1875409555914752:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788530469.083733:0:17185:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530469.083767:0:17185:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e03798600 going to sleep for 11 seconds 00000100:00100000:0.0:1788530469.083795:0:18966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555914752 00000100:00100000:0.0:1788530469.083804:0:18966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555914752 00000100:00100000:0.0:1788530469.083865:0:18966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788530469.083877:0:18966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03764700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:17185:x1875409555914752:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1788530469.083934:0:18966:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00010000:00010000:2.0:1788530469.091510:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788530469.091524:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d133f55a/0xb28d70e125751be1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530469.091539:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f012eb600 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:2.0:1788530469.091543:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d133f55a/0xb28d70e125751be1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530469.091555:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d133f55a/0xb28d70e125751be1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530469.091592:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d133f55a/0xb28d70e125751be1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530469.091600:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d133f55a/0xb28d70e125751be1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530469.091623:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530469.091624:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530469.091626:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788530469.099286:0:18966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03764700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17185:x1875409555914752:12345-0@lo:5:osp-pre-1-0.0 Request processed in 15398us (15540us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1788530469.099305:0:18966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788530469.099640:0:17185:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03767b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17185:1875409555914752:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788530469.099658:0:17185:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00010000:00010000:3.0:1788530469.955152:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788530470.977127:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788530470.977166:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555914880:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788530470.977473:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788530470.977541:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788530470.977614:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555914880 00000100:00100000:0.0:1788530470.977625:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555914880 00000100:00100000:0.0:1788530470.977699:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788530470.977711:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555914880:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788530470.977758:0:18670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788530470.977822:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555914880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 113us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530470.977840:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788530470.977901:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555914880:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788530470.978911:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788530471.493113:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555915008:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788530471.493238:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530471.493323:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555915008 00000100:00100000:2.0:1788530471.493332:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555915008 00000100:00100000:2.0:1788530471.493392:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788530471.493404:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555915008:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788530471.493453:0:17163:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788530471.493504:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555915008:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530471.493511:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788530471.493584:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555915008:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788530471.494302:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788530471.494317:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555915136:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788530471.494365:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530471.494445:0:17899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555915136 00000100:00100000:3.0:1788530471.494452:0:17899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555915136 00000100:00100000:3.0:1788530471.494498:0:17899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788530471.494508:0:17899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f05f46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555915136:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788530471.494534:0:17899:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788530471.494595:0:17899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f05f46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555915136:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530471.494602:0:17899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788530471.494643:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555915136:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788530472.001459:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788530472.010913:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788530472.010945:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555915264:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788530472.011317:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530472.017521:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555915264 00000100:00100000:0.0:1788530472.017539:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555915264 00000100:00100000:0.0:1788530472.017645:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788530472.017657:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555915264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788530472.017688:0:18670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788530472.017806:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555915264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 151us (6489us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530472.017813:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1788530472.017979:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788530472.018029:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555915264:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1788530472.592268:0:19851:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg241-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788530473.040642:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788530474.049246:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555915392:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788530474.049323:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788530474.049415:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788530474.049428:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555915392 00000100:00100000:2.0:1788530474.049436:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555915392 00000100:00100000:2.0:1788530474.049498:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788530474.049510:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1875409555915392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788530474.049542:0:18670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788530474.049621:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1875409555915392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530474.049629:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1788530474.049665:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788530474.049710:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555915392:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788530474.050141:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555915648:0@lo:400:kworker.0 00000100:00100000:3.0:1788530474.050193:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530474.050222:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03692d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555916160:0@lo:400:kworker.0 00000100:00100000:3.0:1788530474.050246:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530474.050264:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03690380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875409555916672:0@lo:400:kworker.0 00000100:00100000:3.0:1788530474.050289:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530474.050309:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788530474.050314:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555915776:0@lo:400:kworker.0 00000100:00100000:3.0:1788530474.050337:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530474.050361:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03691880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555916288:0@lo:400:kworker.0 00000100:00100000:3.0:1788530474.050390:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530474.050408:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03690e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875409555916800:0@lo:400:kworker.0 00000100:00100000:3.0:1788530474.050433:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530474.050459:0:18667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555916160 00000100:00100000:3.0:1788530474.050464:0:18667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555916160 00000100:00100000:3.0:1788530474.050500:0:18667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555915776 00000100:00100000:3.0:1788530474.050504:0:18667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555915776 00000100:00100000:3.0:1788530474.050517:0:18667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555916288 00000100:00100000:3.0:1788530474.050520:0:18667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555916288 00000100:00100000:3.0:1788530474.050534:0:18667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788530474.050541:0:18667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03691c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555916160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530474.050610:0:18667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03691c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555916160:12345-0@lo:400:kworker.0 Request processed in 69us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530474.050616:0:18667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788530474.050629:0:18667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788530474.050635:0:18667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03691f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555915776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530474.050660:0:18667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03691f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555915776:12345-0@lo:400:kworker.0 Request processed in 25us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530474.050674:0:18667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788530474.050686:0:18667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788530474.050693:0:18667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03693100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555916288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530474.050721:0:18667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03693100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555916288:12345-0@lo:400:kworker.0 Request processed in 29us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530474.050727:0:18667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788530474.050757:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555915776:0@lo:400:kworker.0 00000100:00100000:3.0:1788530474.050767:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03691880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555916288:0@lo:400:kworker.0 00000100:00100000:3.0:1788530474.050776:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03692d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555916160:0@lo:400:kworker.0 00000100:00100000:2.0:1788530474.051983:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555915648 00000100:00100000:2.0:1788530474.051994:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555915648 00000100:00100000:2.0:1788530474.052046:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788530474.052055:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03691180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555915648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530474.052141:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03691180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555915648:12345-0@lo:400:kworker.0 Request processed in 88us (1948us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530474.052149:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788530474.052172:0:18163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555916672 00000100:00100000:2.0:1788530474.052175:0:18163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555916672 00000100:00100000:2.0:1788530474.052202:0:18163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555916800 00000100:00100000:2.0:1788530474.052205:0:18163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555916800 00000100:00100000:2.0:1788530474.052225:0:18163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788530474.052231:0:18163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03691500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875409555916672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530474.052261:0:18163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03691500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875409555916672:12345-0@lo:400:kworker.0 Request processed in 31us (1972us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530474.052267:0:18163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788530474.052277:0:18163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788530474.052284:0:18163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03693800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875409555916800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530474.052309:0:18163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03693800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875409555916800:12345-0@lo:400:kworker.0 Request processed in 27us (1877us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530474.052315:0:18163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788530474.052346:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:3648:1875409555915520:0@lo:400:kworker.0 00000100:00100000:2.0:1788530474.052384:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530474.052415:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555916032:0@lo:400:kworker.0 00000100:00100000:2.0:1788530474.052460:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530474.052479:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03693480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875409555916544:0@lo:400:kworker.0 00000100:00100000:2.0:1788530474.052499:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530474.052519:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788530474.052524:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875409555915904:0@lo:400:kworker.0 00000100:00100000:2.0:1788530474.052541:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530474.052554:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03692300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875409555916416:0@lo:400:kworker.0 00000100:00100000:2.0:1788530474.052596:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530474.052612:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03690000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875409555916928:0@lo:400:kworker.0 00000100:00100000:2.0:1788530474.052630:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530474.052653:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555915520 00000100:00100000:2.0:1788530474.052657:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555915520 00000100:00100000:2.0:1788530474.052683:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788530474.052690:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03ccd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+29:3648:x1875409555915520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530474.052722:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03ccd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+29:3648:x1875409555915520:12345-0@lo:400:kworker.0 Request processed in 32us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530474.052728:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788530474.052756:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555916032 00000100:00100000:2.0:1788530474.052760:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555916032 00000100:00100000:2.0:1788530474.052779:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788530474.052785:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555916032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530474.052813:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555916032:12345-0@lo:400:kworker.0 Request processed in 28us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530474.052818:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788530474.052851:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555916544 00000100:00100000:2.0:1788530474.052855:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555916544 00000100:00100000:2.0:1788530474.052880:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555915904 00000100:00100000:2.0:1788530474.052883:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555915904 00000100:00100000:2.0:1788530474.052892:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555916416 00000100:00100000:2.0:1788530474.052894:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555916416 00000100:00100000:2.0:1788530474.052903:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555916928 00000100:00100000:2.0:1788530474.052906:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555916928 00000100:00100000:2.0:1788530474.052918:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788530474.052924:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875409555916544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530474.052954:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875409555916544:12345-0@lo:400:kworker.0 Request processed in 31us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530474.052960:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788530474.052972:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788530474.052977:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875409555915904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530474.053002:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875409555915904:12345-0@lo:400:kworker.0 Request processed in 24us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530474.053007:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788530474.053017:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788530474.053023:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875409555916416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530474.053046:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875409555916416:12345-0@lo:400:kworker.0 Request processed in 24us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530474.053052:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788530474.053062:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788530474.053069:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875409555916928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530474.053094:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875409555916928:12345-0@lo:400:kworker.0 Request processed in 26us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530474.053099:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:2.0:1788530474.053130:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788530474.053140:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788530474.053142:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788530474.053144:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788530474.053180:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e037e4e00 x1875409555915904/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530490 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530474.053194:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875409555915904:0@lo:400:kworker.0 00010000:00080000:2.0:1788530474.053206:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e03692300 x1875409555916416/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530490 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530474.053215:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03692300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875409555916416:0@lo:400:kworker.0 00010000:00080000:2.0:1788530474.053225:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e03690000 x1875409555916928/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530490 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530474.053231:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03690000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875409555916928:0@lo:400:kworker.0 00000100:00100000:2.0:1788530474.053238:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:3648:1875409555915520:0@lo:400:kworker.0 00000100:00100000:2.0:1788530474.053246:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555916032:0@lo:400:kworker.0 00010000:00080000:2.0:1788530474.053254:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e03693480 x1875409555916544/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530490 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530474.053260:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03693480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875409555916544:0@lo:400:kworker.0 00010000:00080000:2.0:1788530474.053305:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e03690e00 x1875409555916800/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530490 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530474.053314:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03690e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875409555916800:0@lo:400:kworker.0 00000100:00100000:2.0:1788530474.053325:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555915648:0@lo:400:kworker.0 00010000:00080000:2.0:1788530474.053336:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e03690380 x1875409555916672/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530490 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530474.053352:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03690380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875409555916672:0@lo:400:kworker.0 00000100:00100000:0.0:1788530474.055250:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03692d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555917056:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788530474.055326:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530474.055725:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555917056 00000100:00100000:3.0:1788530474.055736:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555917056 00000100:00100000:3.0:1788530474.055793:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788530474.055803:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03764380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555917056:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788530474.055904:0:18670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788530474.056116:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03692d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555917056:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788530474.056158:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03764380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555917056:12345-0@lo:13:osp-pre-1-1.0 Request processed in 164us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530474.056169:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000020:00000004:1.0:1788530474.057118:0:19903:0:(tgt_mount.c:2429:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788530474.057398:0:19903:0:(tgt_mount.c:2444:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788530475.072708:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788530475.076958:0:19495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000020:00000004:2.0:1788530475.275200:0:19954:0:(tgt_mount.c:2429:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788530475.275546:0:19954:0:(tgt_mount.c:2444:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788530475.639216:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530475.639286:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531690240 00000100:00100000:0.0:1788530475.639297:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531690240 00000100:00100000:0.0:1788530475.639346:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 137 00000100:00100000:0.0:1788530475.639354:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03ccd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2398:x1875409531690240:12345-192.168.202.41@tcp:250:mount.lustre.0 00010000:00080000:0.0:1788530475.639381:0:17153:0:(ldlm_lib.c:1458:target_handle_connect()) MGS: connection from fc207521-3937-4a55-9052-ed3c297904d3@192.168.202.41@tcp t0 exp 0000000000000000 cur 683 last 0 00000020:00000080:0.0:1788530475.639411:0:17153:0:(genops.c:1385:class_connect()) connect: client fc207521-3937-4a55-9052-ed3c297904d3, cookie 0xb28d70e125751be8 00000100:00080000:0.0:1788530475.639556:0:17153:0:(import.c:65:import_set_state_nolock()) ffff9a9e01b12800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788530475.639670:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03ccd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fc207521-3937-4a55-9052-ed3c297904d3+5:2398:x1875409531690240:12345-192.168.202.41@tcp:250:mount.lustre.0 Request processed in 315us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530475.639677:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 137 00000100:00100000:2.0:1788530475.648051:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530475.648664:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531690368 00000100:00100000:0.0:1788530475.648676:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531690368 00000100:00100000:0.0:1788530475.648736:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 138 00000100:00100000:0.0:1788530475.648746:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03ccf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fc207521-3937-4a55-9052-ed3c297904d3+5:14925:x1875409531690368:12345-192.168.202.41@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788530475.648765:0:17151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530475.648785:0:17151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9e010a3c00/0xb28d70e125751bef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1406819a550c2a expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530475.648820:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9e010a3c00/0xb28d70e125751bef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550c2a expref: 6 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530475.648833:0:17151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9e010a3c00/0xb28d70e125751bef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550c2a expref: 6 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530475.648842:0:17151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9e010a3c00, rc 0) 00000100:00100000:0.0:1788530475.648897:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03ccf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fc207521-3937-4a55-9052-ed3c297904d3+6:14925:x1875409531690368:12345-192.168.202.41@tcp:101:mount.lustre.0 Request processed in 153us (865us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530475.648905:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 138 00000100:00100000:3.0:1788530475.657687:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530475.657792:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531690496 00000100:00100000:2.0:1788530475.657803:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531690496 00000100:00100000:2.0:1788530475.657866:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 139 00000100:00100000:2.0:1788530475.657876:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03ccfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fc207521-3937-4a55-9052-ed3c297904d3+6:14925:x1875409531690496:12345-192.168.202.41@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788530475.658017:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03ccfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fc207521-3937-4a55-9052-ed3c297904d3+6:14925:x1875409531690496:12345-192.168.202.41@tcp:501:mount.lustre.0 Request processed in 141us (341us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788530475.658025:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 139 00000100:00100000:2.0:1788530475.671673:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530475.671773:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531690624 00000100:00100000:1.0:1788530475.671784:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531690624 00000100:00100000:1.0:1788530475.671852:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 140 00000100:00100000:1.0:1788530475.671863:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03ccf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fc207521-3937-4a55-9052-ed3c297904d3+6:14925:x1875409531690624:12345-192.168.202.41@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788530475.671881:0:17153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530475.671900:0:17153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f012eb800/0xb28d70e125751bf6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1406819a550c31 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530475.671931:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f012eb800/0xb28d70e125751bf6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550c31 expref: 7 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530475.671965:0:17153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f012eb800/0xb28d70e125751bf6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550c31 expref: 7 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530475.671973:0:17153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f012eb800, rc 0) 00000100:00100000:1.0:1788530475.672035:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03ccf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fc207521-3937-4a55-9052-ed3c297904d3+7:14925:x1875409531690624:12345-192.168.202.41@tcp:101:mount.lustre.0 Request processed in 173us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530475.672043:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 140 00000100:00100000:1.0:1788530475.673934:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530475.674028:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531690752 00000100:00100000:0.0:1788530475.674037:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531690752 00000100:00100000:0.0:1788530475.674097:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 141 00000100:00100000:0.0:1788530475.674108:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03ccdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fc207521-3937-4a55-9052-ed3c297904d3+7:14925:x1875409531690752:12345-192.168.202.41@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788530475.674288:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03ccdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fc207521-3937-4a55-9052-ed3c297904d3+8:14925:x1875409531690752:12345-192.168.202.41@tcp:501:mount.lustre.0 Request processed in 181us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530475.674297:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 141 00000100:00100000:3.0:1788530475.676958:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530475.677110:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531690880 00000100:00100000:2.0:1788530475.677119:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531690880 00000100:00100000:2.0:1788530475.677181:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 142 00000100:00100000:2.0:1788530475.677193:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03cce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fc207521-3937-4a55-9052-ed3c297904d3+8:14925:x1875409531690880:12345-192.168.202.41@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788530475.677365:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03cce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fc207521-3937-4a55-9052-ed3c297904d3+8:14925:x1875409531690880:12345-192.168.202.41@tcp:503:mount.lustre.0 Request processed in 173us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530475.677373:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 142 00000100:00100000:2.0:1788530475.697443:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530475.697926:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531691008 00000100:00100000:1.0:1788530475.697937:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531691008 00000100:00100000:1.0:1788530475.697996:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 143 00000100:00100000:1.0:1788530475.698007:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03ccf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fc207521-3937-4a55-9052-ed3c297904d3+8:14944:x1875409531691008:12345-192.168.202.41@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788530475.698176:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03ccf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fc207521-3937-4a55-9052-ed3c297904d3+8:14944:x1875409531691008:12345-192.168.202.41@tcp:502:llog_process_th.0 Request processed in 169us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530475.698185:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 143 00000100:00100000:1.0:1788530475.752398:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530475.752600:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531691136 00000100:00100000:0.0:1788530475.752614:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531691136 00000100:00100000:0.0:1788530475.752709:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 144 00000100:00100000:0.0:1788530475.752721:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03ccd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fc207521-3937-4a55-9052-ed3c297904d3+8:14944:x1875409531691136:12345-192.168.202.41@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788530475.753123:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03ccd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fc207521-3937-4a55-9052-ed3c297904d3+8:14944:x1875409531691136:12345-192.168.202.41@tcp:502:llog_process_th.0 Request processed in 402us (740us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530475.753132:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 144 00000100:00100000:3.0:1788530475.760010:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530475.760151:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531691264 00000100:00100000:2.0:1788530475.760170:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531691264 00000100:00100000:2.0:1788530475.760232:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 145 00000100:00100000:2.0:1788530475.760242:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03cccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fc207521-3937-4a55-9052-ed3c297904d3+8:14944:x1875409531691264:12345-192.168.202.41@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788530475.760421:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03cccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fc207521-3937-4a55-9052-ed3c297904d3+8:14944:x1875409531691264:12345-192.168.202.41@tcp:502:llog_process_th.0 Request processed in 179us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530475.760430:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 145 00000100:00100000:2.0:1788530475.770679:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530475.770796:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531691392 00000100:00100000:1.0:1788530475.770807:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531691392 00000100:00100000:1.0:1788530475.770867:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 146 00000100:00100000:1.0:1788530475.770878:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fc207521-3937-4a55-9052-ed3c297904d3+8:14925:x1875409531691392:12345-192.168.202.41@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788530475.770896:0:17153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530475.770918:0:17153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f012eb600/0xb28d70e125751bfd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1406819a550c62 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530475.770947:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f012eb600/0xb28d70e125751bfd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550c62 expref: 9 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530475.770975:0:17153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f012eb600/0xb28d70e125751bfd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550c62 expref: 9 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530475.770985:0:17153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f012eb600, rc 0) 00000100:00100000:1.0:1788530475.771047:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fc207521-3937-4a55-9052-ed3c297904d3+9:14925:x1875409531691392:12345-192.168.202.41@tcp:101:mount.lustre.0 Request processed in 171us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530475.771054:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 146 00000100:00100000:1.0:1788530475.774048:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530475.774455:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531691520 00000100:00100000:0.0:1788530475.774466:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531691520 00000100:00100000:0.0:1788530475.774596:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 147 00000100:00100000:0.0:1788530475.775794:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fc207521-3937-4a55-9052-ed3c297904d3+9:14925:x1875409531691520:12345-192.168.202.41@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788530475.775838:0:17151:0:(mgs_nids.c:1159:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788530475.775866:0:17151:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788530475.775870:0:17151:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788530475.775873:0:17151:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788530475.775876:0:17151:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1788530475.775879:0:17151:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:0.0:1788530475.778010:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fc207521-3937-4a55-9052-ed3c297904d3+9:14925:x1875409531691520:12345-192.168.202.41@tcp:256:mount.lustre.0 Request processed in 2225us (3959us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530475.778024:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 147 00000100:00100000:2.0:1788530475.782401:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530475.782467:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531691648 00000100:00100000:3.0:1788530475.782479:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531691648 00000100:00100000:3.0:1788530475.782647:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 148 00000100:00100000:3.0:1788530475.782658:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fc207521-3937-4a55-9052-ed3c297904d3+9:14925:x1875409531691648:12345-192.168.202.41@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788530475.782690:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788530475.782709:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f3d36b000/0xb28d70e125751c04 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1406819a550c69 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530475.782739:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f3d36b000/0xb28d70e125751c04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550c69 expref: 10 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530475.782750:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f3d36b000/0xb28d70e125751c04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550c69 expref: 10 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530475.782760:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d36b000, rc 0) 00000100:00100000:3.0:1788530475.782825:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fc207521-3937-4a55-9052-ed3c297904d3+10:14925:x1875409531691648:12345-192.168.202.41@tcp:101:mount.lustre.0 Request processed in 169us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530475.782831:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 148 00000100:00100000:1.0:1788530475.784758:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530475.784972:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531691776 00000100:00100000:0.0:1788530475.784981:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531691776 00000100:00100000:0.0:1788530475.785065:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 149 00000100:00100000:0.0:1788530475.785187:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fc207521-3937-4a55-9052-ed3c297904d3+10:14925:x1875409531691776:12345-192.168.202.41@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788530475.785401:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fc207521-3937-4a55-9052-ed3c297904d3+10:14925:x1875409531691776:12345-192.168.202.41@tcp:501:mount.lustre.0 Request processed in 326us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530475.785412:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 149 00000100:00100000:2.0:1788530475.788837:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530475.788924:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531691904 00000100:00100000:3.0:1788530475.788938:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531691904 00000100:00100000:3.0:1788530475.788995:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 150 00000100:00100000:3.0:1788530475.789005:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fc207521-3937-4a55-9052-ed3c297904d3+10:14925:x1875409531691904:12345-192.168.202.41@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788530475.789279:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fc207521-3937-4a55-9052-ed3c297904d3+10:14925:x1875409531691904:12345-192.168.202.41@tcp:503:mount.lustre.0 Request processed in 267us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530475.789288:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 150 00000100:00100000:2.0:1788530475.792724:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530475.792826:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531692032 00000100:00100000:0.0:1788530475.792851:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531692032 00000100:00100000:0.0:1788530475.792917:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 151 00000100:00100000:0.0:1788530475.792929:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fc207521-3937-4a55-9052-ed3c297904d3+10:14950:x1875409531692032:12345-192.168.202.41@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788530475.793094:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fc207521-3937-4a55-9052-ed3c297904d3+10:14950:x1875409531692032:12345-192.168.202.41@tcp:502:llog_process_th.0 Request processed in 159us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530475.793102:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 151 00000100:00100000:1.0:1788530475.802776:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530475.802928:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531692160 00000100:00100000:3.0:1788530475.802942:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531692160 00000100:00100000:3.0:1788530475.803008:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 152 00000100:00100000:3.0:1788530475.803019:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fc207521-3937-4a55-9052-ed3c297904d3+10:14950:x1875409531692160:12345-192.168.202.41@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788530475.803251:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fc207521-3937-4a55-9052-ed3c297904d3+10:14950:x1875409531692160:12345-192.168.202.41@tcp:502:llog_process_th.0 Request processed in 233us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530475.803268:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 152 00000100:00100000:2.0:1788530475.819447:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530475.819548:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530475.819616:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531692288 00000100:00100000:0.0:1788530475.819626:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531692288 00000100:00100000:0.0:1788530475.819671:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531692544 00000100:00100000:0.0:1788530475.819674:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531692544 00000100:00100000:0.0:1788530475.819702:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 7 00000100:00100000:0.0:1788530475.819712:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2398:x1875409531692288:12345-192.168.202.41@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788530475.819743:0:17159:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-MDT0000: connection from 66d42348-56b8-4977-9cd3-df6ed37388a6@192.168.202.41@tcp t0 exp 0000000000000000 cur 683 last 0 00000020:00000080:0.0:1788530475.819796:0:17159:0:(genops.c:1385:class_connect()) connect: client 66d42348-56b8-4977-9cd3-df6ed37388a6, cookie 0xb28d70e125751c0b 00000004:00100000:0.0:1788530475.819821:0:17159:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788530475.820044:0:17159:0:(import.c:65:import_set_state_nolock()) ffff9a9e01b11000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788530475.820068:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 8 00000100:00100000:3.0:1788530475.820084:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2398:x1875409531692544:12345-192.168.202.41@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788530475.820134:0:17158:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-MDT0001: connection from 66d42348-56b8-4977-9cd3-df6ed37388a6@192.168.202.41@tcp t0 exp 0000000000000000 cur 683 last 0 00000020:00000080:3.0:1788530475.820167:0:17158:0:(genops.c:1385:class_connect()) connect: client 66d42348-56b8-4977-9cd3-df6ed37388a6, cookie 0xb28d70e125751c12 00000004:00100000:3.0:1788530475.820181:0:17158:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788530475.820314:0:17158:0:(import.c:65:import_set_state_nolock()) ffff9a9e026c6800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788530475.820340:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:66d42348-56b8-4977-9cd3-df6ed37388a6+6:2398:x1875409531692544:12345-192.168.202.41@tcp:38:mount.lustre.0 Request processed in 255us (792us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530475.820349:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 8 00000100:00100000:0.0:1788530475.820441:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:66d42348-56b8-4977-9cd3-df6ed37388a6+6:2398:x1875409531692288:12345-192.168.202.41@tcp:38:mount.lustre.0 Request processed in 728us (1006us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530475.820448:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 7 00000100:00100000:2.0:1788530475.825040:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530475.825146:0:18163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531692800 00000100:00100000:1.0:1788530475.825164:0:18163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531692800 00000100:00100000:1.0:1788530475.825268:0:18163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 9 00000100:00100000:1.0:1788530475.825288:0:18163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66d42348-56b8-4977-9cd3-df6ed37388a6+6:14925:x1875409531692800:12345-192.168.202.41@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788530475.825334:0:18163:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00080000:3.0:1788530475.825472:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788530475.829579:0:18163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66d42348-56b8-4977-9cd3-df6ed37388a6+6:14925:x1875409531692800:12345-192.168.202.41@tcp:41:mount.lustre.0 Request processed in 4256us (4511us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530475.829600:0:18163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 9 00000100:00100000:2.0:1788530475.836480:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530475.836651:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530475.844512:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530475.850751:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531692672 00000100:00100000:3.0:1788530475.850772:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531692672 00000100:00100000:3.0:1788530475.851074:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531692416 00000100:00100000:3.0:1788530475.851078:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531692416 00000100:00100000:3.0:1788530475.851120:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 10 00000100:00100000:3.0:1788530475.851131:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:66d42348-56b8-4977-9cd3-df6ed37388a6+6:0:x1875409531692672:12345-192.168.202.41@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788530475.851173:0:17158:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788530475.851271:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:66d42348-56b8-4977-9cd3-df6ed37388a6+6:0:x1875409531692672:12345-192.168.202.41@tcp:41:mount.lustre.0 Request processed in 141us (14802us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530475.851279:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 10 00000100:00100000:3.0:1788530475.851299:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 11 00000100:00100000:3.0:1788530475.851306:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:66d42348-56b8-4977-9cd3-df6ed37388a6+6:0:x1875409531692416:12345-192.168.202.41@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788530475.851320:0:17158:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788530475.851380:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:66d42348-56b8-4977-9cd3-df6ed37388a6+6:0:x1875409531692416:12345-192.168.202.41@tcp:41:mount.lustre.0 Request processed in 74us (14728us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530475.851387:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 11 00000100:00100000:3.0:1788530475.854320:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531692928 00000100:00100000:3.0:1788530475.854340:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531692928 00000100:00100000:3.0:1788530475.854402:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 12 00000100:00100000:3.0:1788530475.854413:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:66d42348-56b8-4977-9cd3-df6ed37388a6+6:14925:x1875409531692928:12345-192.168.202.41@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788530475.854528:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:66d42348-56b8-4977-9cd3-df6ed37388a6+6:14925:x1875409531692928:12345-192.168.202.41@tcp:40:mount.lustre.0 Request processed in 115us (10029us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530475.854536:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 12 00000100:00080000:1.0:1788530475.860064:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788530475.862973:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530475.863024:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530475.863103:0:18666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531693056 00000100:00100000:1.0:1788530475.863114:0:18666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531693056 00000100:00100000:1.0:1788530475.863157:0:18666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531693184 00000100:00100000:1.0:1788530475.863161:0:18666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531693184 00000100:00100000:1.0:1788530475.863187:0:18666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 23 00000100:00100000:1.0:1788530475.863196:0:18666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2398:x1875409531693056:12345-192.168.202.41@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788530475.863233:0:18666:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-OST0000: connection from 66d42348-56b8-4977-9cd3-df6ed37388a6@192.168.202.41@tcp t0 exp 0000000000000000 cur 683 last 0 00000020:00000080:1.0:1788530475.863278:0:18666:0:(genops.c:1385:class_connect()) connect: client 66d42348-56b8-4977-9cd3-df6ed37388a6, cookie 0xb28d70e125751c19 00002000:00100000:1.0:1788530475.863289:0:18666:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 66d42348-56b8-4977-9cd3-df6ed37388a6/ffff9a9f047f8800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a05 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788530475.863308:0:18666:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788530475.863497:0:18666:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788530475.863533:0:18666:0:(import.c:65:import_set_state_nolock()) ffff9a9f047fd800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788530475.863630:0:18666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66d42348-56b8-4977-9cd3-df6ed37388a6+6:2398:x1875409531693056:12345-192.168.202.41@tcp:8:mount.lustre.0 Request processed in 433us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530475.863638:0:18666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 23 00000100:00100000:1.0:1788530475.863657:0:18666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 24 00000100:00100000:1.0:1788530475.863662:0:18666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2398:x1875409531693184:12345-192.168.202.41@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788530475.863679:0:18666:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-OST0001: connection from 66d42348-56b8-4977-9cd3-df6ed37388a6@192.168.202.41@tcp t0 exp 0000000000000000 cur 683 last 0 00000020:00000080:1.0:1788530475.863695:0:18666:0:(genops.c:1385:class_connect()) connect: client 66d42348-56b8-4977-9cd3-df6ed37388a6, cookie 0xb28d70e125751c20 00002000:00100000:1.0:1788530475.863700:0:18666:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 66d42348-56b8-4977-9cd3-df6ed37388a6/ffff9a9f047ff000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a05 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788530475.863713:0:18666:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788530475.863853:0:18666:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788530475.863869:0:18666:0:(import.c:65:import_set_state_nolock()) ffff9a9f047f8000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788530475.863896:0:18666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66d42348-56b8-4977-9cd3-df6ed37388a6+6:2398:x1875409531693184:12345-192.168.202.41@tcp:8:mount.lustre.0 Request processed in 232us (872us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530475.863903:0:18666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 24 00000100:00100000:1.0:1788530475.868120:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530475.868210:0:17169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531693312 00000100:00100000:3.0:1788530475.868223:0:17169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531693312 00000100:00100000:3.0:1788530475.868298:0:17169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 3 00000100:00100000:3.0:1788530475.868309:0:17169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f05f44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:66d42348-56b8-4977-9cd3-df6ed37388a6+6:14925:x1875409531693312:12345-192.168.202.41@tcp:900:mount.lustre.0 00000100:00100000:3.0:1788530475.868416:0:17169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f05f44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:66d42348-56b8-4977-9cd3-df6ed37388a6+6:14925:x1875409531693312:12345-192.168.202.41@tcp:900:mount.lustre.0 Request processed in 109us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530475.868424:0:17169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 3 00000100:00100000:2.0:1788530475.880319:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530475.880501:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531693440 00000100:00100000:0.0:1788530475.880513:0:17161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531693440 00000100:00100000:0.0:1788530475.880598:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 0 00000100:00100000:0.0:1788530475.880615:0:17161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:66d42348-56b8-4977-9cd3-df6ed37388a6+6:14925:x1875409531693440:12345-192.168.202.41@tcp:33:mount.lustre.0 00000004:00080000:0.0:1788530475.882104:0:17161:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1409us 00000004:00200000:3.0:1788530475.902767:0:17161:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788530475.902933:0:17161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:66d42348-56b8-4977-9cd3-df6ed37388a6+6:14925:x1875409531693440:12345-192.168.202.41@tcp:33:mount.lustre.0 Request processed in 22313us (22620us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530475.902948:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 0 00010000:00010000:0.0:1788530476.098064:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788530476.098136:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788530476.098163:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32a55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555917184:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788530476.098264:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530476.098452:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555917184 00000100:00100000:2.0:1788530476.098464:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555917184 00000100:00100000:2.0:1788530476.098553:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788530476.098594:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f05f46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555917184:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788530476.098628:0:18670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788530476.098697:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f05f46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555917184:12345-0@lo:13:osp-pre-0-1.0 Request processed in 134us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530476.098705:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1788530476.098949:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788530476.099010:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32a55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555917184:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788530476.178650:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530476.178781:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531693568 00000100:00100000:3.0:1788530476.178793:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531693568 00000100:00100000:3.0:1788530476.178885:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 13 00000100:00100000:3.0:1788530476.178897:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f05f44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:66d42348-56b8-4977-9cd3-df6ed37388a6+6:14973:x1875409531693568:12345-192.168.202.41@tcp:101:mkdir.0 00010000:00010000:3.0:1788530476.178923:0:17158:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788530476.178970:0:17158:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36a000/0xb28d70e125751c27 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550c9a expref: -99 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530476.179061:0:17158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36ae00/0xb28d70e125751c2e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530476.179079:0:17158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36ae00/0xb28d70e125751c2e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530476.179110:0:17158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36ae00/0xb28d70e125751c2e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788530476.179159:0:17158:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788530476.179164:0:17158:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788530476.179203:0:17158:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36ae00/0xb28d70e125751c2e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530476.179234:0:17158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36a000/0xb28d70e125751c27 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550c9a expref: 8 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530476.179256:0:17158:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36ae00/0xb28d70e125751c2e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550c9a expref: 7 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530476.179265:0:17158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a9f0b171900) 00010000:00010000:3.0:1788530476.179268:0:17158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788530476.179271:0:17158:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d36ae00, rc 0) 00000100:00100000:3.0:1788530476.179494:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f05f44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:66d42348-56b8-4977-9cd3-df6ed37388a6+7:14973:x1875409531693568:12345-192.168.202.41@tcp:101:mkdir.0 Request processed in 598us (854us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530476.179503:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 13 00000100:00100000:0.0:1788530476.610349:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788530476.610397:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32a55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555917312:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788530476.610488:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530476.611143:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555917312 00000100:00100000:2.0:1788530476.611152:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555917312 00000100:00100000:2.0:1788530476.611213:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788530476.611229:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03764a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555917312:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788530476.611273:0:17163:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788530476.611324:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03764a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555917312:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (835us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530476.611330:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788530476.612365:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32a55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555917312:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788530476.614479:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788530476.614502:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03765f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555917440:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788530476.614610:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530476.615381:0:17899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555917440 00000100:00100000:0.0:1788530476.615391:0:17899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555917440 00000100:00100000:0.0:1788530476.615455:0:17899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788530476.615466:0:17899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f05f45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555917440:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788530476.615506:0:17899:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788530476.615604:0:17899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f05f45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555917440:12345-0@lo:41:osp-pre-1-0.0 Request processed in 140us (994us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530476.615611:0:17899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788530476.615980:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03765f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555917440:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788530477.123091:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788530477.137445:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788530477.137473:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03765f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555917568:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788530477.137548:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530477.139005:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555917568 00000100:00100000:3.0:1788530477.139045:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555917568 00000100:00100000:3.0:1788530477.139993:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788530477.140010:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555917568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788530477.140044:0:18670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788530477.140138:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555917568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 135us (2590us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530477.140146:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1788530477.140357:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788530477.140455:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03765f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555917568:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788530478.146742:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788530478.573345:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530478.573451:0:18163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531693696 00000100:00100000:2.0:1788530478.573463:0:18163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531693696 00000100:00100000:2.0:1788530478.573557:0:18163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 14 00000100:00100000:2.0:1788530478.573596:0:18163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f05f45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66d42348-56b8-4977-9cd3-df6ed37388a6+7:15025:x1875409531693696:12345-192.168.202.41@tcp:41:lfs.0 00000004:00000024:2.0:1788530478.573641:0:18163:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788530478.573753:0:18163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f05f45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66d42348-56b8-4977-9cd3-df6ed37388a6+7:15025:x1875409531693696:12345-192.168.202.41@tcp:41:lfs.0 Request processed in 151us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530478.573761:0:18163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 14 00000100:00080000:1.0:1788530478.574345:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788530478.579759:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530478.579876:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531693824 00000100:00100000:3.0:1788530478.579886:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531693824 00000100:00100000:3.0:1788530478.579969:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 15 00000100:00100000:3.0:1788530478.579988:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:66d42348-56b8-4977-9cd3-df6ed37388a6+6:15025:x1875409531693824:12345-192.168.202.41@tcp:41:lfs.0 00000004:00000024:3.0:1788530478.580032:0:17158:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00080000:1.0:1788530478.580057:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788530478.580148:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:66d42348-56b8-4977-9cd3-df6ed37388a6+6:15025:x1875409531693824:12345-192.168.202.41@tcp:41:lfs.0 Request processed in 170us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530478.580156:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 15 00000040:00080000:0.0:1788530478.594411:0:17192:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788530478.595823:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530478.596004:0:18671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531693952 00000100:00100000:2.0:1788530478.596015:0:18671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531693952 00000100:00100000:2.0:1788530478.596147:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 16 00000100:00100000:2.0:1788530478.596159:0:18671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03765f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:66d42348-56b8-4977-9cd3-df6ed37388a6+6:15025:x1875409531693952:12345-192.168.202.41@tcp:13:lfs.0 00002000:00000024:2.0:1788530478.596186:0:18671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788530478.596288:0:18671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03765f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:66d42348-56b8-4977-9cd3-df6ed37388a6+6:15025:x1875409531693952:12345-192.168.202.41@tcp:13:lfs.0 Request processed in 130us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530478.596313:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 16 00000100:00100000:2.0:1788530478.598871:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530478.599075:0:18671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531694080 00000100:00100000:3.0:1788530478.599088:0:18671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531694080 00000100:00080000:1.0:1788530478.599939:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788530478.599945:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788530478.600364:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 17 00000100:00100000:3.0:1788530478.600378:0:18671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:66d42348-56b8-4977-9cd3-df6ed37388a6+6:15025:x1875409531694080:12345-192.168.202.41@tcp:13:lfs.0 00002000:00000024:3.0:1788530478.600416:0:18671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788530478.600518:0:18671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:66d42348-56b8-4977-9cd3-df6ed37388a6+6:15025:x1875409531694080:12345-192.168.202.41@tcp:13:lfs.0 Request processed in 144us (1659us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530478.600527:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 17 00000040:00080000:3.0:1788530478.723770:0:17913:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788530478.884914:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530478.885030:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531694208 00000100:00100000:1.0:1788530478.885042:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531694208 00000100:00100000:1.0:1788530478.885130:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 153 00000100:00100000:1.0:1788530478.885142:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fc207521-3937-4a55-9052-ed3c297904d3+10:15056:x1875409531694208:12345-192.168.202.41@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788530478.885166:0:17153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530478.885186:0:17153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f42166a00/0xb28d70e125751c35 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1406819a550ca1 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530478.885219:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f42166a00/0xb28d70e125751c35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550ca1 expref: 11 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530478.885231:0:17153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f42166a00/0xb28d70e125751c35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550ca1 expref: 11 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530478.885242:0:17153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f42166a00, rc 0) 00000100:00100000:1.0:1788530478.885697:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fc207521-3937-4a55-9052-ed3c297904d3+11:15056:x1875409531694208:12345-192.168.202.41@tcp:101:mount.lustre.0 Request processed in 555us (795us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530478.885720:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 153 00000100:00100000:0.0:1788530478.897107:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530478.897393:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531694336 00000100:00100000:2.0:1788530478.897406:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531694336 00000100:00100000:2.0:1788530478.897477:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 154 00000100:00100000:2.0:1788530478.897489:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fc207521-3937-4a55-9052-ed3c297904d3+11:15056:x1875409531694336:12345-192.168.202.41@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788530478.897683:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fc207521-3937-4a55-9052-ed3c297904d3+11:15056:x1875409531694336:12345-192.168.202.41@tcp:501:mount.lustre.0 Request processed in 196us (587us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788530478.897692:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 154 00000100:00100000:2.0:1788530478.903964:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530478.904544:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531694464 00000100:00100000:1.0:1788530478.904589:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531694464 00000100:00100000:1.0:1788530478.904675:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 155 00000100:00100000:1.0:1788530478.904688:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fc207521-3937-4a55-9052-ed3c297904d3+11:15056:x1875409531694464:12345-192.168.202.41@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788530478.904713:0:17153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530478.904738:0:17153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f42167c00/0xb28d70e125751c3c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1406819a550ca8 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530478.904775:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f42167c00/0xb28d70e125751c3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550ca8 expref: 12 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530478.905133:0:17153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f42167c00/0xb28d70e125751c3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550ca8 expref: 12 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530478.905147:0:17153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f42167c00, rc 0) 00000100:00100000:1.0:1788530478.907527:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fc207521-3937-4a55-9052-ed3c297904d3+12:15056:x1875409531694464:12345-192.168.202.41@tcp:101:mount.lustre.0 Request processed in 2825us (3571us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530478.907541:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 155 00000100:00100000:1.0:1788530478.916904:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530478.917191:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531694592 00000100:00100000:0.0:1788530478.917209:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531694592 00000100:00100000:0.0:1788530478.917290:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 156 00000100:00100000:0.0:1788530478.917303:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fc207521-3937-4a55-9052-ed3c297904d3+12:15056:x1875409531694592:12345-192.168.202.41@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788530478.917533:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fc207521-3937-4a55-9052-ed3c297904d3+12:15056:x1875409531694592:12345-192.168.202.41@tcp:501:mount.lustre.0 Request processed in 231us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530478.917541:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 156 00000100:00100000:0.0:1788530478.920778:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530478.927600:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531694720 00000100:00100000:1.0:1788530478.927632:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531694720 00000100:00100000:1.0:1788530478.927727:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 157 00000100:00100000:1.0:1788530478.927744:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03d57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fc207521-3937-4a55-9052-ed3c297904d3+12:15056:x1875409531694720:12345-192.168.202.41@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788530478.927956:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03d57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fc207521-3937-4a55-9052-ed3c297904d3+12:15056:x1875409531694720:12345-192.168.202.41@tcp:503:mount.lustre.0 Request processed in 217us (7191us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530478.927986:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 157 00000100:00100000:3.0:1788530478.943228:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530478.944112:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531694848 00000100:00100000:0.0:1788530478.944125:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531694848 00000100:00100000:0.0:1788530478.944204:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 158 00000100:00100000:0.0:1788530478.944214:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f22280450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fc207521-3937-4a55-9052-ed3c297904d3+12:15063:x1875409531694848:12345-192.168.202.41@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788530478.944452:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f22280450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fc207521-3937-4a55-9052-ed3c297904d3+12:15063:x1875409531694848:12345-192.168.202.41@tcp:502:llog_process_th.0 Request processed in 238us (1235us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530478.944461:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 158 00000100:00100000:0.0:1788530478.999968:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530479.000218:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531694976 00000100:00100000:2.0:1788530479.000232:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531694976 00000100:00100000:2.0:1788530479.000314:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 159 00000100:00100000:2.0:1788530479.000333:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f051ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fc207521-3937-4a55-9052-ed3c297904d3+12:15063:x1875409531694976:12345-192.168.202.41@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788530479.000540:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f051ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fc207521-3937-4a55-9052-ed3c297904d3+12:15063:x1875409531694976:12345-192.168.202.41@tcp:502:llog_process_th.0 Request processed in 215us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530479.000548:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 159 00000100:00100000:2.0:1788530479.006557:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530479.020723:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531695104 00000100:00100000:1.0:1788530479.020745:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531695104 00000100:00100000:1.0:1788530479.020838:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 160 00000100:00100000:1.0:1788530479.020849:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f051adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fc207521-3937-4a55-9052-ed3c297904d3+12:15063:x1875409531695104:12345-192.168.202.41@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788530479.021086:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f051adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fc207521-3937-4a55-9052-ed3c297904d3+12:15063:x1875409531695104:12345-192.168.202.41@tcp:502:llog_process_th.0 Request processed in 237us (14539us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530479.021095:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 160 00000100:00100000:3.0:1788530479.029327:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530479.029605:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531695232 00000100:00100000:0.0:1788530479.029620:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531695232 00000100:00100000:0.0:1788530479.029688:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 161 00000100:00100000:0.0:1788530479.029701:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f051af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fc207521-3937-4a55-9052-ed3c297904d3+12:15056:x1875409531695232:12345-192.168.202.41@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788530479.029728:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530479.029756:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9e010a2000/0xb28d70e125751c43 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1406819a550cd9 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530479.029804:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9e010a2000/0xb28d70e125751c43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550cd9 expref: 13 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530479.029822:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9e010a2000/0xb28d70e125751c43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550cd9 expref: 13 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530479.029834:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9e010a2000, rc 0) 00000100:00100000:0.0:1788530479.029907:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f051af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fc207521-3937-4a55-9052-ed3c297904d3+13:15056:x1875409531695232:12345-192.168.202.41@tcp:101:mount.lustre.0 Request processed in 208us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530479.029915:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 161 00000100:00100000:3.0:1788530479.034010:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530479.034286:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531695360 00000100:00100000:2.0:1788530479.034301:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531695360 00000100:00100000:2.0:1788530479.034391:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 162 00000100:00100000:2.0:1788530479.034405:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f051ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fc207521-3937-4a55-9052-ed3c297904d3+13:15056:x1875409531695360:12345-192.168.202.41@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788530479.034446:0:17151:0:(mgs_nids.c:1159:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788530479.034482:0:17151:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788530479.034486:0:17151:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788530479.034496:0:17151:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788530479.034500:0:17151:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1788530479.034502:0:17151:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:3.0:1788530479.038475:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f051ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fc207521-3937-4a55-9052-ed3c297904d3+13:15056:x1875409531695360:12345-192.168.202.41@tcp:256:mount.lustre.0 Request processed in 4060us (4469us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530479.038492:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 162 00000100:00100000:3.0:1788530479.042893:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530479.043041:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531695488 00000100:00100000:1.0:1788530479.043379:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531695488 00000100:00100000:1.0:1788530479.043445:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 163 00000100:00100000:1.0:1788530479.043456:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f051afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fc207521-3937-4a55-9052-ed3c297904d3+13:15056:x1875409531695488:12345-192.168.202.41@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788530479.043476:0:17153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530479.043497:0:17153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f42167e00/0xb28d70e125751c4a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1406819a550ce0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530479.043531:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f42167e00/0xb28d70e125751c4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550ce0 expref: 14 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530479.043552:0:17153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f42167e00/0xb28d70e125751c4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550ce0 expref: 14 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530479.043585:0:17153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f42167e00, rc 0) 00000100:00100000:1.0:1788530479.043666:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f051afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fc207521-3937-4a55-9052-ed3c297904d3+14:15056:x1875409531695488:12345-192.168.202.41@tcp:101:mount.lustre.0 Request processed in 211us (783us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530479.043673:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 163 00000100:00100000:1.0:1788530479.046799:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530479.047018:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531695616 00000100:00100000:3.0:1788530479.047028:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531695616 00000100:00100000:3.0:1788530479.047206:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 164 00000100:00100000:3.0:1788530479.047218:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f051ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fc207521-3937-4a55-9052-ed3c297904d3+14:15056:x1875409531695616:12345-192.168.202.41@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788530479.047433:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f051ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fc207521-3937-4a55-9052-ed3c297904d3+14:15056:x1875409531695616:12345-192.168.202.41@tcp:501:mount.lustre.0 Request processed in 216us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530479.047443:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 164 00000100:00100000:0.0:1788530479.050883:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530479.050986:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531695744 00000100:00100000:3.0:1788530479.050998:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531695744 00000100:00100000:3.0:1788530479.051171:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 165 00000100:00100000:3.0:1788530479.051183:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f051ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fc207521-3937-4a55-9052-ed3c297904d3+14:15056:x1875409531695744:12345-192.168.202.41@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788530479.051423:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f051ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fc207521-3937-4a55-9052-ed3c297904d3+14:15056:x1875409531695744:12345-192.168.202.41@tcp:503:mount.lustre.0 Request processed in 241us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530479.051433:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 165 00000100:00100000:2.0:1788530479.056029:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530479.056217:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531695872 00000100:00100000:3.0:1788530479.056232:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531695872 00000100:00100000:3.0:1788530479.056362:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 166 00000100:00100000:3.0:1788530479.056376:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f051ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fc207521-3937-4a55-9052-ed3c297904d3+14:15069:x1875409531695872:12345-192.168.202.41@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788530479.056634:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f051ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fc207521-3937-4a55-9052-ed3c297904d3+14:15069:x1875409531695872:12345-192.168.202.41@tcp:502:llog_process_th.0 Request processed in 258us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530479.056655:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 166 00000100:00100000:2.0:1788530479.065479:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530479.065629:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531696000 00000100:00100000:3.0:1788530479.065642:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531696000 00000100:00100000:3.0:1788530479.065713:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 167 00000100:00100000:3.0:1788530479.065725:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f051ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fc207521-3937-4a55-9052-ed3c297904d3+14:15069:x1875409531696000:12345-192.168.202.41@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788530479.065921:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f051ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fc207521-3937-4a55-9052-ed3c297904d3+14:15069:x1875409531696000:12345-192.168.202.41@tcp:502:llog_process_th.0 Request processed in 197us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530479.065931:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 167 00000100:00100000:0.0:1788530479.074640:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530479.075073:0:18163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531696128 00000100:00100000:2.0:1788530479.075088:0:18163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531696128 00000100:00100000:2.0:1788530479.075143:0:18163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 16 00000100:00100000:2.0:1788530479.075153:0:18163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2398:x1875409531696128:12345-192.168.202.41@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788530479.075193:0:18163:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-MDT0000: connection from 5fa0991a-e80a-4f33-96cf-7430c54598af@192.168.202.41@tcp t0 exp 0000000000000000 cur 686 last 0 00000020:00000080:2.0:1788530479.075244:0:18163:0:(genops.c:1385:class_connect()) connect: client 5fa0991a-e80a-4f33-96cf-7430c54598af, cookie 0xb28d70e125751c51 00000004:00100000:2.0:1788530479.075279:0:18163:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788530479.075444:0:18163:0:(import.c:65:import_set_state_nolock()) ffff9a9f274ff000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788530479.075554:0:18163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5fa0991a-e80a-4f33-96cf-7430c54598af+6:2398:x1875409531696128:12345-192.168.202.41@tcp:38:mount.lustre.0 Request processed in 399us (994us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530479.075593:0:18163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 16 00000100:00100000:2.0:1788530479.088505:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530479.088655:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531696384 00000100:00100000:0.0:1788530479.088679:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531696384 00000100:00100000:0.0:1788530479.088732:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 17 00000100:00100000:0.0:1788530479.088741:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2398:x1875409531696384:12345-192.168.202.41@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788530479.088776:0:17159:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-MDT0001: connection from 5fa0991a-e80a-4f33-96cf-7430c54598af@192.168.202.41@tcp t0 exp 0000000000000000 cur 686 last 0 00000020:00000080:0.0:1788530479.088833:0:17159:0:(genops.c:1385:class_connect()) connect: client 5fa0991a-e80a-4f33-96cf-7430c54598af, cookie 0xb28d70e125751c58 00000004:00100000:0.0:1788530479.088863:0:17159:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788530479.088961:0:17159:0:(import.c:65:import_set_state_nolock()) ffff9a9f3b054000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788530479.089049:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5fa0991a-e80a-4f33-96cf-7430c54598af+6:2398:x1875409531696384:12345-192.168.202.41@tcp:38:mount.lustre.0 Request processed in 308us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530479.089661:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 17 00000100:00100000:1.0:1788530479.103824:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530479.103870:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530479.103962:0:18163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531696512 00000100:00100000:2.0:1788530479.103973:0:18163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531696512 00000100:00100000:2.0:1788530479.104041:0:18163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531696256 00000100:00100000:2.0:1788530479.104045:0:18163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531696256 00000100:00100000:2.0:1788530479.104093:0:18163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 18 00000100:00100000:2.0:1788530479.104103:0:18163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5fa0991a-e80a-4f33-96cf-7430c54598af+6:0:x1875409531696512:12345-192.168.202.41@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788530479.104144:0:18163:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788530479.104225:0:18163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5fa0991a-e80a-4f33-96cf-7430c54598af+6:0:x1875409531696512:12345-192.168.202.41@tcp:41:mount.lustre.0 Request processed in 123us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530479.104232:0:18163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 18 00000100:00100000:2.0:1788530479.104265:0:18163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 19 00000100:00100000:2.0:1788530479.104272:0:18163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5fa0991a-e80a-4f33-96cf-7430c54598af+6:0:x1875409531696256:12345-192.168.202.41@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788530479.104292:0:18163:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788530479.104333:0:18163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5fa0991a-e80a-4f33-96cf-7430c54598af+6:0:x1875409531696256:12345-192.168.202.41@tcp:41:mount.lustre.0 Request processed in 49us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530479.104341:0:18163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 19 00000100:00080000:1.0:1788530479.105496:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788530479.105504:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788530479.110534:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530479.110698:0:18163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531696640 00000100:00100000:2.0:1788530479.110711:0:18163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531696640 00000100:00100000:2.0:1788530479.110784:0:18163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 20 00000100:00100000:2.0:1788530479.110796:0:18163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5fa0991a-e80a-4f33-96cf-7430c54598af+6:15056:x1875409531696640:12345-192.168.202.41@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788530479.110835:0:18163:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788530479.110916:0:18163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5fa0991a-e80a-4f33-96cf-7430c54598af+6:15056:x1875409531696640:12345-192.168.202.41@tcp:41:mount.lustre.0 Request processed in 122us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530479.110924:0:18163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 20 00000100:00100000:2.0:1788530479.116725:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530479.116879:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531696768 00000100:00100000:3.0:1788530479.116891:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531696768 00000100:00100000:3.0:1788530479.116957:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 21 00000100:00100000:3.0:1788530479.116968:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5fa0991a-e80a-4f33-96cf-7430c54598af+6:15056:x1875409531696768:12345-192.168.202.41@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788530479.117254:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5fa0991a-e80a-4f33-96cf-7430c54598af+6:15056:x1875409531696768:12345-192.168.202.41@tcp:40:mount.lustre.0 Request processed in 287us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530479.117263:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 21 00000100:00100000:1.0:1788530479.135413:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530479.135465:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530479.135509:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530479.135817:0:17169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531697152 00000100:00100000:3.0:1788530479.135829:0:17169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531697152 00000100:00100000:3.0:1788530479.135894:0:17169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 4 00000100:00100000:3.0:1788530479.135905:0:17169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:5fa0991a-e80a-4f33-96cf-7430c54598af+6:15056:x1875409531697152:12345-192.168.202.41@tcp:900:mount.lustre.0 00000100:00100000:3.0:1788530479.135992:0:17169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:5fa0991a-e80a-4f33-96cf-7430c54598af+6:15056:x1875409531697152:12345-192.168.202.41@tcp:900:mount.lustre.0 Request processed in 87us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530479.136000:0:17169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 4 00000100:00100000:0.0:1788530479.136990:0:18667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531696896 00000100:00100000:0.0:1788530479.137000:0:18667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531696896 00000100:00100000:0.0:1788530479.137045:0:18667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531697024 00000100:00100000:0.0:1788530479.137049:0:18667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531697024 00000100:00100000:1.0:1788530479.137163:0:18966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 25 00000100:00100000:1.0:1788530479.137172:0:18966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2398:x1875409531696896:12345-192.168.202.41@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788530479.137205:0:18966:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-OST0000: connection from 5fa0991a-e80a-4f33-96cf-7430c54598af@192.168.202.41@tcp t0 exp 0000000000000000 cur 687 last 0 00000020:00000080:1.0:1788530479.137243:0:18966:0:(genops.c:1385:class_connect()) connect: client 5fa0991a-e80a-4f33-96cf-7430c54598af, cookie 0xb28d70e125751c5f 00002000:00100000:1.0:1788530479.137256:0:18966:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 5fa0991a-e80a-4f33-96cf-7430c54598af/ffff9a9f047fb000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a05 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788530479.137278:0:18966:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788530479.137380:0:18966:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788530479.137413:0:18966:0:(import.c:65:import_set_state_nolock()) ffff9a9f047fe800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788530479.137457:0:18966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5fa0991a-e80a-4f33-96cf-7430c54598af+6:2398:x1875409531696896:12345-192.168.202.41@tcp:8:mount.lustre.0 Request processed in 284us (1990us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530479.137465:0:18966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 25 00000100:00100000:0.0:1788530479.137890:0:18667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 26 00000100:00100000:0.0:1788530479.137898:0:18667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2398:x1875409531697024:12345-192.168.202.41@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788530479.137920:0:18667:0:(ldlm_lib.c:1458:target_handle_connect()) lustre-OST0001: connection from 5fa0991a-e80a-4f33-96cf-7430c54598af@192.168.202.41@tcp t0 exp 0000000000000000 cur 687 last 0 00000020:00000080:0.0:1788530479.137939:0:18667:0:(genops.c:1385:class_connect()) connect: client 5fa0991a-e80a-4f33-96cf-7430c54598af, cookie 0xb28d70e125751c66 00002000:00100000:0.0:1788530479.137945:0:18667:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 5fa0991a-e80a-4f33-96cf-7430c54598af/ffff9a9f3b052000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a05 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788530479.137954:0:18667:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788530479.138011:0:18667:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788530479.138031:0:18667:0:(import.c:65:import_set_state_nolock()) ffff9a9f3b053000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788530479.138155:0:18667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5fa0991a-e80a-4f33-96cf-7430c54598af+6:2398:x1875409531697024:12345-192.168.202.41@tcp:8:mount.lustre.0 Request processed in 255us (2644us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530479.138163:0:18667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 26 00000100:00100000:0.0:1788530479.145046:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530479.145771:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531697280 00000100:00100000:1.0:1788530479.145854:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531697280 00000100:00100000:1.0:1788530479.145972:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 1 00000100:00100000:1.0:1788530479.145984:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5fa0991a-e80a-4f33-96cf-7430c54598af+6:15056:x1875409531697280:12345-192.168.202.41@tcp:33:mount.lustre.0 00000004:00200000:1.0:1788530479.146295:0:17162:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1788530479.146419:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5fa0991a-e80a-4f33-96cf-7430c54598af+6:15056:x1875409531697280:12345-192.168.202.41@tcp:33:mount.lustre.0 Request processed in 437us (1387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530479.146438:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 1 00000100:00100000:0.0:1788530479.173471:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f2b92c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555917952:0@lo:400:kworker.0 00000100:00100000:0.0:1788530479.173557:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530479.173656:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f2b92ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555918464:0@lo:400:kworker.0 00000100:00100000:0.0:1788530479.173684:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530479.173700:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f2b92c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875409555918976:0@lo:400:kworker.0 00000100:00100000:0.0:1788530479.173722:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530479.173752:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788530479.173759:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f2b92df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555918080:0@lo:400:kworker.0 00000100:00100000:0.0:1788530479.173794:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530479.173816:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f2b92e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555918592:0@lo:400:kworker.0 00000100:00100000:0.0:1788530479.173837:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530479.173853:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03736d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875409555919104:0@lo:400:kworker.0 00000100:00100000:0.0:1788530479.173873:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530479.173906:0:18667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555917952 00000100:00100000:0.0:1788530479.173914:0:18667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555917952 00000100:00100000:0.0:1788530479.173964:0:18667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555918464 00000100:00100000:0.0:1788530479.173967:0:18667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555918464 00000100:00100000:0.0:1788530479.173982:0:18667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555918080 00000100:00100000:0.0:1788530479.173985:0:18667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555918080 00000100:00100000:0.0:1788530479.173996:0:18667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555918592 00000100:00100000:0.0:1788530479.173998:0:18667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555918592 00000100:00100000:0.0:1788530479.174012:0:18667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788530479.174021:0:18667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03737800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555917952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530479.174335:0:18667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03737800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555917952:12345-0@lo:400:kworker.0 Request processed in 313us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530479.174343:0:18667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788530479.174364:0:18667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788530479.174387:0:18667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f0700a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555918464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530479.174420:0:18667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f0700a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555918464:12345-0@lo:400:kworker.0 Request processed in 35us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530479.174426:0:18667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788530479.174547:0:18667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788530479.174554:0:18667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f06271f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555918080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530479.174639:0:18667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f06271f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555918080:12345-0@lo:400:kworker.0 Request processed in 85us (844us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530479.174646:0:18667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788530479.174659:0:18667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788530479.174666:0:18667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f06273100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555918592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530479.174691:0:18667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f06273100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555918592:12345-0@lo:400:kworker.0 Request processed in 26us (853us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530479.174696:0:18667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788530479.174741:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:0.0:1788530479.174758:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f2b92df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555918080:0@lo:400:kworker.0 00000100:00100000:0.0:1788530479.174769:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f2b92e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555918592:0@lo:400:kworker.0 00000100:00100000:3.0:1788530479.175181:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:3649:1875409555917696:0@lo:400:kworker.0 00000100:00100000:3.0:1788530479.175232:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530479.175276:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f2b92ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875409555918208:0@lo:400:kworker.0 00000100:00100000:3.0:1788530479.175305:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530479.175339:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f2b92d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875409555918720:0@lo:400:kworker.0 00000100:00100000:3.0:1788530479.175361:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530479.175382:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03735f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875409555919232:0@lo:400:kworker.0 00000100:00100000:3.0:1788530479.175406:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530479.175424:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788530479.175431:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03d3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555917824:0@lo:400:kworker.0 00000100:00100000:3.0:1788530479.175455:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530479.175471:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f2b92f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555918336:0@lo:400:kworker.0 00000100:00100000:3.0:1788530479.175493:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530479.175511:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f2b92fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875409555918848:0@lo:400:kworker.0 00000100:00100000:3.0:1788530479.175532:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530479.175557:0:17899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555917824 00000100:00100000:3.0:1788530479.175582:0:17899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555917824 00000100:00100000:3.0:1788530479.175628:0:17899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555918336 00000100:00100000:3.0:1788530479.175631:0:17899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555918336 00000100:00100000:3.0:1788530479.175646:0:17899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788530479.175653:0:17899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03692680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555917824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530479.175691:0:17899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03692680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555917824:12345-0@lo:400:kworker.0 Request processed in 39us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530479.175698:0:17899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788530479.175712:0:17899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788530479.175718:0:17899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03690700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555918336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530479.175740:0:17899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03690700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555918336:12345-0@lo:400:kworker.0 Request processed in 23us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530479.175757:0:17899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788530479.175964:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f2b92c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555917952:0@lo:400:kworker.0 00000100:00100000:1.0:1788530479.176085:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555919360:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788530479.176127:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03d3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555917824:0@lo:400:kworker.0 00000100:00100000:2.0:1788530479.176313:0:18163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555918976 00000100:00100000:2.0:1788530479.176329:0:18163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555918976 00000100:00100000:2.0:1788530479.176365:0:18163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555919104 00000100:00100000:2.0:1788530479.176368:0:18163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555919104 00000100:00100000:2.0:1788530479.176382:0:18163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555918208 00000100:00100000:2.0:1788530479.176385:0:18163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555918208 00000100:00100000:2.0:1788530479.176395:0:18163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555918720 00000100:00100000:2.0:1788530479.176398:0:18163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555918720 00000100:00100000:2.0:1788530479.176407:0:18163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555919232 00000100:00100000:2.0:1788530479.176422:0:18163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555919232 00000100:00100000:2.0:1788530479.176436:0:18163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555918848 00000100:00100000:2.0:1788530479.176439:0:18163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555918848 00000100:00100000:2.0:1788530479.176455:0:18163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788530479.176462:0:18163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f06272d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875409555918976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530479.186024:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f2b92ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555918464:0@lo:400:kworker.0 00000100:00100000:0.0:1788530479.186100:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32a54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555919488:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788530479.186180:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788530479.186238:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788530479.187925:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788530479.187937:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788530479.187942:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788530479.187945:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788530479.188013:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530479.188173:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555919488 00000100:00100000:0.0:1788530479.188183:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555919488 00000100:00100000:0.0:1788530479.188242:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555919360 00000100:00100000:0.0:1788530479.188246:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555919360 00000100:00100000:0.0:1788530479.188261:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788530479.188272:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f06270e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555919488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788530479.188306:0:18670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788530479.188379:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f06270e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555919488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (2199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530479.188388:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788530479.188413:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788530479.188420:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555919360:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788530479.188430:0:18670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788530479.188469:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555919360:12345-0@lo:13:osp-pre-1-1.0 Request processed in 50us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530479.188476:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788530479.188761:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32a54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555919488:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788530479.188813:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555919360:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788530479.191586:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788530479.191611:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f06271500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875409555919104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530479.191711:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f06271500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875409555919104:12345-0@lo:400:kworker.0 Request processed in 111us (17836us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530479.191719:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788530479.191744:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788530479.191752:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03691880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875409555918208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530479.192860:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03736d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875409555919104:0@lo:400:kworker.0 00000100:00100000:1.0:1788530479.192925:0:17159:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1788530479.192938:0:17159:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:1.0:1788530479.193087:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555917696 00000100:00100000:1.0:1788530479.193096:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555917696 00000100:00100000:1.0:1788530479.193158:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788530479.193168:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f051af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+29:3649:x1875409555917696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530479.193237:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f051af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+29:3649:x1875409555917696:12345-0@lo:400:kworker.0 Request processed in 71us (18004us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530479.193245:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788530479.193290:0:17158:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1788530479.193300:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788530479.193307:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03693b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875409555918720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530479.193355:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03693b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875409555918720:12345-0@lo:400:kworker.0 Request processed in 48us (17993us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530479.193361:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788530479.193393:0:17158:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1788530479.193399:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788530479.193407:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03692a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875409555919232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530479.194139:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03692a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875409555919232:12345-0@lo:400:kworker.0 Request processed in 33us (18030us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530479.194148:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788530479.194170:0:17158:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1788530479.194179:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788530479.194188:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03690a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875409555918848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530479.194235:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03690a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875409555918848:12345-0@lo:400:kworker.0 Request processed in 49us (18702us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530479.194242:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788530479.194481:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03691880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875409555918208:12345-0@lo:400:kworker.0 Request processed in 2728us (19172us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530479.194490:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788530479.195720:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f2b92f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555918336:0@lo:400:kworker.0 00000100:00100000:3.0:1788530479.197685:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f2b92fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875409555918848:0@lo:400:kworker.0 00000100:00100000:3.0:1788530479.197710:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:3649:1875409555917696:0@lo:400:kworker.0 00000100:00100000:3.0:1788530479.197726:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f2b92ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875409555918208:0@lo:400:kworker.0 00000100:00100000:3.0:1788530479.197737:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f2b92d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875409555918720:0@lo:400:kworker.0 00010000:00080000:3.0:1788530479.197758:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e03735f80 x1875409555919232/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530495 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530479.197772:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03735f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875409555919232:0@lo:400:kworker.0 00000100:00100000:2.0:1788530479.198639:0:18163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f06272d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875409555918976:12345-0@lo:400:kworker.0 Request processed in 22172us (24910us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530479.198653:0:18163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:1.0:1788530479.200721:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f2b92c380 x1875409555918976/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530495 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530479.200749:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f2b92c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875409555918976:0@lo:400:kworker.0 00000100:00100000:2.0:1788530479.378263:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530479.378927:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531697408 00000100:00100000:1.0:1788530479.378940:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531697408 00000100:00100000:1.0:1788530479.379013:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 22 00000100:00100000:1.0:1788530479.379025:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5fa0991a-e80a-4f33-96cf-7430c54598af+6:15092:x1875409531697408:12345-192.168.202.41@tcp:101:mkdir.0 00010000:00010000:1.0:1788530479.379047:0:17158:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530479.379081:0:17158:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167800/0xb28d70e125751c6d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550d11 expref: -99 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530479.379147:0:17158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166800/0xb28d70e125751c74 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530479.379161:0:17158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166800/0xb28d70e125751c74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530479.379191:0:17158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166800/0xb28d70e125751c74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788530479.379236:0:17158:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788530479.379240:0:17158:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788530479.379433:0:17158:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166800/0xb28d70e125751c74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530479.379464:0:17158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167800/0xb28d70e125751c6d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550d11 expref: 8 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530479.379497:0:17158:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166800/0xb28d70e125751c74 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550d11 expref: 7 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530479.379505:0:17158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a9f0b171900) 00010000:00010000:1.0:1788530479.379508:0:17158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788530479.379512:0:17158:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f42166800, rc 0) 00000100:00100000:1.0:1788530479.379625:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5fa0991a-e80a-4f33-96cf-7430c54598af+7:15092:x1875409531697408:12345-192.168.202.41@tcp:101:mkdir.0 Request processed in 602us (1373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530479.379632:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 22 00010000:00010000:0.0:1788530480.195525:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788530481.219812:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788530481.219837:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32a56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555919616:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788530481.219915:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788530481.219967:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788530481.219981:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555919616 00000100:00100000:2.0:1788530481.219990:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555919616 00000100:00100000:2.0:1788530481.220063:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788530481.220074:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555919616:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788530481.220109:0:18670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788530481.220157:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555919616:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530481.220164:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788530481.220220:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32a56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555919616:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788530481.220455:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788530481.729554:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32a56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555919744:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788530481.729659:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530481.731824:0:17899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555919744 00000100:00100000:2.0:1788530481.731845:0:17899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555919744 00000100:00100000:2.0:1788530481.731938:0:17899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788530481.731949:0:17899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555919744:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788530481.731996:0:17899:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788530481.732101:0:17899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555919744:12345-0@lo:41:osp-pre-0-1.0 Request processed in 154us (2442us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530481.732109:0:17899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788530481.732899:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32a56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555919744:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788530481.734180:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555919872:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788530481.734248:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530481.734363:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555919872 00000100:00100000:1.0:1788530481.734370:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555919872 00000100:00100000:1.0:1788530481.734419:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788530481.734653:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03691c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555919872:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788530481.734688:0:17164:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788530481.734745:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03691c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555919872:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530481.734752:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788530481.734864:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555919872:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788530482.241596:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f06273b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555920000:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788530482.241705:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530482.241778:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555920000 00000100:00100000:0.0:1788530482.241786:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555920000 00000100:00100000:0.0:1788530482.241845:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788530482.241856:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f06270380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555920000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788530482.241887:0:18670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788530482.241934:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f06270380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555920000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530482.241940:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788530482.241997:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f06273b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555920000:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788530482.242374:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788530482.244757:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788530482.248098:0:17139:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5fa0991a-e80a-4f33-96cf-7430c54598af 00000001:00100000:1.0:1788530482.248116:0:17139:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 66d42348-56b8-4977-9cd3-df6ed37388a6 00000001:00100000:2.0:1788530482.249137:0:18663:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5fa0991a-e80a-4f33-96cf-7430c54598af 00000001:00100000:2.0:1788530482.249169:0:18663:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 66d42348-56b8-4977-9cd3-df6ed37388a6 00000001:00100000:3.0:1788530482.250072:0:19495:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5fa0991a-e80a-4f33-96cf-7430c54598af 00000001:00100000:3.0:1788530482.250081:0:19495:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 66d42348-56b8-4977-9cd3-df6ed37388a6 00000001:00100000:3.0:1788530482.258301:0:17891:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 5fa0991a-e80a-4f33-96cf-7430c54598af 00000001:00100000:3.0:1788530482.258325:0:17891:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 66d42348-56b8-4977-9cd3-df6ed37388a6 00000001:02000400:2.0:1788530482.922260:0:20053:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1788530483.265057:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788530484.203630:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530484.203979:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531697536 00000100:00100000:0.0:1788530484.203992:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531697536 00000100:00100000:0.0:1788530484.204064:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 169 00000100:00100000:0.0:1788530484.204075:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f051af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fc207521-3937-4a55-9052-ed3c297904d3+14:2399:x1875409531697536:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1788530484.204149:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f051af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fc207521-3937-4a55-9052-ed3c297904d3+14:2399:x1875409531697536:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 75us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530484.204156:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 169 00000100:00100000:3.0:1788530484.231929:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530484.231964:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530484.231993:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530484.232105:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530484.232144:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530484.232165:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530484.232180:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530484.232202:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530484.232236:0:18667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531697920 00000100:00100000:3.0:1788530484.232249:0:18667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531697920 00000100:00100000:3.0:1788530484.232382:0:18667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531698432 00000100:00100000:3.0:1788530484.232386:0:18667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531698432 00000100:00100000:3.0:1788530484.232402:0:18667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531698048 00000100:00100000:3.0:1788530484.232405:0:18667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531698048 00000100:00100000:3.0:1788530484.232419:0:18667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531698560 00000100:00100000:3.0:1788530484.232422:0:18667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531698560 00000100:00100000:3.0:1788530484.232441:0:18667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 14 00000100:00100000:3.0:1788530484.232454:0:18667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03693100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:66d42348-56b8-4977-9cd3-df6ed37388a6+5:2400:x1875409531697920:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1788530484.232546:0:18667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03693100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:66d42348-56b8-4977-9cd3-df6ed37388a6+5:2400:x1875409531697920:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 95us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530484.232556:0:18667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 14 00000100:00100000:1.0:1788530484.232904:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531697664 00000100:00100000:1.0:1788530484.232910:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531697664 00000100:00100000:1.0:1788530484.232950:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531698176 00000100:00100000:1.0:1788530484.232953:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531698176 00000100:00100000:1.0:1788530484.232968:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531697792 00000100:00100000:1.0:1788530484.232971:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531697792 00000100:00100000:1.0:1788530484.232985:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531698304 00000100:00100000:1.0:1788530484.232987:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531698304 00000100:00100000:1.0:1788530484.233088:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 55 00000100:00100000:1.0:1788530484.233099:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03691f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66d42348-56b8-4977-9cd3-df6ed37388a6+6:2400:x1875409531697664:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1788530484.233138:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03691f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66d42348-56b8-4977-9cd3-df6ed37388a6+6:2400:x1875409531697664:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 42us (1221us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530484.233146:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 55 00000100:00100000:1.0:1788530484.233165:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 56 00000100:00100000:1.0:1788530484.233171:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03692d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5fa0991a-e80a-4f33-96cf-7430c54598af+6:2400:x1875409531698176:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1788530484.233198:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03692d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5fa0991a-e80a-4f33-96cf-7430c54598af+6:2400:x1875409531698176:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 26us (1204us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530484.233204:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 56 00000100:00100000:1.0:1788530484.233230:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 57 00000100:00100000:1.0:1788530484.233236:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03690e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66d42348-56b8-4977-9cd3-df6ed37388a6+5:2399:x1875409531697792:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1788530484.233264:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03690e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66d42348-56b8-4977-9cd3-df6ed37388a6+5:2399:x1875409531697792:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 28us (1120us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530484.233269:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 57 00000100:00100000:1.0:1788530484.233357:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 58 00000100:00100000:1.0:1788530484.233365:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03690000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5fa0991a-e80a-4f33-96cf-7430c54598af+5:2399:x1875409531698304:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1788530484.233392:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03690000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5fa0991a-e80a-4f33-96cf-7430c54598af+5:2399:x1875409531698304:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 28us (1210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530484.233399:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 58 00000100:00100000:1.0:1788530484.233426:0:18666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 15 00000100:00100000:1.0:1788530484.233433:0:18666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03690380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5fa0991a-e80a-4f33-96cf-7430c54598af+5:2400:x1875409531698432:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1788530484.233459:0:18666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03690380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5fa0991a-e80a-4f33-96cf-7430c54598af+5:2400:x1875409531698432:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 27us (1354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530484.233466:0:18666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 15 00000100:00100000:1.0:1788530484.233483:0:18666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 16 00000100:00100000:1.0:1788530484.233490:0:18666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03693480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66d42348-56b8-4977-9cd3-df6ed37388a6+5:2399:x1875409531698048:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1788530484.233515:0:18666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03693480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66d42348-56b8-4977-9cd3-df6ed37388a6+5:2399:x1875409531698048:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 26us (1349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530484.233521:0:18666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 16 00000100:00100000:1.0:1788530484.233533:0:18666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 17 00000100:00100000:1.0:1788530484.233539:0:18666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03692300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5fa0991a-e80a-4f33-96cf-7430c54598af+5:2399:x1875409531698560:12345-192.168.202.41@tcp:400:kworker.0 00000100:00080000:3.0:1788530484.234144:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788530484.234151:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788530484.234154:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788530484.234157:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788530484.234923:0:18666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03692300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5fa0991a-e80a-4f33-96cf-7430c54598af+5:2399:x1875409531698560:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 21us (1356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530484.234950:0:18666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 17 00000100:00100000:1.0:1788530484.288751:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788530484.288777:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555920128:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788530484.288854:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530484.288947:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555920128 00000100:00100000:1.0:1788530484.288957:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555920128 00000100:00100000:1.0:1788530484.289093:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788530484.289104:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555920128:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788530484.289136:0:18670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788530484.289189:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555920128:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530484.289196:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788530484.289244:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555920128:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788530484.289450:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32a54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555920256:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788530484.289481:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788530484.289515:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788530484.289597:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555920256 00000100:00100000:1.0:1788530484.289602:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555920256 00000100:00100000:1.0:1788530484.289629:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788530484.289637:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555920256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788530484.289648:0:18670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788530484.289681:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555920256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 46us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530484.289688:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788530484.289718:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32a54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555920256:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788530484.289819:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788530484.290318:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555920640:0@lo:400:kworker.0 00000100:00100000:3.0:1788530484.290354:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530484.290375:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875409555921152:0@lo:400:kworker.0 00000100:00100000:3.0:1788530484.290398:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530484.290416:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875409555921664:0@lo:400:kworker.0 00000100:00100000:3.0:1788530484.290437:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530484.290471:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788530484.290477:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555920512:0@lo:400:kworker.0 00000100:00100000:3.0:1788530484.290516:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530484.290542:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555921024:0@lo:400:kworker.0 00000100:00100000:3.0:1788530484.290589:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530484.290608:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875409555921536:0@lo:400:kworker.0 00000100:00100000:3.0:1788530484.290630:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530484.290659:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555920512 00000100:00100000:3.0:1788530484.290664:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555920512 00000100:00100000:3.0:1788530484.290697:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788530484.290705:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555920512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530484.290747:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555920512:12345-0@lo:400:kworker.0 Request processed in 42us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530484.290754:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788530484.290774:0:18669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555920640 00000100:00100000:3.0:1788530484.290777:0:18669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555920640 00000100:00100000:3.0:1788530484.290808:0:18669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555921024 00000100:00100000:3.0:1788530484.290811:0:18669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555921024 00000100:00100000:3.0:1788530484.290827:0:18669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788530484.290833:0:18669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555920640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530484.290863:0:18669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555920640:12345-0@lo:400:kworker.0 Request processed in 30us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530484.290869:0:18669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788530484.290880:0:18669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788530484.290886:0:18669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555921024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530484.290911:0:18669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555921024:12345-0@lo:400:kworker.0 Request processed in 25us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530484.290926:0:18669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788530484.290947:0:19968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555921152 00000100:00100000:3.0:1788530484.290951:0:19968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555921152 00000100:00100000:3.0:1788530484.290974:0:19968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555921664 00000100:00100000:3.0:1788530484.290976:0:19968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555921664 00000100:00100000:3.0:1788530484.290991:0:19968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555921536 00000100:00100000:3.0:1788530484.290994:0:19968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555921536 00000100:00100000:0.0:1788530484.291189:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:3650:1875409555920384:0@lo:400:kworker.0 00000100:00100000:0.0:1788530484.291226:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530484.291248:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555920896:0@lo:400:kworker.0 00000100:00100000:0.0:1788530484.291267:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530484.291294:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875409555921408:0@lo:400:kworker.0 00000100:00100000:0.0:1788530484.291315:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530484.291328:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788530484.291342:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875409555920768:0@lo:400:kworker.0 00000100:00100000:0.0:1788530484.291368:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530484.291379:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875409555921280:0@lo:400:kworker.0 00000100:00100000:0.0:1788530484.291397:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530484.292575:0:17899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555920896 00000100:00100000:2.0:1788530484.292587:0:17899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555920896 00000100:00100000:2.0:1788530484.292634:0:17899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788530484.292642:0:17899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f06273b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555920896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530484.292712:0:17899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f06273b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555920896:12345-0@lo:400:kworker.0 Request processed in 71us (1443us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530484.292720:0:17899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788530484.292742:0:18163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555921408 00000100:00100000:2.0:1788530484.292746:0:18163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555921408 00000100:00100000:2.0:1788530484.292765:0:18163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555920768 00000100:00100000:2.0:1788530484.292768:0:18163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555920768 00000100:00100000:2.0:1788530484.292777:0:18163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555921280 00000100:00100000:2.0:1788530484.292779:0:18163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555921280 00000100:00100000:2.0:1788530484.292792:0:18163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788530484.292798:0:18163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875409555921152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530484.292829:0:18163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875409555921152:12345-0@lo:400:kworker.0 Request processed in 30us (2429us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530484.292836:0:18163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788530484.292848:0:18163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788530484.292853:0:18163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875409555921664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530484.292880:0:18163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875409555921664:12345-0@lo:400:kworker.0 Request processed in 27us (2442us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530484.292898:0:18163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788530484.292909:0:18163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788530484.292915:0:18163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875409555921536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530484.292943:0:18163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875409555921536:12345-0@lo:400:kworker.0 Request processed in 29us (2313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530484.292949:0:18163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788530484.292959:0:18163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788530484.292964:0:18163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f06270000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875409555921408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530484.292990:0:18163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f06270000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875409555921408:12345-0@lo:400:kworker.0 Request processed in 26us (1675us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530484.292996:0:18163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788530484.293126:0:19968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788530484.293137:0:19968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f06272680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875409555920768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530484.293174:0:19968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f06272680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875409555920768:12345-0@lo:400:kworker.0 Request processed in 40us (1805us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530484.293180:0:19968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788530484.293294:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875409555920768:0@lo:400:kworker.0 00000100:00100000:0.0:1788530484.293309:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555920896:0@lo:400:kworker.0 00010000:00080000:0.0:1788530484.293328:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e037e4e00 x1875409555921408/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530500 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788530484.293340:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875409555921408:0@lo:400:kworker.0 00000100:00100000:2.0:1788530484.293500:0:18163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788530484.293510:0:18163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f06273480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875409555921280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530484.293588:0:18163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f06273480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875409555921280:12345-0@lo:400:kworker.0 Request processed in 81us (2190us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530484.293594:0:18163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788530484.293644:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875409555921280:0@lo:400:kworker.0 00000100:00100000:1.0:1788530484.296525:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555920384 00000100:00100000:1.0:1788530484.296542:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555920384 00000100:00100000:1.0:1788530484.296620:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788530484.296646:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f051ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+29:3650:x1875409555920384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530484.296738:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f051ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+29:3650:x1875409555920384:12345-0@lo:400:kworker.0 Request processed in 94us (5510us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530484.296746:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788530484.296815:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:3650:1875409555920384:0@lo:400:kworker.0 00000100:00080000:0.0:1788530484.297323:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788530484.297331:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788530484.297335:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788530484.297521:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555920512:0@lo:400:kworker.0 00000100:00100000:2.0:1788530484.297536:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555921024:0@lo:400:kworker.0 00000100:00100000:2.0:1788530484.297547:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875409555921536:0@lo:400:kworker.0 00000100:00100000:2.0:1788530484.297639:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555920640:0@lo:400:kworker.0 00000100:00100000:2.0:1788530484.297654:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875409555921152:0@lo:400:kworker.0 00010000:00080000:2.0:1788530484.297668:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f3d2a3100 x1875409555921664/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530500 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530484.297689:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875409555921664:0@lo:400:kworker.0 00010000:00010000:0.0:1788530485.313965:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530486.345417:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788530486.347311:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788530486.347342:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f06270a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555921792:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788530486.347420:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530486.347470:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555921792 00000100:00100000:3.0:1788530486.347478:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555921792 00000100:00100000:3.0:1788530486.347526:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788530486.347536:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555921792:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788530486.347579:0:18670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788530486.347621:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555921792:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530486.347627:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1788530486.347646:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788530486.347681:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f06270a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555921792:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788530486.849092:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555921920:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788530486.849197:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530486.849446:0:17899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555921920 00000100:00100000:1.0:1788530486.849455:0:17899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555921920 00000100:00100000:1.0:1788530486.849511:0:17899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788530486.849520:0:17899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555921920:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788530486.849556:0:17899:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788530486.849651:0:17899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555921920:12345-0@lo:41:osp-pre-1-0.0 Request processed in 132us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530486.849658:0:17899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788530486.849710:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555921920:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788530486.849950:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788530486.849961:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32a54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555922048:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788530486.850012:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530486.850178:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555922048 00000100:00100000:1.0:1788530486.850183:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555922048 00000100:00100000:1.0:1788530486.850219:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788530486.850227:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555922048:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788530486.850319:0:17164:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788530486.850370:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555922048:12345-0@lo:41:osp-pre-0-1.0 Request processed in 143us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530486.850377:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788530486.850448:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32a54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555922048:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788530487.361833:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f06273800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555922176:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788530487.361909:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530487.361971:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555922176 00000100:00100000:0.0:1788530487.362013:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555922176 00000100:00100000:0.0:1788530487.362070:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788530487.362080:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f06271880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555922176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788530487.362105:0:18670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788530487.362149:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f06271880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555922176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530487.362156:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:0.0:1788530487.362191:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788530487.362231:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f06273800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555922176:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788530487.366262:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788530487.375085:0:20202:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe9d6d9890 20000000:00000080:3.0:1788530487.375104:0:20202:0:(mgs_handler.c:1172:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a9e010dc400 uarg=0000000000000000 20000000:01000000:3.0:1788530487.375164:0:20202:0:(mgs_llog.c:6198:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788530487.375171:0:20202:0:(mgs_llog.c:4653:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788530487.375177:0:20202:0:(mgs_llog.c:1385:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788530487.379005:0:20203:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:0.0:1788530487.379688:0:20202:0:(mgs_llog.c:1456:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788530487.402237:0:20202:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788530487.402431:0:20202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a9f42167600/0xb28d70e125751c7b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530487.402454:0:20202:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a9f3d101200/0xb28d70e1257518a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e1257518a0 expref: 28 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530487.402476:0:20202:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a9f3d101800/0xb28d70e1257518b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e1257518ae expref: 28 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530487.402482:0:20202:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a9f3d100800/0xb28d70e125751910 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125751909 expref: 28 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530487.402488:0:20202:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a9f012eae00/0xb28d70e125751a9f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125751a98 expref: 28 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530487.402497:0:20202:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a9f3d36b000/0xb28d70e125751c04 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550c69 expref: 13 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530487.402503:0:20202:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a9f42167e00/0xb28d70e125751c4a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550ce0 expref: 13 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530487.402510:0:20202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a9f42167600/0xb28d70e125751c7b lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530487.402556:0:20202:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a9f42167e00/0xb28d70e125751c4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550ce0 expref: 13 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530487.402603:0:20202:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a9f42167e00/0xb28d70e125751c4a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550ce0 expref: 13 pid: 17153 timeout: 795 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530487.402618:0:20202:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20202:1875409555922304:192.168.202.41@tcp:104: 00010000:00010000:1.0:1788530487.402704:0:20202:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a9f3d36b000/0xb28d70e125751c04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550c69 expref: 13 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530487.402710:0:20202:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a9f3d36b000/0xb28d70e125751c04 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550c69 expref: 13 pid: 17154 timeout: 795 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530487.402721:0:20202:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20202:1875409555922432:192.168.202.41@tcp:104: 00010000:00010000:1.0:1788530487.402743:0:20202:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a9f012eae00/0xb28d70e125751a9f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb28d70e125751a98 expref: 28 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530487.402748:0:20202:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a9f012eae00/0xb28d70e125751a9f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb28d70e125751a98 expref: 28 pid: 17154 timeout: 795 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530487.402753:0:20202:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20202:1875409555922560:0@lo:104: 00000100:00100000:1.0:1788530487.402780:0:20202:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788530487.402816:0:20202:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a9f3d100800/0xb28d70e125751910 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb28d70e125751909 expref: 28 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530487.402824:0:20202:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a9f3d100800/0xb28d70e125751910 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb28d70e125751909 expref: 28 pid: 17153 timeout: 795 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530487.402825:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555922560 00000100:00100000:3.0:1788530487.402831:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555922560 00000100:00100000:1.0:1788530487.402832:0:20202:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20202:1875409555922688:0@lo:104: 00000100:00100000:1.0:1788530487.402854:0:20202:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788530487.402877:0:20202:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a9f3d101800/0xb28d70e1257518b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb28d70e1257518ae expref: 28 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530487.402885:0:20202:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a9f3d101800/0xb28d70e1257518b5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb28d70e1257518ae expref: 28 pid: 17153 timeout: 795 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530487.402893:0:20202:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20202:1875409555922816:0@lo:104: 00010000:00010000:1.0:1788530487.402916:0:20202:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a9f3d101200/0xb28d70e1257518a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb28d70e1257518a0 expref: 28 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530487.402923:0:20202:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a9f3d101200/0xb28d70e1257518a7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb28d70e1257518a0 expref: 28 pid: 17153 timeout: 795 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530487.402939:0:20202:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20202:1875409555922944:0@lo:104: 00000100:00100000:3.0:1788530487.402950:0:17142:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788530487.402958:0:20202:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e03798600 going to sleep for 11 seconds 00000100:00100000:3.0:1788530487.402967:0:17142:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530487.402996:0:17142:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530487.403005:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555922688 00000100:00100000:3.0:1788530487.403008:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555922688 00000100:00100000:3.0:1788530487.403024:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555922816 00000100:00100000:3.0:1788530487.403026:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555922816 00000100:00100000:3.0:1788530487.403035:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555922944 00000100:00100000:3.0:1788530487.403037:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555922944 00000100:00100000:3.0:1788530487.403048:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788530487.403057:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+6:20202:x1875409555922560:12345-0@lo:104: 00010000:00010000:3.0:1788530487.403070:0:17142:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36aa00/0xb28d70e125751a98 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e125751a9f expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530487.403128:0:17142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788530487.403135:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+6:20202:x1875409555922560:12345-0@lo:104: Request processed in 79us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530487.403142:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788530487.403160:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788530487.403167:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03dfb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+5:20202:x1875409555922688:12345-0@lo:104: 00010000:00010000:3.0:1788530487.403181:0:17142:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff9a9f012ebc00/0xb28d70e125751909 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e125751910 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530487.403521:0:17142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788530487.403529:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03dfb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+5:20202:x1875409555922688:12345-0@lo:104: Request processed in 363us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530487.403536:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788530487.403596:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788530487.403604:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+4:20202:x1875409555922816:12345-0@lo:104: 00010000:00010000:3.0:1788530487.403613:0:17142:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff9a9f3d20d000/0xb28d70e1257518ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e1257518b5 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530487.403649:0:17142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788530487.403654:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+4:20202:x1875409555922816:12345-0@lo:104: Request processed in 52us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530487.403660:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788530487.403673:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788530487.403679:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+3:20202:x1875409555922944:12345-0@lo:104: 00010000:00010000:3.0:1788530487.403686:0:17142:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.141@tcp lock: ffff9a9f012ea000/0xb28d70e1257518a0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e1257518a7 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530487.403712:0:17142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1788530487.403717:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+3:20202:x1875409555922944:12345-0@lo:104: Request processed in 39us (720us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530487.403722:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:0.0:1788530487.404593:0:17147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788530487.404602:0:17147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36aa00/0xb28d70e125751a98 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e125751a9f expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530487.404610:0:17147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d36aa00 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:0.0:1788530487.404614:0:17147:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36aa00/0xb28d70e125751a98 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xb28d70e125751a9f expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530487.404624:0:17147:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36aa00/0xb28d70e125751a98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xb28d70e125751a9f expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788530487.404631:0:17147:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36aa00/0xb28d70e125751a98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xb28d70e125751a9f expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788530487.404637:0:17147:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788530487.404676:0:17147:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36aa00/0xb28d70e125751a98 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125751a9f expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530487.404682:0:17147:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788530487.404709:0:17147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36aa00/0xb28d70e125751a98 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125751a9f expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530487.404715:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f3d36aa00/0xb28d70e125751a98 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125751a9f expref: -99 pid: 19494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530487.404729:0:17147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788530487.404743:0:17147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f012ebc00/0xb28d70e125751909 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e125751910 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530487.404748:0:17147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f012ebc00 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:0.0:1788530487.404751:0:17147:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f012ebc00/0xb28d70e125751909 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb28d70e125751910 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530487.404758:0:17147:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f012ebc00/0xb28d70e125751909 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb28d70e125751910 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788530487.404764:0:17147:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f012ebc00/0xb28d70e125751909 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb28d70e125751910 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788530487.404768:0:17147:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788530487.404781:0:17147:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9f012ebc00/0xb28d70e125751909 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125751910 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530487.404787:0:17147:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788530487.404792:0:17147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f012ebc00/0xb28d70e125751909 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125751910 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530487.404798:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f012ebc00/0xb28d70e125751909 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e125751910 expref: -99 pid: 18662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530487.404807:0:17147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788530487.404810:0:17147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f3d20d000/0xb28d70e1257518ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e1257518b5 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530487.404815:0:17147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f3d20d000 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:0.0:1788530487.404817:0:17147:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f3d20d000/0xb28d70e1257518ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb28d70e1257518b5 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530487.404834:0:17147:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f3d20d000/0xb28d70e1257518ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb28d70e1257518b5 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788530487.404840:0:17147:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f3d20d000/0xb28d70e1257518ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb28d70e1257518b5 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788530487.404845:0:17147:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788530487.404859:0:17147:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9f3d20d000/0xb28d70e1257518ae lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e1257518b5 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530487.404865:0:17147:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788530487.404917:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f06270700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:3647:1875409555923328:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788530487.404973:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788530487.405036:0:17147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f3d20d000/0xb28d70e1257518ae lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e1257518b5 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530487.405044:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f3d20d000/0xb28d70e1257518ae lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e1257518b5 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530487.405055:0:17147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788530487.405057:0:17147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.141@tcp lock: ffff9a9f012ea000/0xb28d70e1257518a0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb28d70e1257518a7 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530487.405063:0:17147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f012ea000 already unused, calling callback (ffffffffc1349e00) 10000000:00010000:0.0:1788530487.405066:0:17147:0:(mgc_request.c:1202:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.141@tcp lock: ffff9a9f012ea000/0xb28d70e1257518a0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb28d70e1257518a7 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530487.405072:0:17147:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.141@tcp lock: ffff9a9f012ea000/0xb28d70e1257518a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb28d70e1257518a7 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788530487.405078:0:17147:0:(mgc_request.c:1208:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.141@tcp lock: ffff9a9f012ea000/0xb28d70e1257518a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb28d70e1257518a7 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788530487.405101:0:17147:0:(mgc_request.c:1212:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788530487.405118:0:17147:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.141@tcp lock: ffff9a9f012ea000/0xb28d70e1257518a0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e1257518a7 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530487.405124:0:17147:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788530487.405140:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555923328 00000100:00100000:3.0:1788530487.405146:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555923328 00010000:00010000:3.0:1788530487.405181:0:17146:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a9f3d101800/0xb28d70e1257518b5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e1257518ae expref: 29 pid: 17153 timeout: 795 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530487.405210:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788530487.405218:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a55f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+29:3647:x1875409555923328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788530487.405236:0:17146:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788530487.405242:0:17146:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a9f3d101800/0xb28d70e1257518b5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e1257518ae expref: 29 pid: 17153 timeout: 795 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530487.405261:0:17146:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a9f3d101800/0xb28d70e1257518b5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb28d70e1257518ae expref: 29 pid: 17153 timeout: 795 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530487.405278:0:17146:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788530487.405302:0:20202:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20202:1875409555922560:0@lo:104: 00000100:00100000:1.0:1788530487.405334:0:20202:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20202:1875409555922688:0@lo:104: 00010000:00010000:1.0:1788530487.405346:0:20202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f3d101800/0xb28d70e1257518b5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb28d70e1257518ae expref: 29 pid: 17153 timeout: 795 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530487.405356:0:20202:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20202:1875409555922816:0@lo:104: 00000100:00100000:1.0:1788530487.405365:0:20202:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20202:1875409555922944:0@lo:104: 00010000:00010000:1.0:1788530487.407029:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788530487.407039:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788530487.408655:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f06272a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:3650:1875409555923200:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788530487.408743:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530487.408804:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788530487.408811:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f06273800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:3650:1875409555923072:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788530487.408834:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530487.409719:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f06271c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:3648:1875409555923456:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788530487.409765:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788530487.410050:0:17147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.141@tcp lock: ffff9a9f012ea000/0xb28d70e1257518a0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e1257518a7 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530487.410063:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.141@tcp lock: ffff9a9f012ea000/0xb28d70e1257518a0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb28d70e1257518a7 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530487.410097:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530487.410100:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788530487.410103:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788530487.410800:0:17145:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1788530487.410813:0:17145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1788530487.411230:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555923200 00000100:00100000:1.0:1788530487.411240:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555923200 00000100:00100000:0.0:1788530487.411428:0:20204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555923072 00000100:00100000:0.0:1788530487.411433:0:20204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555923072 00010000:00010000:0.0:1788530487.411466:0:20204:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a9f012eae00/0xb28d70e125751a9f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e125751a98 expref: 29 pid: 17154 timeout: 795 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530487.411486:0:20204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555923456 00000100:00100000:0.0:1788530487.411489:0:20204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555923456 00010000:00010000:0.0:1788530487.411500:0:20204:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a9f3d101200/0xb28d70e1257518a7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e1257518a0 expref: 30 pid: 17153 timeout: 795 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530487.411514:0:20204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788530487.411522:0:20204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+30:3650:x1875409555923072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788530487.411536:0:20204:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788530487.411550:0:20204:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a9f012eae00/0xb28d70e125751a9f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e125751a98 expref: 30 pid: 17154 timeout: 795 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530487.411581:0:20204:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a9f012eae00/0xb28d70e125751a9f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb28d70e125751a98 expref: 30 pid: 17154 timeout: 795 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530487.411781:0:17145:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a9f3d100800/0xb28d70e125751910 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e125751909 expref: 31 pid: 17153 timeout: 795 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530487.411796:0:17145:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:1.0:1788530487.411801:0:17145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00010000:00010000:0.0:1788530487.411925:0:20204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f012eae00/0xb28d70e125751a9f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb28d70e125751a98 expref: 31 pid: 17154 timeout: 795 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530487.412018:0:20204:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788530487.412221:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f06273800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:3650:1875409555923072:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788530487.412426:0:20204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+30:3650:x1875409555923072:12345-0@lo:103:ldlm_bl.0 Request processed in 903us (3589us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530487.412434:0:20204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788530487.412454:0:20204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788530487.412461:0:20204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+29:3648:x1875409555923456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788530487.412471:0:20204:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788530487.412477:0:20204:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a9f3d101200/0xb28d70e1257518a7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e1257518a0 expref: 29 pid: 17153 timeout: 795 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530487.412486:0:20204:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a9f3d101200/0xb28d70e1257518a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb28d70e1257518a0 expref: 29 pid: 17153 timeout: 795 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530487.412496:0:20204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f3d101200/0xb28d70e1257518a7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb28d70e1257518a0 expref: 29 pid: 17153 timeout: 795 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530487.412506:0:20204:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788530487.412546:0:20204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+28:3648:x1875409555923456:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (2780us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530487.412552:0:20204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788530487.412587:0:20204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788530487.412620:0:20204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f178eb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+27:3650:x1875409555923200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788530487.412629:0:20204:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788530487.412634:0:20204:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a9f3d100800/0xb28d70e125751910 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb28d70e125751909 expref: 27 pid: 17153 timeout: 795 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530487.412642:0:20204:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a9f3d100800/0xb28d70e125751910 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb28d70e125751909 expref: 27 pid: 17153 timeout: 795 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530487.412653:0:20204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f3d100800/0xb28d70e125751910 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb28d70e125751909 expref: 27 pid: 17153 timeout: 795 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530487.412662:0:20204:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788530487.412690:0:20204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f178eb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+26:3650:x1875409555923200:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (3947us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530487.412695:0:20204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788530487.412896:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f06271c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:3648:1875409555923456:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788530487.412922:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f06272a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:3650:1875409555923200:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788530487.414335:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a55f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+25:3647:x1875409555923328:12345-0@lo:103:ldlm_bl.0 Request processed in 9109us (9352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530487.414346:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788530487.414393:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f06270700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:3647:1875409555923328:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788530487.414460:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530487.414556:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530487.414599:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531698688 00000100:00100000:0.0:1788530487.414604:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531698688 00010000:00010000:0.0:1788530487.414630:0:17146:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a9f42167e00/0xb28d70e125751c4a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550ce0 expref: 14 pid: 17153 timeout: 795 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530487.414654:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531698816 00000100:00100000:0.0:1788530487.414658:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531698816 00010000:00010000:0.0:1788530487.414670:0:17146:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a9f3d36b000/0xb28d70e125751c04 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550c69 expref: 15 pid: 17154 timeout: 795 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530487.414684:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 16 00000100:00100000:0.0:1788530487.414691:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f06272300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc207521-3937-4a55-9052-ed3c297904d3+15:2400:x1875409531698688:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788530487.414728:0:17146:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788530487.414734:0:17146:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a9f42167e00/0xb28d70e125751c4a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550ce0 expref: 15 pid: 17153 timeout: 795 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530487.414744:0:17146:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a9f42167e00/0xb28d70e125751c4a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550ce0 expref: 15 pid: 17153 timeout: 795 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530487.414762:0:17146:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788530487.414804:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f06272300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc207521-3937-4a55-9052-ed3c297904d3+15:2400:x1875409531698688:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 113us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530487.414811:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 16 00000100:00100000:0.0:1788530487.414825:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 17 00000100:00100000:0.0:1788530487.414831:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f06271180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc207521-3937-4a55-9052-ed3c297904d3+14:2400:x1875409531698816:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788530487.414837:0:17146:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788530487.414841:0:17146:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a9f3d36b000/0xb28d70e125751c04 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550c69 expref: 14 pid: 17154 timeout: 795 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530487.414850:0:17146:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a9f3d36b000/0xb28d70e125751c04 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550c69 expref: 14 pid: 17154 timeout: 795 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530487.414862:0:17146:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a9f42167600/0xb28d70e125751c7b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 20202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530487.414871:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f42167600/0xb28d70e125751c7b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 20202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530487.414884:0:17146:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a9f42167600/0xb28d70e125751c7b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530487.414901:0:17146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a9f42167600/0xb28d70e125751c7b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530487.414907:0:17146:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a9f42167600/0xb28d70e125751c7b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530487.414914:0:17146:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a9f42167600/0xb28d70e125751c7b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530487.414920:0:17146:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f42167600 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:0.0:1788530487.414925:0:17146:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a9f42167600/0xb28d70e125751c7b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530487.414933:0:17146:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a9f42167600/0xb28d70e125751c7b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530487.414953:0:17146:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a9f42167600/0xb28d70e125751c7b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530487.414967:0:17146:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788530487.414997:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f06271180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc207521-3937-4a55-9052-ed3c297904d3+14:2400:x1875409531698816:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 165us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530487.415003:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 17 00010000:00010000:1.0:1788530487.417557:0:20202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f42167e00/0xb28d70e125751c4a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550ce0 expref: 13 pid: 17153 timeout: 795 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530487.417626:0:20202:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20202:1875409555922304:192.168.202.41@tcp:104: 00010000:00010000:1.0:1788530487.417642:0:20202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f3d36b000/0xb28d70e125751c04 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550c69 expref: 12 pid: 17154 timeout: 795 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530487.417652:0:20202:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20202:1875409555922432:192.168.202.41@tcp:104: 00010000:00010000:1.0:1788530487.417689:0:20202:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a9f42167600/0xb28d70e125751c7b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530487.417700:0:20202:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a9f42167600/0xb28d70e125751c7b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530487.417707:0:20202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a9f42167600/0xb28d70e125751c7b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530487.417713:0:20202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a9f42167600/0xb28d70e125751c7b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530488.393229:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788530488.514191:0:17156:0:(mgc_request.c:715:do_requeue()) updating log params 10000000:01000000:1.0:1788530488.514202:0:17156:0:(mgc_request.c:2194:mgc_process_log()) Process log params-ffff9a9e025ec800 from 13 10000000:01000000:1.0:1788530488.514210:0:17156:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788530488.514270:0:17156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f42167600/0xb28d70e125751c82 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530488.514283:0:17156:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f42167600/0xb28d70e125751c82 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530488.514313:0:17156:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f42167600/0xb28d70e125751c82 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530488.514342:0:17156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17156:1875409555923584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788530488.514424:0:17156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530488.514477:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e03798b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788530488.514590:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555923584 00000100:00100000:3.0:1788530488.514599:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555923584 00000100:00100000:3.0:1788530488.514660:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788530488.514671:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f051aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+25:17156:x1875409555923584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788530488.514683:0:17151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788530488.514698:0:17151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f3d36b000/0xb28d70e125751c89 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e125751c82 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530488.514723:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f3d36b000/0xb28d70e125751c89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e125751c82 expref: 26 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530488.514734:0:17151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f3d36b000/0xb28d70e125751c89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125751c82 expref: 26 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530488.514755:0:17151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d36b000, rc 0) 00000100:00100000:3.0:1788530488.515007:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f051aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+26:17156:x1875409555923584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 337us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530488.515015:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788530488.516377:0:17156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17156:1875409555923584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788530488.516418:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f42167600/0xb28d70e125751c82 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751c89 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530488.516432:0:17156:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f42167600/0xb28d70e125751c82 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e125751c89 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788530488.519642:0:17156:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 13 count 13 00000040:00080000:3.0:1788530488.521403:0:17156:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788530488.526086:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].1, 224 off8416 00000040:00080000:3.0:1788530488.526146:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].2, 112 off8528 00000040:00080000:3.0:1788530488.526162:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].3, 224 off8752 00000040:00080000:3.0:1788530488.526177:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].4, 224 off8976 00000040:00080000:3.0:1788530488.526192:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].5, 112 off9088 00000040:00080000:3.0:1788530488.526206:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].6, 224 off9312 00000040:00080000:3.0:1788530488.526219:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].7, 224 off9536 00000040:00080000:3.0:1788530488.526233:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].8, 128 off9664 00000040:00080000:3.0:1788530488.526388:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].9, 224 off9888 00000040:00080000:3.0:1788530488.526407:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].10, 224 off10112 00000040:00080000:3.0:1788530488.526420:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].11, 128 off10240 00000040:00080000:3.0:1788530488.526446:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].12, 224 off10464 00000040:00080000:3.0:1788530488.526452:0:17156:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 12 count 13 00000100:00100000:3.0:1788530488.526589:0:17156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2a2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17156:1875409555923712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788530488.526660:0:17156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530488.526708:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f08cd5cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788530488.526852:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555923712 00000100:00100000:1.0:1788530488.526860:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555923712 00000100:00100000:1.0:1788530488.526929:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788530488.526939:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f051ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+26:17156:x1875409555923712:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788530488.527076:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f051ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+26:17156:x1875409555923712:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 139us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530488.527084:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788530488.527684:0:17156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2a2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17156:1875409555923712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788530488.527726:0:17156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2a2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17156:1875409555923840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788530488.528152:0:17156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530488.528191:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f08cd5cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788530488.528404:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555923840 00000100:00100000:1.0:1788530488.528410:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555923840 00000100:00100000:1.0:1788530488.528453:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788530488.528462:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f051ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+26:17156:x1875409555923840:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788530488.528600:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f051ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+26:17156:x1875409555923840:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 139us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530488.528608:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788530488.530948:0:17156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2a2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17156:1875409555923840:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788530488.531411:0:17156:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788530488.531493:0:17156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2a2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17156:1875409555923968:0@lo:502:ll_cfg_requeue.0 00000100:00100000:3.0:1788530488.531628:0:17156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530488.531667:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f08cd5cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788530488.531919:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555923968 00000100:00100000:2.0:1788530488.531927:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555923968 00000100:00100000:2.0:1788530488.531986:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788530488.531997:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f051acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+26:17156:x1875409555923968:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:2.0:1788530488.532100:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f051acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+26:17156:x1875409555923968:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 106us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530488.532108:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1788530488.532824:0:17156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2a2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17156:1875409555923968:0@lo:502:ll_cfg_requeue.0 00000040:00080000:3.0:1788530488.533166:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].1, 224 off8416 00000040:00080000:3.0:1788530488.533214:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].2, 112 off8528 00000040:00080000:3.0:1788530488.533230:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].3, 224 off8752 00000040:00080000:3.0:1788530488.533242:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].4, 224 off8976 00000040:00080000:3.0:1788530488.533255:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].5, 112 off9088 00000040:00080000:3.0:1788530488.533266:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].6, 224 off9312 00000040:00080000:3.0:1788530488.533277:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].7, 224 off9536 00000040:00080000:3.0:1788530488.533288:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].8, 128 off9664 00000040:00080000:3.0:1788530488.533300:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].9, 224 off9888 00000040:00080000:3.0:1788530488.533311:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].10, 224 off10112 00000040:00080000:3.0:1788530488.533321:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].11, 128 off10240 00000100:00100000:3.0:1788530488.533354:0:17156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2a2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17156:1875409555924096:0@lo:502:ll_cfg_requeue.0 00000100:00100000:3.0:1788530488.533410:0:17156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530488.535371:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f08cd5cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788530488.548555:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555924096 00000100:00100000:2.0:1788530488.548607:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555924096 00000100:00100000:2.0:1788530488.548677:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788530488.548689:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03752c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+26:17156:x1875409555924096:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:2.0:1788530488.548871:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03752c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+26:17156:x1875409555924096:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 184us (15460us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530488.548879:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788530488.551080:0:17156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2a2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17156:1875409555924096:0@lo:502:ll_cfg_requeue.0 00000040:00080000:3.0:1788530488.551187:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].12, 224 off10464 00000040:00080000:3.0:1788530488.551203:0:17156:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000040:00080000:3.0:1788530488.553296:0:20236:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x16:0x0] index 64768 count 13 00000020:01000000:2.0:1788530488.553478:0:17156:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788530488.553492:0:17156:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788530488.553503:0:17156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f42167600/0xb28d70e125751c82 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751c89 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530488.553515:0:17156:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f42167600/0xb28d70e125751c82 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751c89 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788530488.553544:0:17156:0:(mgc_request.c:715:do_requeue()) updating log params 10000000:01000000:2.0:1788530488.553548:0:17156:0:(mgc_request.c:2194:mgc_process_log()) Process log params-ffff9a9f0519b800 from 13 10000000:01000000:2.0:1788530488.553551:0:17156:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788530488.553617:0:17156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f18140000/0xb28d70e125751c90 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530488.553626:0:17156:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f18140000/0xb28d70e125751c90 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530488.553637:0:17156:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f18140000/0xb28d70e125751c90 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530488.553672:0:17156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32a57100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17156:1875409555924224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788530488.553736:0:17156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530488.553789:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f046a9d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788530488.555408:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555924224 00000100:00100000:1.0:1788530488.555420:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555924224 00000100:00100000:1.0:1788530488.555475:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788530488.555483:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03750850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+26:17156:x1875409555924224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788530488.555498:0:17151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530488.555525:0:17151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f42167e00/0xb28d70e125751c97 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e125751c90 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530488.555571:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f42167e00/0xb28d70e125751c97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e125751c90 expref: 27 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530488.555580:0:17151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f42167e00/0xb28d70e125751c97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125751c90 expref: 27 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530488.555587:0:17151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f42167e00, rc 0) 00000100:00100000:1.0:1788530488.555639:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03750850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+27:17156:x1875409555924224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 158us (1905us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530488.555644:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788530488.555995:0:17156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32a57100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17156:1875409555924224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788530488.556019:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f18140000/0xb28d70e125751c90 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751c97 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530488.556029:0:17156:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f18140000/0xb28d70e125751c90 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e125751c97 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788530488.556197:0:17156:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x16:0x0] index 13 count 13 00000040:00080000:2.0:1788530488.557555:0:17156:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788530488.558312:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].1, 224 off8416 00000040:00080000:2.0:1788530488.558354:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].2, 112 off8528 00000040:00080000:2.0:1788530488.558368:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].3, 224 off8752 00000040:00080000:2.0:1788530488.558376:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].4, 224 off8976 00000040:00080000:2.0:1788530488.558383:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].5, 112 off9088 00000040:00080000:2.0:1788530488.558390:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].6, 224 off9312 00000040:00080000:2.0:1788530488.558397:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].7, 224 off9536 00000040:00080000:2.0:1788530488.558404:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].8, 128 off9664 00000040:00080000:2.0:1788530488.558412:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].9, 224 off9888 00000040:00080000:2.0:1788530488.558419:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].10, 224 off10112 00000040:00080000:2.0:1788530488.558427:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].11, 128 off10240 00000040:00080000:2.0:1788530488.558455:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].12, 224 off10464 00000040:00080000:2.0:1788530488.558459:0:17156:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x16:0x0] index 12 count 13 00000100:00100000:2.0:1788530488.558539:0:17156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32a57100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17156:1875409555924352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788530488.558700:0:17156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530488.558873:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f046a9d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788530488.560351:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555924352 00000100:00100000:1.0:1788530488.560363:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555924352 00000100:00100000:1.0:1788530488.560412:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788530488.560420:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03752850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+27:17156:x1875409555924352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788530488.560551:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03752850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+27:17156:x1875409555924352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 132us (1851us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530488.560557:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788530488.560676:0:17156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32a57100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17156:1875409555924352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788530488.560718:0:17156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32a57100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17156:1875409555924480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788530488.560866:0:17156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530488.560894:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f046a9d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788530488.560934:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555924480 00000100:00100000:1.0:1788530488.560937:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555924480 00000100:00100000:1.0:1788530488.560964:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788530488.560980:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03751c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+27:17156:x1875409555924480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788530488.561407:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03751c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+27:17156:x1875409555924480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 427us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530488.561413:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788530488.561503:0:17156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32a57100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17156:1875409555924480:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788530488.562918:0:17156:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788530488.563016:0:17156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17156:1875409555924608:0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788530488.564903:0:17156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530488.564950:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f329c3240 going to sleep for 11 seconds 00000100:00100000:3.0:1788530488.564983:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555924608 00000100:00100000:3.0:1788530488.564992:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555924608 00000100:00100000:3.0:1788530488.565051:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788530488.565062:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03753050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+27:17156:x1875409555924608:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:3.0:1788530488.565216:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03753050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+27:17156:x1875409555924608:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 156us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530488.565224:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788530488.565312:0:17156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17156:1875409555924608:0@lo:502:ll_cfg_requeue.0 00000040:00080000:0.0:1788530488.565531:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].1, 224 off8416 00000040:00080000:0.0:1788530488.565597:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].2, 112 off8528 00000040:00080000:0.0:1788530488.565616:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].3, 224 off8752 00000040:00080000:0.0:1788530488.565639:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].4, 224 off8976 00000040:00080000:0.0:1788530488.565652:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].5, 112 off9088 00000040:00080000:0.0:1788530488.565676:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].6, 224 off9312 00000040:00080000:0.0:1788530488.565693:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].7, 224 off9536 00000040:00080000:0.0:1788530488.565711:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].8, 128 off9664 00000040:00080000:0.0:1788530488.565731:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].9, 224 off9888 00000040:00080000:0.0:1788530488.565746:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].10, 224 off10112 00000040:00080000:0.0:1788530488.565760:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].11, 128 off10240 00000100:00100000:0.0:1788530488.565793:0:17156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f06270700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17156:1875409555924736:0@lo:502:ll_cfg_requeue.0 00000100:00100000:0.0:1788530488.565843:0:17156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530488.565872:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f3b007900 going to sleep for 11 seconds 00000100:00100000:3.0:1788530488.566938:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555924736 00000100:00100000:3.0:1788530488.566949:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555924736 00000100:00100000:3.0:1788530488.567006:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788530488.567015:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03752050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+27:17156:x1875409555924736:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:3.0:1788530488.567140:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03752050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+27:17156:x1875409555924736:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 126us (1296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530488.567149:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788530488.567365:0:17156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f06270700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17156:1875409555924736:0@lo:502:ll_cfg_requeue.0 00000040:00080000:0.0:1788530488.567432:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].12, 224 off10464 00000040:00080000:0.0:1788530488.567443:0:17156:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000040:00080000:0.0:1788530488.568531:0:20238:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1a:0x0] index 64768 count 13 00000020:01000000:1.0:1788530488.568712:0:17156:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788530488.568725:0:17156:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788530488.568735:0:17156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f18140000/0xb28d70e125751c90 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751c97 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530488.568747:0:17156:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f18140000/0xb28d70e125751c90 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751c97 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788530488.568766:0:17156:0:(mgc_request.c:715:do_requeue()) updating log params 10000000:01000000:1.0:1788530488.568769:0:17156:0:(mgc_request.c:2194:mgc_process_log()) Process log params-ffff9a9e03637800 from 13 10000000:01000000:1.0:1788530488.568772:0:17156:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788530488.568811:0:17156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f42167a00/0xb28d70e125751c9e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530488.568819:0:17156:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f42167a00/0xb28d70e125751c9e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530488.568829:0:17156:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f42167a00/0xb28d70e125751c9e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530488.568853:0:17156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17156:1875409555924864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788530488.568931:0:17156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530488.568984:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f1f42d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788530488.569137:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555924864 00000100:00100000:3.0:1788530488.569144:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555924864 00000100:00100000:3.0:1788530488.569196:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1788530488.569204:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03750450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+27:17156:x1875409555924864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788530488.569214:0:17153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788530488.569226:0:17153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f3d36a000/0xb28d70e125751ca5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e125751c9e expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530488.569246:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f3d36a000/0xb28d70e125751ca5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e125751c9e expref: 28 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530488.569253:0:17153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f3d36a000/0xb28d70e125751ca5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125751c9e expref: 28 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530488.569259:0:17153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d36a000, rc 0) 00000100:00100000:3.0:1788530488.569295:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03750450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+28:17156:x1875409555924864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 92us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530488.569307:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1788530488.571120:0:17156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17156:1875409555924864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788530488.571148:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f42167a00/0xb28d70e125751c9e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751ca5 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530488.571175:0:17156:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f42167a00/0xb28d70e125751c9e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e125751ca5 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788530488.571317:0:17156:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x22:0x0] index 13 count 13 00000040:00080000:1.0:1788530488.571820:0:17156:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788530488.572147:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].1, 224 off8416 00000040:00080000:1.0:1788530488.572179:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].2, 112 off8528 00000040:00080000:1.0:1788530488.572191:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].3, 224 off8752 00000040:00080000:1.0:1788530488.572202:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].4, 224 off8976 00000040:00080000:1.0:1788530488.572212:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].5, 112 off9088 00000040:00080000:1.0:1788530488.572222:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].6, 224 off9312 00000040:00080000:1.0:1788530488.572230:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].7, 224 off9536 00000040:00080000:1.0:1788530488.572240:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].8, 128 off9664 00000040:00080000:1.0:1788530488.572249:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].9, 224 off9888 00000040:00080000:1.0:1788530488.572258:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].10, 224 off10112 00000040:00080000:1.0:1788530488.572273:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].11, 128 off10240 00000040:00080000:1.0:1788530488.572290:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].12, 224 off10464 00000040:00080000:1.0:1788530488.572295:0:17156:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x22:0x0] index 12 count 13 00000100:00100000:1.0:1788530488.572373:0:17156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17156:1875409555924992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788530488.572441:0:17156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530488.572483:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f1f42d6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788530488.572527:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555924992 00000100:00100000:2.0:1788530488.572539:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555924992 00000100:00100000:2.0:1788530488.572597:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788530488.572604:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03751050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+28:17156:x1875409555924992:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788530488.572693:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03751050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+28:17156:x1875409555924992:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 90us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530488.572699:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788530488.572828:0:17156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17156:1875409555924992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788530488.572855:0:17156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32a57100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17156:1875409555925120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788530488.572882:0:17156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530488.572905:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f046a9d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788530488.572944:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555925120 00000100:00100000:3.0:1788530488.572949:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555925120 00000100:00100000:3.0:1788530488.572991:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788530488.572998:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03751450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+28:17156:x1875409555925120:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788530488.573088:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03751450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+28:17156:x1875409555925120:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 91us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530488.573093:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788530488.573182:0:17156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32a57100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17156:1875409555925120:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788530488.573545:0:17156:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788530488.573629:0:17156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32a57100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17156:1875409555925248:0@lo:502:ll_cfg_requeue.0 00000100:00100000:2.0:1788530488.573658:0:17156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530488.573678:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f046a9d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788530488.573800:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555925248 00000100:00100000:0.0:1788530488.573806:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555925248 00000100:00100000:0.0:1788530488.573839:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788530488.573845:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03753c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+28:17156:x1875409555925248:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:0.0:1788530488.573924:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03753c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+28:17156:x1875409555925248:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 79us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530488.573930:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1788530488.575987:0:17156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32a57100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17156:1875409555925248:0@lo:502:ll_cfg_requeue.0 00000040:00080000:2.0:1788530488.576276:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].1, 224 off8416 00000040:00080000:2.0:1788530488.576311:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].2, 112 off8528 00000040:00080000:2.0:1788530488.576326:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].3, 224 off8752 00000040:00080000:2.0:1788530488.576342:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].4, 224 off8976 00000040:00080000:2.0:1788530488.576358:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].5, 112 off9088 00000040:00080000:2.0:1788530488.576370:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].6, 224 off9312 00000040:00080000:2.0:1788530488.576379:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].7, 224 off9536 00000040:00080000:2.0:1788530488.576388:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].8, 128 off9664 00000040:00080000:2.0:1788530488.576397:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].9, 224 off9888 00000040:00080000:2.0:1788530488.576406:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].10, 224 off10112 00000040:00080000:2.0:1788530488.576424:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].11, 128 off10240 00000100:00100000:2.0:1788530488.576457:0:17156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32a57100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17156:1875409555925376:0@lo:502:ll_cfg_requeue.0 00000100:00100000:2.0:1788530488.576522:0:17156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530488.576582:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f046a9d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788530488.576690:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555925376 00000100:00100000:0.0:1788530488.576697:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555925376 00000100:00100000:0.0:1788530488.576751:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788530488.576761:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03751850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+28:17156:x1875409555925376:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:0.0:1788530488.577046:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03751850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+28:17156:x1875409555925376:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 285us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530488.577063:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1788530488.582783:0:17156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32a57100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17156:1875409555925376:0@lo:502:ll_cfg_requeue.0 00000040:00080000:2.0:1788530488.584214:0:17156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].12, 224 off10464 00000040:00080000:2.0:1788530488.584226:0:17156:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000040:00080000:2.0:1788530488.587665:0:20241:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x24:0x0] index 64768 count 13 00000020:01000000:2.0:1788530488.587711:0:17156:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788530488.587724:0:17156:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788530488.587879:0:17156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f42167a00/0xb28d70e125751c9e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751ca5 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530488.587888:0:17156:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f42167a00/0xb28d70e125751c9e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751ca5 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788530488.587898:0:17156:0:(mgc_request.c:715:do_requeue()) updating log params 10000000:01000000:2.0:1788530488.587900:0:17156:0:(mgc_request.c:2194:mgc_process_log()) Process log params-ffff9a9f202a8800 from 13 10000000:01000000:2.0:1788530488.587902:0:17156:0:(mgc_request.c:1294:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788530488.587931:0:17156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f18140a00/0xb28d70e125751cac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530488.587937:0:17156:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.141@tcp lock: ffff9a9f18140a00/0xb28d70e125751cac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530488.587949:0:17156:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.141@tcp lock: ffff9a9f18140a00/0xb28d70e125751cac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530488.587982:0:17156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32a55f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17156:1875409555925504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788530488.588046:0:17156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530488.588303:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f046a9900 going to sleep for 11 seconds 00000100:00100000:3.0:1788530488.589846:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555925504 00000100:00100000:3.0:1788530488.589856:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555925504 00000100:00100000:3.0:1788530488.589897:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1788530488.589905:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03cff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+28:17156:x1875409555925504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788530488.589918:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788530488.589932:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f3d36a200/0xb28d70e125751cb3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb28d70e125751cac expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530488.589957:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f3d36a200/0xb28d70e125751cb3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb28d70e125751cac expref: 29 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530488.589979:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f3d36a200/0xb28d70e125751cb3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb28d70e125751cac expref: 29 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530488.589988:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d36a200, rc 0) 00000100:00100000:3.0:1788530488.590067:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03cff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+29:17156:x1875409555925504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 161us (2020us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530488.590083:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1788530488.590133:0:17156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32a55f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17156:1875409555925504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788530488.590146:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.141@tcp lock: ffff9a9f18140a00/0xb28d70e125751cac lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751cb3 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530488.590154:0:17156:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.141@tcp lock: ffff9a9f18140a00/0xb28d70e125751cac lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb28d70e125751cb3 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530488.590190:0:17156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2a2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17156:1875409555925632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788530488.590213:0:17156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530488.590347:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e02519000 going to sleep for 11 seconds 00000100:00100000:3.0:1788530488.590359:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555925632 00000100:00100000:3.0:1788530488.590362:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555925632 00000100:00100000:3.0:1788530488.590380:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1788530488.590384:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03cfec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+29:17156:x1875409555925632:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788530488.590468:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03cfec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+29:17156:x1875409555925632:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 83us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530488.590473:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1788530488.590493:0:17156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2a2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17156:1875409555925632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788530488.590512:0:17156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3d2a2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17156:1875409555925760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788530488.590540:0:17156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530488.590548:0:17156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9e02519000 going to sleep for 11 seconds 00000100:00100000:3.0:1788530488.590556:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555925760 00000100:00100000:3.0:1788530488.590576:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555925760 00000100:00100000:3.0:1788530488.590592:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1788530488.590601:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03cffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+29:17156:x1875409555925760:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788530488.590653:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03cffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+29:17156:x1875409555925760:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 52us (112us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530488.590657:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1788530488.590684:0:17156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3d2a2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:17156:1875409555925760:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788530488.592665:0:20242:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788530488.592725:0:17156:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788530488.593917:0:17156:0:(mgc_request.c:2277:mgc_process_log()) MGC192.168.202.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788530488.593930:0:17156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.141@tcp lock: ffff9a9f18140a00/0xb28d70e125751cac lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751cb3 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530488.593941:0:17156:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.141@tcp lock: ffff9a9f18140a00/0xb28d70e125751cac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb28d70e125751cb3 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788530488.836037:0:17192:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1788530488.961418:0:17913:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788530489.320334:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530489.320474:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531698944 00000100:00100000:3.0:1788530489.320489:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531698944 00000100:00100000:3.0:1788530489.320605:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 189 00000100:00100000:3.0:1788530489.320616:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03cfe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fc207521-3937-4a55-9052-ed3c297904d3+12:14939:x1875409531698944:12345-192.168.202.41@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788530489.320640:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788530489.320670:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f3d36aa00/0xb28d70e125751cba lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1406819a550d18 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530489.320713:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f3d36aa00/0xb28d70e125751cba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550d18 expref: 13 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530489.320727:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f3d36aa00/0xb28d70e125751cba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550d18 expref: 13 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530489.320774:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f3d36aa00, rc 0) 00000100:00100000:3.0:1788530489.320839:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03cfe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fc207521-3937-4a55-9052-ed3c297904d3+13:14939:x1875409531698944:12345-192.168.202.41@tcp:101:ll_cfg_requeue.0 Request processed in 225us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530489.320846:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 189 00000100:00100000:0.0:1788530489.326733:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530489.326789:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530489.326818:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530489.326922:0:18669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531699328 00000100:00100000:3.0:1788530489.326948:0:18669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531699328 00000100:00100000:3.0:1788530489.327063:0:18669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 20 00000100:00100000:3.0:1788530489.327074:0:18669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f06272a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66d42348-56b8-4977-9cd3-df6ed37388a6+5:2402:x1875409531699328:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1788530489.327189:0:18669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f06272a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66d42348-56b8-4977-9cd3-df6ed37388a6+5:2402:x1875409531699328:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 117us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530489.327197:0:18669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 20 00000100:00100000:0.0:1788530489.327319:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530489.327339:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530489.336860:0:18966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531699840 00000100:00100000:3.0:1788530489.336878:0:18966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531699840 00000100:00100000:3.0:1788530489.336975:0:18966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 21 00000100:00100000:3.0:1788530489.336987:0:18966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f06273800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5fa0991a-e80a-4f33-96cf-7430c54598af+5:2402:x1875409531699840:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:3.0:1788530489.337093:0:18966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f06273800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5fa0991a-e80a-4f33-96cf-7430c54598af+5:2402:x1875409531699840:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 107us (9773us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530489.337102:0:18966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 21 00000100:00080000:3.0:1788530489.337130:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788530489.348929:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531699072 00000100:00100000:2.0:1788530489.348947:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531699072 00000100:00080000:2.0:1788530489.349524:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788530489.349608:0:18163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531699584 00000100:00100000:2.0:1788530489.349614:0:18163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531699584 00000100:00100000:2.0:1788530489.349643:0:18163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531699200 00000100:00100000:2.0:1788530489.349652:0:18163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531699200 00000100:00100000:2.0:1788530489.349697:0:18163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 65 00000100:00100000:2.0:1788530489.349712:0:18163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f06270700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66d42348-56b8-4977-9cd3-df6ed37388a6+6:2402:x1875409531699072:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1788530489.349936:0:18163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f06270700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66d42348-56b8-4977-9cd3-df6ed37388a6+6:2402:x1875409531699072:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 227us (23218us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530489.349946:0:18163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 65 00000100:00100000:2.0:1788530489.349979:0:18163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 66 00000100:00100000:2.0:1788530489.349987:0:18163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f06271c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5fa0991a-e80a-4f33-96cf-7430c54598af+6:2402:x1875409531699584:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1788530489.350012:0:18163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f06271c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5fa0991a-e80a-4f33-96cf-7430c54598af+6:2402:x1875409531699584:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 27us (23193us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530489.350018:0:18163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 66 00000100:00100000:2.0:1788530489.350030:0:18163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 67 00000100:00100000:2.0:1788530489.350037:0:18163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f06270a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66d42348-56b8-4977-9cd3-df6ed37388a6+5:2402:x1875409531699200:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1788530489.350060:0:18163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f06270a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66d42348-56b8-4977-9cd3-df6ed37388a6+5:2402:x1875409531699200:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 24us (22719us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530489.350066:0:18163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 67 00000100:00080000:2.0:1788530489.350081:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788530489.350084:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788530489.350142:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530489.350209:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530489.350327:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530489.350443:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530489.350466:0:18669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531699456 00000100:00100000:2.0:1788530489.350471:0:18669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531699456 00000100:00100000:2.0:1788530489.350505:0:18669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531699968 00000100:00100000:2.0:1788530489.350508:0:18669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531699968 00000100:00100000:2.0:1788530489.350526:0:18669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 22 00000100:00100000:2.0:1788530489.350533:0:18669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66d42348-56b8-4977-9cd3-df6ed37388a6+5:2402:x1875409531699456:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1788530489.350597:0:18669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66d42348-56b8-4977-9cd3-df6ed37388a6+5:2402:x1875409531699456:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 64us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530489.350604:0:18669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 22 00000100:00100000:2.0:1788530489.350617:0:18669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 23 00000100:00100000:2.0:1788530489.350624:0:18669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5fa0991a-e80a-4f33-96cf-7430c54598af+5:2402:x1875409531699968:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1788530489.350646:0:18669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5fa0991a-e80a-4f33-96cf-7430c54598af+5:2402:x1875409531699968:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 23us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530489.350652:0:18669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 23 00000100:00100000:2.0:1788530489.350667:0:18163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531699712 00000100:00100000:2.0:1788530489.350671:0:18163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531699712 00000100:00100000:2.0:1788530489.352538:0:18163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 68 00000100:00100000:2.0:1788530489.352574:0:18163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5fa0991a-e80a-4f33-96cf-7430c54598af+5:2402:x1875409531699712:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1788530489.352646:0:18163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5fa0991a-e80a-4f33-96cf-7430c54598af+5:2402:x1875409531699712:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 97us (2437us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530489.352653:0:18163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 68 00000100:00100000:2.0:1788530489.352690:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531700096 00000100:00100000:2.0:1788530489.352698:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531700096 00000100:00100000:2.0:1788530489.352744:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 190 00000100:00100000:2.0:1788530489.352768:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03cfc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fc207521-3937-4a55-9052-ed3c297904d3+13:14939:x1875409531700096:12345-192.168.202.41@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788530489.352878:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03cfc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fc207521-3937-4a55-9052-ed3c297904d3+13:14939:x1875409531700096:12345-192.168.202.41@tcp:501:ll_cfg_requeue.0 Request processed in 112us (2435us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530489.352884:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 190 00000100:00080000:2.0:1788530489.352911:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788530489.352916:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788530489.358125:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530489.358219:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531700224 00000100:00100000:1.0:1788530489.358229:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531700224 00000100:00100000:1.0:1788530489.358285:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 191 00000100:00100000:1.0:1788530489.358295:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03cff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fc207521-3937-4a55-9052-ed3c297904d3+13:14939:x1875409531700224:12345-192.168.202.41@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788530489.358445:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03cff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fc207521-3937-4a55-9052-ed3c297904d3+13:14939:x1875409531700224:12345-192.168.202.41@tcp:503:ll_cfg_requeue.0 Request processed in 150us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530489.358462:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 191 00000100:00100000:2.0:1788530489.369688:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530489.370148:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531700352 00000100:00100000:3.0:1788530489.370165:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531700352 00000100:00100000:3.0:1788530489.370440:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 192 00000100:00100000:3.0:1788530489.370453:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fc207521-3937-4a55-9052-ed3c297904d3+13:14939:x1875409531700352:12345-192.168.202.41@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788530489.370472:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788530489.370507:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a9f012eae00/0xb28d70e125751cc1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b1406819a550d1f expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530489.370537:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a9f012eae00/0xb28d70e125751cc1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550d1f expref: 14 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530489.370550:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a9f012eae00/0xb28d70e125751cc1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550d1f expref: 14 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530489.370594:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f012eae00, rc 0) 00000100:00100000:3.0:1788530489.370850:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fc207521-3937-4a55-9052-ed3c297904d3+14:14939:x1875409531700352:12345-192.168.202.41@tcp:101:ll_cfg_requeue.0 Request processed in 399us (1176us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530489.370858:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 192 00000100:00100000:2.0:1788530489.373485:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530489.373587:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531700480 00000100:00100000:3.0:1788530489.373596:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531700480 00000100:00100000:3.0:1788530489.373642:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 193 00000100:00100000:3.0:1788530489.373652:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fc207521-3937-4a55-9052-ed3c297904d3+14:14939:x1875409531700480:12345-192.168.202.41@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788530489.373807:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fc207521-3937-4a55-9052-ed3c297904d3+14:14939:x1875409531700480:12345-192.168.202.41@tcp:501:ll_cfg_requeue.0 Request processed in 156us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530489.373816:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 193 00000100:00100000:2.0:1788530489.376617:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530489.376713:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531700608 00000100:00100000:0.0:1788530489.376723:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531700608 00000100:00100000:0.0:1788530489.376806:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 194 00000100:00100000:0.0:1788530489.376817:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fc207521-3937-4a55-9052-ed3c297904d3+14:14939:x1875409531700608:12345-192.168.202.41@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788530489.376953:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fc207521-3937-4a55-9052-ed3c297904d3+14:14939:x1875409531700608:12345-192.168.202.41@tcp:503:ll_cfg_requeue.0 Request processed in 137us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530489.376970:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 194 00000100:00100000:1.0:1788530489.412575:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e027d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555925888:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788530489.412701:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530489.412922:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555925888 00000100:00100000:1.0:1788530489.413012:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555925888 00000100:00100000:1.0:1788530489.413218:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788530489.413245:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555925888:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788530489.413290:0:18670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788530489.413358:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555925888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 117us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530489.413366:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788530489.413426:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e027d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555925888:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788530489.414194:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32a55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:3647:1875409555926144:0@lo:400:kworker.0 00000100:00100000:2.0:1788530489.414313:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530489.414353:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875409555926656:0@lo:400:kworker.0 00000100:00100000:2.0:1788530489.414383:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530489.414402:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875409555927168:0@lo:400:kworker.0 00000100:00100000:2.0:1788530489.414421:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530489.414439:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788530489.414444:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32a55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555926272:0@lo:400:kworker.0 00000100:00100000:2.0:1788530489.414470:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530489.414490:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555926784:0@lo:400:kworker.0 00000100:00100000:2.0:1788530489.414510:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530489.414524:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875409555927296:0@lo:400:kworker.0 00000100:00100000:2.0:1788530489.414542:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530489.414599:0:18163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555926656 00000100:00100000:2.0:1788530489.414913:0:18163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555926656 00000100:00100000:2.0:1788530489.414995:0:18163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555927168 00000100:00100000:2.0:1788530489.414999:0:18163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555927168 00010000:00010000:1.0:1788530489.415089:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788530489.415113:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555926272 00000100:00100000:1.0:1788530489.415118:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555926272 00000100:00100000:1.0:1788530489.415148:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555926784 00000100:00100000:1.0:1788530489.415151:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555926784 00000100:00100000:1.0:1788530489.415170:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788530489.415180:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32bd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555926272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530489.415259:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32bd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875409555926272:12345-0@lo:400:kworker.0 Request processed in 80us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530489.415267:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788530489.415284:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788530489.415290:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32bd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555926784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530489.415319:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32bd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555926784:12345-0@lo:400:kworker.0 Request processed in 29us (808us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530489.415332:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788530489.415357:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32a54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555926016:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788530489.415389:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530489.415411:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32a57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555926528:0@lo:400:kworker.0 00000100:00100000:1.0:1788530489.415430:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530489.415458:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875409555927040:0@lo:400:kworker.0 00000100:00100000:1.0:1788530489.415478:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530489.415495:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875409555927552:0@lo:400:kworker.0 00000100:00100000:1.0:1788530489.415515:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530489.415528:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788530489.415535:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32a55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555926400:0@lo:400:kworker.0 00000100:00100000:1.0:1788530489.415555:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530489.415588:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555926912:0@lo:400:kworker.0 00000100:00100000:0.0:1788530489.415598:0:18669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555926528 00000100:00100000:0.0:1788530489.415602:0:18669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555926528 00000100:00100000:1.0:1788530489.415623:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530489.416281:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875409555927424:0@lo:400:kworker.0 00000100:00100000:1.0:1788530489.416316:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530489.416352:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555926016 00000100:00100000:1.0:1788530489.416356:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555926016 00000100:00100000:1.0:1788530489.416392:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788530489.416401:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1875409555926016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788530489.416424:0:18670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788530489.416467:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1875409555926016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (1076us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530489.416475:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788530489.416552:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32a55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875409555926272:0@lo:400:kworker.0 00000100:00100000:1.0:1788530489.416599:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555926784:0@lo:400:kworker.0 00000100:00100000:1.0:1788530489.416658:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32a54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555926016:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788530489.416678:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555927296 00000100:00100000:1.0:1788530489.416857:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555927296 00000100:00080000:3.0:1788530489.417010:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788530489.417015:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788530489.417017:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788530489.417866:0:19968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555927040 00000100:00100000:3.0:1788530489.417872:0:19968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555927040 00000100:00100000:3.0:1788530489.417903:0:19968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555927552 00000100:00100000:3.0:1788530489.417907:0:19968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555927552 00000100:00100000:3.0:1788530489.417943:0:19968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555927424 00000100:00100000:3.0:1788530489.417951:0:19968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555927424 00000100:00100000:3.0:1788530489.417993:0:19968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788530489.418002:0:19968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32bd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875409555926656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530489.418078:0:19968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32bd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875409555926656:12345-0@lo:400:kworker.0 Request processed in 78us (3694us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530489.418084:0:19968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788530489.418100:0:19968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788530489.418105:0:19968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875409555927040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530489.418135:0:19968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875409555927040:12345-0@lo:400:kworker.0 Request processed in 30us (2656us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530489.418141:0:19968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788530489.418151:0:19968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788530489.418157:0:19968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875409555927552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530489.418181:0:19968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875409555927552:12345-0@lo:400:kworker.0 Request processed in 25us (2665us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530489.418187:0:19968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788530489.418196:0:19968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788530489.418202:0:19968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875409555927424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530489.418226:0:19968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875409555927424:12345-0@lo:400:kworker.0 Request processed in 25us (1910us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530489.418243:0:19968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:3.0:1788530489.418262:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788530489.418265:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788530489.418291:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555926144 00000100:00100000:3.0:1788530489.418295:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555926144 00000100:00100000:3.0:1788530489.418318:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1788530489.418323:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+29:3647:x1875409555926144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788530489.418360:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+29:3647:x1875409555926144:12345-0@lo:400:kworker.0 Request processed in 37us (4049us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530489.418366:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1788530489.418414:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875409555927424:0@lo:400:kworker.0 00000100:00100000:3.0:1788530489.418425:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875409555927040:0@lo:400:kworker.0 00010000:00080000:3.0:1788530489.418436:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f32bd0e00 x1875409555927552/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530505 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530489.418445:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875409555927552:0@lo:400:kworker.0 00000100:00100000:3.0:1788530489.418475:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32a55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:3647:1875409555926144:0@lo:400:kworker.0 00000100:00100000:3.0:1788530489.418485:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875409555926656:0@lo:400:kworker.0 00000100:00100000:2.0:1788530489.418940:0:18163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788530489.418948:0:18163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32bd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875409555927168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530489.419005:0:18163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32bd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875409555927168:12345-0@lo:400:kworker.0 Request processed in 58us (4582us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530489.419012:0:18163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788530489.419037:0:18966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555926400 00000100:00100000:2.0:1788530489.419041:0:18966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555926400 00000100:00100000:2.0:1788530489.419079:0:18966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555926912 00000100:00100000:2.0:1788530489.419082:0:18966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555926912 00000100:00100000:2.0:1788530489.419097:0:18966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788530489.419103:0:18966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555926400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530489.419142:0:18966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555926400:12345-0@lo:400:kworker.0 Request processed in 39us (3586us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530489.419148:0:18966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788530489.419159:0:18966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788530489.419164:0:18966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555926912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530489.419189:0:18966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555926912:12345-0@lo:400:kworker.0 Request processed in 26us (3567us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530489.419195:0:18966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788530489.419375:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875409555927168:0@lo:400:kworker.0 00000100:00100000:2.0:1788530489.419405:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32a55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555926400:0@lo:400:kworker.0 00000100:00100000:2.0:1788530489.419414:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555926912:0@lo:400:kworker.0 00000100:00080000:3.0:1788530489.419474:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788530489.423641:0:18669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788530489.423658:0:18669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555926528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530489.423758:0:18669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555926528:12345-0@lo:400:kworker.0 Request processed in 104us (8326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530489.423766:0:18669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788530489.423819:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32a57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555926528:0@lo:400:kworker.0 00000100:00100000:1.0:1788530489.423879:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788530489.423888:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32bd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875409555927296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530489.424023:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32bd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875409555927296:12345-0@lo:400:kworker.0 Request processed in 136us (9478us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530489.424030:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00080000:3.0:1788530489.424753:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f32bd3100 x1875409555927296/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530505 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788530489.424769:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875409555927296:0@lo:400:kworker.0 00010000:00010000:0.0:1788530490.433017:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530491.456774:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788530491.457390:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788530491.457418:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555927680:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788530491.457496:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530491.457603:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555927680 00000100:00100000:2.0:1788530491.457626:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555927680 00000100:00100000:2.0:1788530491.457701:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788530491.457713:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555927680:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788530491.457742:0:18670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788530491.457793:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555927680:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530491.457799:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788530491.457844:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555927680:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788530491.458083:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788530491.748365:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530491.748695:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531700736 00000100:00100000:0.0:1788530491.748707:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531700736 00000100:00100000:0.0:1788530491.748791:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 23 00000100:00100000:0.0:1788530491.748802:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66d42348-56b8-4977-9cd3-df6ed37388a6+6:15609:x1875409531700736:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788530491.748823:0:17160:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530491.748848:0:17160:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3a00/0xb28d70e125751cc8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550d26 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530491.748916:0:17160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3800/0xb28d70e125751ccf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530491.748931:0:17160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3800/0xb28d70e125751ccf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530491.748954:0:17160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3800/0xb28d70e125751ccf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530491.748969:0:17160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a2400/0xb28d70e125751cd6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530491.748976:0:17160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a2400/0xb28d70e125751cd6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530491.748982:0:17160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a2400/0xb28d70e125751cd6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530491.749078:0:17160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a2600/0xb28d70e125751cdd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530491.749087:0:17160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a2600/0xb28d70e125751cdd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530491.749094:0:17160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a2600/0xb28d70e125751cdd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788530491.749142:0:17160:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788530491.749146:0:17160:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788530491.749193:0:17160:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a2600/0xb28d70e125751cdd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530491.749216:0:17160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3800/0xb28d70e125751ccf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530491.749224:0:17160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3800/0xb28d70e125751ccf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530491.749231:0:17160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3800/0xb28d70e125751ccf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530491.749237:0:17160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9e010a3800 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:0.0:1788530491.750553:0:17160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3800/0xb28d70e125751ccf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530491.750589:0:17160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3800/0xb28d70e125751ccf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530491.750608:0:17160:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a9f0b171900) 00010000:00010000:0.0:1788530491.750611:0:17160:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788530491.750618:0:17160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3800/0xb28d70e125751ccf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530491.750625:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3800/0xb28d70e125751ccf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530491.750646:0:17160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a2400/0xb28d70e125751cd6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530491.750672:0:17160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a2400/0xb28d70e125751cd6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530491.750684:0:17160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a2400/0xb28d70e125751cd6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530491.750690:0:17160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9e010a2400 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:0.0:1788530491.750694:0:17160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a2400/0xb28d70e125751cd6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530491.750700:0:17160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a2400/0xb28d70e125751cd6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530491.750707:0:17160:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9a9e03284b00) 00010000:00010000:0.0:1788530491.750710:0:17160:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788530491.750712:0:17160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a2400/0xb28d70e125751cd6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530491.750718:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a2400/0xb28d70e125751cd6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530491.750773:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3a00/0xb28d70e125751cc8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550d26 expref: 8 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530491.750788:0:17160:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a2600/0xb28d70e125751cdd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550d26 expref: 7 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530491.750796:0:17160:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a9e03284a00) 00010000:00010000:0.0:1788530491.750799:0:17160:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788530491.750808:0:17160:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9e010a2600, rc 0) 00000100:00080000:1.0:1788530491.750915:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788530491.760241:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66d42348-56b8-4977-9cd3-df6ed37388a6+7:15609:x1875409531700736:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 10676us (11122us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530491.760258:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 23 00000100:00100000:2.0:1788530491.770232:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530491.770583:0:17170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531700864 00000100:00100000:1.0:1788530491.770595:0:17170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531700864 00000100:00100000:0.0:1788530491.770754:0:17169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 5 00000100:00100000:0.0:1788530491.770768:0:17169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32bd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:66d42348-56b8-4977-9cd3-df6ed37388a6+7:15609:x1875409531700864:12345-192.168.202.41@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1788530491.770853:0:17169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32bd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:66d42348-56b8-4977-9cd3-df6ed37388a6+7:15609:x1875409531700864:12345-192.168.202.41@tcp:900:lhsmtool_posix.0 Request processed in 89us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530491.770862:0:17169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 5 00000100:00100000:2.0:1788530491.775699:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530491.775856:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531701120 00000100:00100000:0.0:1788530491.775867:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531701120 00000100:00100000:0.0:1788530491.775934:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 24 00000100:00100000:0.0:1788530491.775955:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32bd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:66d42348-56b8-4977-9cd3-df6ed37388a6+7:15609:x1875409531701120:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788530491.775976:0:17158:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530491.775996:0:17158:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3a00/0xb28d70e125751ce4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550d2d expref: -99 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530491.776083:0:17158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a2400/0xb28d70e125751ceb lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530491.776100:0:17158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a2400/0xb28d70e125751ceb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530491.776112:0:17158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a2400/0xb28d70e125751ceb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530491.776180:0:17158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3800/0xb28d70e125751cf2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530491.776221:0:17158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3800/0xb28d70e125751cf2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530491.776229:0:17158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3800/0xb28d70e125751cf2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530491.776340:0:17158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a2800/0xb28d70e125751cf9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530491.776349:0:17158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a2800/0xb28d70e125751cf9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530491.776356:0:17158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a2800/0xb28d70e125751cf9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788530491.776366:0:17158:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1788530491.776511:0:17158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a2400/0xb28d70e125751ceb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530491.776520:0:17158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a2400/0xb28d70e125751ceb lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530491.776527:0:17158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a2400/0xb28d70e125751ceb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530491.776534:0:17158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9e010a2400 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:0.0:1788530491.776538:0:17158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a2400/0xb28d70e125751ceb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530491.776546:0:17158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a2400/0xb28d70e125751ceb lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530491.776621:0:17158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a9e03284a00) 00010000:00010000:0.0:1788530491.776625:0:17158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788530491.776629:0:17158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a2400/0xb28d70e125751ceb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530491.776636:0:17158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a2400/0xb28d70e125751ceb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530491.776651:0:17158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3800/0xb28d70e125751cf2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530491.777150:0:17158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3800/0xb28d70e125751cf2 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530491.777162:0:17158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3800/0xb28d70e125751cf2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530491.777168:0:17158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9e010a3800 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:0.0:1788530491.777171:0:17158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3800/0xb28d70e125751cf2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530491.777179:0:17158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3800/0xb28d70e125751cf2 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530491.777189:0:17158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9a9e03284b00) 00010000:00010000:0.0:1788530491.777191:0:17158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788530491.777195:0:17158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3800/0xb28d70e125751cf2 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530491.777260:0:17158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3800/0xb28d70e125751cf2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530491.783441:0:17158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3a00/0xb28d70e125751ce4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550d2d expref: 10 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530491.783466:0:17158:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a2800/0xb28d70e125751cf9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550d2d expref: 9 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530491.783474:0:17158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a9e03284300) 00010000:00010000:1.0:1788530491.783477:0:17158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788530491.783480:0:17158:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9e010a2800, rc 0) 00000100:00100000:1.0:1788530491.783598:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32bd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:66d42348-56b8-4977-9cd3-df6ed37388a6+9:15609:x1875409531701120:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 7645us (7914us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788530491.783628:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 24 00000100:00100000:3.0:1788530491.787143:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530491.787409:0:18163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531701248 00000100:00100000:0.0:1788530491.787419:0:18163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531701248 00000100:00100000:0.0:1788530491.787486:0:18163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 25 00000100:00100000:0.0:1788530491.787497:0:18163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66d42348-56b8-4977-9cd3-df6ed37388a6+9:15609:x1875409531701248:12345-192.168.202.41@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788530491.787637:0:18163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66d42348-56b8-4977-9cd3-df6ed37388a6+9:15609:x1875409531701248:12345-192.168.202.41@tcp:59:lhsmtool_posix.0 Request processed in 141us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530491.787646:0:18163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 25 00000100:00100000:3.0:1788530491.789512:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530491.790691:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531701376 00000100:00100000:0.0:1788530491.790706:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531701376 00000100:00100000:0.0:1788530491.790791:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 26 00000100:00100000:0.0:1788530491.790807:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66d42348-56b8-4977-9cd3-df6ed37388a6+5:15609:x1875409531701376:12345-192.168.202.41@tcp:59:lhsmtool_posix.0 00000100:00080000:1.0:1788530491.791506:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:0.0:1788530491.796409:0:17160:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 5544us 00000100:00100000:3.0:1788530491.843556:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66d42348-56b8-4977-9cd3-df6ed37388a6+5:15609:x1875409531701376:12345-192.168.202.41@tcp:59:lhsmtool_posix.0 Request processed in 52742us (54044us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530491.843597:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 26 00000100:00100000:3.0:1788530491.875083:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530491.876818:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531701504 00000100:00100000:1.0:1788530491.876832:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531701504 00000100:00100000:1.0:1788530491.876914:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 27 00000100:00100000:1.0:1788530491.876925:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:66d42348-56b8-4977-9cd3-df6ed37388a6+9:15615:x1875409531701504:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:1.0:1788530491.876958:0:17158:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530491.876983:0:17158:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166600/0xb28d70e125751d07 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550d34 expref: -99 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530491.877057:0:17158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166400/0xb28d70e125751d0e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530491.877074:0:17158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166400/0xb28d70e125751d0e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530491.877086:0:17158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166400/0xb28d70e125751d0e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530491.877100:0:17158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167800/0xb28d70e125751d15 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530491.877107:0:17158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167800/0xb28d70e125751d15 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530491.877114:0:17158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167800/0xb28d70e125751d15 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530491.877158:0:17158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166400/0xb28d70e125751d0e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530491.877184:0:17158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166400/0xb28d70e125751d0e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530491.877191:0:17158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166400/0xb28d70e125751d0e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530491.877197:0:17158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f42166400 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:1.0:1788530491.877201:0:17158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166400/0xb28d70e125751d0e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530491.877209:0:17158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166400/0xb28d70e125751d0e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530491.877222:0:17158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a9f0b171900) 00010000:00010000:1.0:1788530491.877225:0:17158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788530491.877230:0:17158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166400/0xb28d70e125751d0e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530491.877236:0:17158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166400/0xb28d70e125751d0e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530491.877264:0:17158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167800/0xb28d70e125751d15 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530491.877269:0:17158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167800/0xb28d70e125751d15 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530491.877275:0:17158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167800/0xb28d70e125751d15 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530491.877281:0:17158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f42167800 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:1.0:1788530491.877288:0:17158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167800/0xb28d70e125751d15 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530491.877295:0:17158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167800/0xb28d70e125751d15 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530491.877302:0:17158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9a9f32abd100) 00010000:00010000:1.0:1788530491.877304:0:17158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788530491.877306:0:17158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167800/0xb28d70e125751d15 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530491.877312:0:17158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167800/0xb28d70e125751d15 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530491.877353:0:17158:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166600/0xb28d70e125751d07 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550d34 expref: 10 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530491.877362:0:17158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a9f0b171900) 00010000:00010000:1.0:1788530491.877364:0:17158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788530491.877367:0:17158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166600/0xb28d70e125751d07 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550d34 expref: 10 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530491.877377:0:17158:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f42166600, rc 0) 00000100:00100000:1.0:1788530491.877451:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:66d42348-56b8-4977-9cd3-df6ed37388a6+9:15615:x1875409531701504:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 528us (2384us total) trans 0 rc 301/301 00000100:00100000:1.0:1788530491.877459:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 27 00000100:00100000:2.0:1788530491.887140:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530491.889873:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531701632 00000100:00100000:1.0:1788530491.889899:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531701632 00000100:00100000:1.0:1788530491.889983:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 0 00000100:00100000:1.0:1788530491.889994:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32bd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:66d42348-56b8-4977-9cd3-df6ed37388a6+9:15615:x1875409531701632:12345-192.168.202.41@tcp:700:lfs.0 00000100:00100000:1.0:1788530491.890120:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32bd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:66d42348-56b8-4977-9cd3-df6ed37388a6+9:15615:x1875409531701632:12345-192.168.202.41@tcp:700:lfs.0 Request processed in 127us (2989us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530491.890129:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 0 00000100:00100000:3.0:1788530491.893648:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530491.894170:0:19968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531701888 00000100:00100000:2.0:1788530491.894181:0:19968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531701888 00000100:00100000:2.0:1788530491.894263:0:19968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 28 00000100:00100000:2.0:1788530491.894275:0:19968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:66d42348-56b8-4977-9cd3-df6ed37388a6+9:15615:x1875409531701888:12345-192.168.202.41@tcp:36:lfs.0 00010000:00010000:2.0:1788530491.894352:0:19968:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788530491.894387:0:19968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f3d36ae00/0xb28d70e125751c2e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550c9a expref: 9 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530491.894415:0:19968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a9f0b171900) 00010000:00010000:2.0:1788530491.894420:0:19968:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788530491.894497:0:19968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141200/0xb28d70e125751d1c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530491.894511:0:19968:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166800/0xb28d70e125751c74 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550d11 expref: 5 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530491.894540:0:19968:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141200/0xb28d70e125751d1c lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530491.894606:0:19968:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166800/0xb28d70e125751c74 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550d11 expref: 5 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530491.894622:0:19968:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166800/0xb28d70e125751c74 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550d11 expref: 5 pid: 17158 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530491.894638:0:19968:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19968:1875409555927808:192.168.202.41@tcp:104: 00000100:00100000:2.0:1788530491.894737:0:19968:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f046a9240 going to sleep for 11 seconds 00000100:00100000:3.0:1788530491.897418:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530491.897846:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531702016 00000100:00100000:0.0:1788530491.897858:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531702016 00010000:00010000:0.0:1788530491.897923:0:17146:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166800/0xb28d70e125751c74 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550d11 expref: 6 pid: 17158 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530491.897983:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 18 00000100:00100000:0.0:1788530491.897995:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5fa0991a-e80a-4f33-96cf-7430c54598af+6:2399:x1875409531702016:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788530491.898014:0:17146:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788530491.898022:0:17146:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166800/0xb28d70e125751c74 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550d11 expref: 6 pid: 17158 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530491.898037:0:17146:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166800/0xb28d70e125751c74 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550d11 expref: 6 pid: 17158 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530491.898075:0:17146:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a9f0b171900) 00010000:00010000:0.0:1788530491.898081:0:17146:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141200/0xb28d70e125751d1c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530491.898092:0:17146:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141200/0xb28d70e125751d1c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530491.898101:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141200/0xb28d70e125751d1c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530491.898126:0:17146:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788530491.898149:0:19968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166800/0xb28d70e125751c74 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550d11 expref: 6 pid: 17158 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530491.898174:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5fa0991a-e80a-4f33-96cf-7430c54598af+5:2399:x1875409531702016:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 182us (768us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530491.898180:0:19968:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19968:1875409555927808:192.168.202.41@tcp:104: 00000100:00100000:0.0:1788530491.898181:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 18 00010000:00010000:2.0:1788530491.898211:0:19968:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141200/0xb28d70e125751d1c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530491.898221:0:19968:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141200/0xb28d70e125751d1c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530491.898226:0:19968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141200/0xb28d70e125751d1c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788530491.898247:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788530491.898252:0:19968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141c00/0xb28d70e125751d23 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530491.898261:0:19968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141c00/0xb28d70e125751d23 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530491.898276:0:19968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141c00/0xb28d70e125751d23 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788530491.905484:0:17192:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788530491.916793:0:19968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ebc00/0xb28d70e125751d2a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530491.916818:0:19968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ebc00/0xb28d70e125751d2a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530491.916830:0:19968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ebc00/0xb28d70e125751d2a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788530491.916852:0:19968:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000feb4d408 reply state 000000000166bd8a transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ebc00/0xb28d70e125751d2a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530491.916867:0:19968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ebc00/0xb28d70e125751d2a lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530491.916876:0:19968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a9f0b171500) 00010000:00010000:3.0:1788530491.916879:0:19968:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788530491.916884:0:19968:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788530491.916890:0:19968:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788530491.916900:0:19968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141200/0xb28d70e125751d1c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530491.916907:0:19968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141200/0xb28d70e125751d1c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530491.916915:0:19968:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141200/0xb28d70e125751d1c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530491.916922:0:19968:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f18141200 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:3.0:1788530491.916947:0:19968:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141200/0xb28d70e125751d1c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530491.916956:0:19968:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141200/0xb28d70e125751d1c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530491.916986:0:19968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a9f0b171900) 00010000:00010000:3.0:1788530491.916989:0:19968:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788530491.916993:0:19968:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141200/0xb28d70e125751d1c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530491.916999:0:19968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141200/0xb28d70e125751d1c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788530491.917021:0:19968:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000feb4d408 reply state 000000000166bd8a transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141c00/0xb28d70e125751d23 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530491.917029:0:19968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141c00/0xb28d70e125751d23 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530491.917035:0:19968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9a9f2b995c00) 00010000:00010000:3.0:1788530491.917037:0:19968:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788530491.917040:0:19968:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1788530491.917176:0:19968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:66d42348-56b8-4977-9cd3-df6ed37388a6+10:15615:x1875409531701888:12345-192.168.202.41@tcp:36:lfs.0 Request processed in 22896us (23535us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1788530491.917188:0:19968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 28 00000100:00100000:3.0:1788530491.970096:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32a57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555927936:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788530491.970180:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530491.970290:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555927936 00000100:00100000:1.0:1788530491.970300:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555927936 00000100:00100000:1.0:1788530491.970357:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788530491.970367:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555927936:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788530491.970405:0:17164:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788530491.970458:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555927936:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530491.970466:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788530491.970513:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32a57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555927936:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788530491.973549:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788530491.973895:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555928064:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788530491.973992:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530491.974100:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555928064 00000100:00100000:3.0:1788530491.974108:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555928064 00000100:00100000:3.0:1788530491.974162:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788530491.974171:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555928064:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788530491.974209:0:17163:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788530491.974259:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555928064:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530491.974281:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788530491.974390:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555928064:0@lo:41:osp-pre-0-1.0 00000040:00080000:1.0:1788530492.033243:0:17913:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788530492.083700:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530492.084374:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531702144 00000100:00100000:0.0:1788530492.084385:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531702144 00000100:00100000:0.0:1788530492.084457:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 29 00000100:00100000:0.0:1788530492.084467:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66d42348-56b8-4977-9cd3-df6ed37388a6+10:15623:x1875409531702144:12345-192.168.202.41@tcp:101:lctl.0 00010000:00010000:0.0:1788530492.084491:0:17160:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530492.084515:0:17160:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3800/0xb28d70e125751d31 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550d3b expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530492.084651:0:17160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a2400/0xb28d70e125751d38 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530492.084676:0:17160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a2400/0xb28d70e125751d38 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530492.084688:0:17160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a2400/0xb28d70e125751d38 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788530492.084732:0:17160:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788530492.084736:0:17160:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788530492.084774:0:17160:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a2400/0xb28d70e125751d38 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530492.084799:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3800/0xb28d70e125751d31 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550d3b expref: 12 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530492.084816:0:17160:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a2400/0xb28d70e125751d38 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550d3b expref: 11 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530492.084824:0:17160:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a9e03284b00) 00010000:00010000:0.0:1788530492.084827:0:17160:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788530492.084830:0:17160:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9e010a2400, rc 0) 00000100:00100000:0.0:1788530492.085813:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66d42348-56b8-4977-9cd3-df6ed37388a6+11:15623:x1875409531702144:12345-192.168.202.41@tcp:101:lctl.0 Request processed in 436us (1214us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530492.085824:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 29 00000100:00100000:2.0:1788530492.116746:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530492.116849:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531702272 00000100:00100000:1.0:1788530492.116861:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531702272 00000100:00100000:1.0:1788530492.116976:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 30 00000100:00100000:1.0:1788530492.116988:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32bd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5fa0991a-e80a-4f33-96cf-7430c54598af+5:15624:x1875409531702272:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:1.0:1788530492.117007:0:17158:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530492.117027:0:17158:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166600/0xb28d70e125751d3f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550d42 expref: -99 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530492.117089:0:17158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167800/0xb28d70e125751d46 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530492.117102:0:17158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167800/0xb28d70e125751d46 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530492.117137:0:17158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167800/0xb28d70e125751d46 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788530492.117184:0:17158:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788530492.117187:0:17158:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788530492.117209:0:17158:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167800/0xb28d70e125751d46 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530492.117233:0:17158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166600/0xb28d70e125751d3f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550d42 expref: 7 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530492.117264:0:17158:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167800/0xb28d70e125751d46 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550d42 expref: 6 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530492.117273:0:17158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a9e03284b00) 00010000:00010000:1.0:1788530492.117275:0:17158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788530492.117279:0:17158:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f42167800, rc 0) 00000100:00100000:1.0:1788530492.117341:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32bd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5fa0991a-e80a-4f33-96cf-7430c54598af+6:15624:x1875409531702272:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 357us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530492.117348:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 30 00000100:00100000:3.0:1788530492.131536:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530492.131761:0:19968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531702400 00000100:00100000:2.0:1788530492.131773:0:19968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531702400 00000100:00100000:2.0:1788530492.131843:0:19968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 31 00000100:00100000:2.0:1788530492.131855:0:19968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3960ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5fa0991a-e80a-4f33-96cf-7430c54598af+6:15624:x1875409531702400:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:2.0:1788530492.131879:0:19968:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530492.131905:0:19968:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140400/0xb28d70e125751d4d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550d49 expref: -99 pid: 19968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.131987:0:19968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141400/0xb28d70e125751d54 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.132004:0:19968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141400/0xb28d70e125751d54 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.132016:0:19968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141400/0xb28d70e125751d54 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.132028:0:19968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141000/0xb28d70e125751d5b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.132035:0:19968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141000/0xb28d70e125751d5b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.132042:0:19968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141000/0xb28d70e125751d5b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.132144:0:19968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141e00/0xb28d70e125751d62 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.132154:0:19968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141e00/0xb28d70e125751d62 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.132162:0:19968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141e00/0xb28d70e125751d62 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788530492.132203:0:19968:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788530492.132207:0:19968:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788530492.132227:0:19968:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141e00/0xb28d70e125751d62 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.132239:0:19968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141400/0xb28d70e125751d54 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.132246:0:19968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141400/0xb28d70e125751d54 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.132253:0:19968:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141400/0xb28d70e125751d54 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.132259:0:19968:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f18141400 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:2.0:1788530492.132264:0:19968:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141400/0xb28d70e125751d54 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.132272:0:19968:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141400/0xb28d70e125751d54 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.132285:0:19968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a9e03284b00) 00010000:00010000:2.0:1788530492.132296:0:19968:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788530492.132302:0:19968:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141400/0xb28d70e125751d54 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.132309:0:19968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141400/0xb28d70e125751d54 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.132327:0:19968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141000/0xb28d70e125751d5b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.132333:0:19968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141000/0xb28d70e125751d5b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.132339:0:19968:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141000/0xb28d70e125751d5b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.132345:0:19968:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f18141000 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:2.0:1788530492.132347:0:19968:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141000/0xb28d70e125751d5b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.132354:0:19968:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141000/0xb28d70e125751d5b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.132361:0:19968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9a9f2b995c00) 00010000:00010000:2.0:1788530492.132363:0:19968:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788530492.132365:0:19968:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141000/0xb28d70e125751d5b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.132370:0:19968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141000/0xb28d70e125751d5b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.132397:0:19968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140400/0xb28d70e125751d4d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550d49 expref: 8 pid: 19968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.132420:0:19968:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141e00/0xb28d70e125751d62 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550d49 expref: 7 pid: 19968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.132427:0:19968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a9f0b171500) 00010000:00010000:2.0:1788530492.132429:0:19968:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788530492.132431:0:19968:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f18141e00, rc 0) 00000100:00100000:2.0:1788530492.132510:0:19968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3960ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5fa0991a-e80a-4f33-96cf-7430c54598af+7:15624:x1875409531702400:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 657us (989us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530492.132517:0:19968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 31 00000100:00100000:3.0:1788530492.140905:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530492.141032:0:17169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531702528 00000100:00100000:0.0:1788530492.141046:0:17169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531702528 00000100:00100000:0.0:1788530492.141158:0:17169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 6 00000100:00100000:0.0:1788530492.141171:0:17169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3960c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:5fa0991a-e80a-4f33-96cf-7430c54598af+5:15624:x1875409531702528:12345-192.168.202.41@tcp:900:lfs.0 00000100:00100000:0.0:1788530492.141267:0:17169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3960c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:5fa0991a-e80a-4f33-96cf-7430c54598af+5:15624:x1875409531702528:12345-192.168.202.41@tcp:900:lfs.0 Request processed in 99us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530492.141276:0:17169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 6 00000100:00080000:1.0:1788530492.141593:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788530492.153058:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530492.153163:0:18163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531702784 00000100:00100000:2.0:1788530492.153173:0:18163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531702784 00000100:00100000:2.0:1788530492.153241:0:18163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 32 00000100:00100000:2.0:1788530492.153252:0:18163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3960ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5fa0991a-e80a-4f33-96cf-7430c54598af+7:15624:x1875409531702784:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:2.0:1788530492.153273:0:18163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530492.153293:0:18163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140400/0xb28d70e125751d69 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550d50 expref: -99 pid: 18163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788530492.153392:0:18163:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788530492.153502:0:18163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140400/0xb28d70e125751d69 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550d50 expref: 9 pid: 18163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.153516:0:18163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a9e03284b00) 00010000:00010000:2.0:1788530492.153519:0:18163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788530492.153525:0:18163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140400/0xb28d70e125751d69 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550d50 expref: 9 pid: 18163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.153605:0:18163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f18140400, rc 0) 00000100:00100000:2.0:1788530492.153809:0:18163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3960ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5fa0991a-e80a-4f33-96cf-7430c54598af+8:15624:x1875409531702784:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 558us (761us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1788530492.153818:0:18163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 32 00000100:00100000:3.0:1788530492.161861:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530492.162844:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531703040 00000100:00100000:2.0:1788530492.162858:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531703040 00000100:00100000:2.0:1788530492.162928:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 33 00000100:00100000:2.0:1788530492.162947:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3960df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5fa0991a-e80a-4f33-96cf-7430c54598af+8:15624:x1875409531703040:12345-192.168.202.41@tcp:36:lfs.0 00010000:00010000:2.0:1788530492.163011:0:17159:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788530492.163044:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141e00/0xb28d70e125751d62 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550d49 expref: 8 pid: 19968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.163066:0:17159:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a9f0b171500) 00010000:00010000:2.0:1788530492.163072:0:17159:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788530492.163096:0:17159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141000/0xb28d70e125751d77 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.163111:0:17159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141000/0xb28d70e125751d77 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.163121:0:17159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141000/0xb28d70e125751d77 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788530492.163374:0:17159:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000055eb6f22 reply state 00000000e8de6d07 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141000/0xb28d70e125751d77 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.163388:0:17159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141000/0xb28d70e125751d77 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.164782:0:17159:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a9f0b171500) 00010000:00010000:2.0:1788530492.164785:0:17159:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:2.0:1788530492.164790:0:17159:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788530492.164802:0:17159:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788530492.168041:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3960df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5fa0991a-e80a-4f33-96cf-7430c54598af+9:15624:x1875409531703040:12345-192.168.202.41@tcp:36:lfs.0 Request processed in 5082us (6181us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1788530492.168055:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 33 00000100:00100000:3.0:1788530492.171270:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530492.171633:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531703296 00000100:00100000:1.0:1788530492.171645:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531703296 00000100:00100000:1.0:1788530492.171706:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 2 00000100:00100000:1.0:1788530492.171716:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3960c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5fa0991a-e80a-4f33-96cf-7430c54598af+9:15624:x1875409531703296:12345-192.168.202.41@tcp:35:lfs.0 00000100:00100000:1.0:1788530492.172005:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3960c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5fa0991a-e80a-4f33-96cf-7430c54598af+10:15624:x1875409531703296:12345-192.168.202.41@tcp:35:lfs.0 Request processed in 289us (746us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1788530492.172038:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 2 00000100:00100000:3.0:1788530492.175297:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530492.175410:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531703552 00000100:00100000:0.0:1788530492.175420:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531703552 00000100:00100000:0.0:1788530492.175478:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 34 00000100:00100000:0.0:1788530492.175488:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3960c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5fa0991a-e80a-4f33-96cf-7430c54598af+10:15624:x1875409531703552:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:0.0:1788530492.175512:0:17160:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530492.175533:0:17160:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3800/0xb28d70e125751d7e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550d57 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530492.175650:0:17160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3600/0xb28d70e125751d85 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530492.175676:0:17160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3600/0xb28d70e125751d85 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530492.175687:0:17160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3600/0xb28d70e125751d85 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530492.175700:0:17160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3a00/0xb28d70e125751d8c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530492.175707:0:17160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3a00/0xb28d70e125751d8c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530492.175713:0:17160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3a00/0xb28d70e125751d8c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788530492.175829:0:17160:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788530492.175899:0:17160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3600/0xb28d70e125751d85 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530492.175908:0:17160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3600/0xb28d70e125751d85 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530492.175915:0:17160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3600/0xb28d70e125751d85 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530492.175921:0:17160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9e010a3600 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:0.0:1788530492.175925:0:17160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3600/0xb28d70e125751d85 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530492.175943:0:17160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3600/0xb28d70e125751d85 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530492.175956:0:17160:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a9e03284b00) 00010000:00010000:0.0:1788530492.175959:0:17160:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788530492.175964:0:17160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3600/0xb28d70e125751d85 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530492.175970:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3600/0xb28d70e125751d85 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530492.175985:0:17160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3a00/0xb28d70e125751d8c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530492.175992:0:17160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3a00/0xb28d70e125751d8c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530492.176008:0:17160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3a00/0xb28d70e125751d8c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530492.176014:0:17160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9e010a3a00 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:0.0:1788530492.176016:0:17160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3a00/0xb28d70e125751d8c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530492.176023:0:17160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3a00/0xb28d70e125751d8c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530492.176031:0:17160:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9a9f2b995c00) 00010000:00010000:0.0:1788530492.176034:0:17160:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788530492.176037:0:17160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3a00/0xb28d70e125751d8c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530492.176042:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3a00/0xb28d70e125751d8c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530492.176081:0:17160:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3800/0xb28d70e125751d7e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550d57 expref: 12 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530492.176091:0:17160:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a9e03284b00) 00010000:00010000:0.0:1788530492.176093:0:17160:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788530492.176096:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3800/0xb28d70e125751d7e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550d57 expref: 12 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530492.176106:0:17160:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9e010a3800, rc 0) 00000100:00100000:0.0:1788530492.176158:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3960c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5fa0991a-e80a-4f33-96cf-7430c54598af+11:15624:x1875409531703552:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 671us (870us total) trans 8589934598 rc 301/301 00000100:00100000:0.0:1788530492.176174:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 34 00000100:00100000:3.0:1788530492.179960:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530492.180117:0:18163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531703680 00000100:00100000:2.0:1788530492.180126:0:18163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531703680 00000100:00100000:2.0:1788530492.180183:0:18163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 35 00000100:00100000:2.0:1788530492.180192:0:18163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3960d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5fa0991a-e80a-4f33-96cf-7430c54598af+11:15624:x1875409531703680:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:2.0:1788530492.180223:0:18163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530492.180243:0:18163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141e00/0xb28d70e125751d9a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550d5e expref: -99 pid: 18163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.180342:0:18163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140400/0xb28d70e125751da1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.180358:0:18163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140400/0xb28d70e125751da1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.180369:0:18163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140400/0xb28d70e125751da1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788530492.180407:0:18163:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788530492.180410:0:18163:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788530492.180430:0:18163:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140400/0xb28d70e125751da1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.180480:0:18163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141e00/0xb28d70e125751d9a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550d5e expref: 13 pid: 18163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.180503:0:18163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140400/0xb28d70e125751da1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550d5e expref: 12 pid: 18163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.180514:0:18163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a9f0b171500) 00010000:00010000:2.0:1788530492.180516:0:18163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788530492.180520:0:18163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f18140400, rc 0) 00000100:00100000:2.0:1788530492.180624:0:18163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3960d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5fa0991a-e80a-4f33-96cf-7430c54598af+12:15624:x1875409531703680:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 432us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530492.180631:0:18163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 35 00000100:00100000:3.0:1788530492.187033:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530492.187192:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531703808 00000100:00100000:1.0:1788530492.187203:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531703808 00000100:00100000:1.0:1788530492.187265:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 3 00000100:00100000:1.0:1788530492.187276:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3960ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5fa0991a-e80a-4f33-96cf-7430c54598af+12:15624:x1875409531703808:12345-192.168.202.41@tcp:37:lfs.0 00000100:00100000:0.0:1788530492.195545:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3960ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5fa0991a-e80a-4f33-96cf-7430c54598af+12:15624:x1875409531703808:12345-192.168.202.41@tcp:37:lfs.0 Request processed in 8256us (8509us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530492.196520:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 3 00000100:00100000:3.0:1788530492.204124:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530492.204356:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531704064 00000100:00100000:2.0:1788530492.204367:0:17161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531704064 00000100:00100000:2.0:1788530492.204427:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 4 00000100:00100000:2.0:1788530492.204436:0:17161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f39609050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5fa0991a-e80a-4f33-96cf-7430c54598af+12:15624:x1875409531704064:12345-192.168.202.41@tcp:35:lfs.0 00000100:00100000:2.0:1788530492.204912:0:17161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f39609050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5fa0991a-e80a-4f33-96cf-7430c54598af+13:15624:x1875409531704064:12345-192.168.202.41@tcp:35:lfs.0 Request processed in 476us (798us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1788530492.204921:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 4 00000100:00100000:3.0:1788530492.275617:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530492.275795:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531704192 00000100:00100000:2.0:1788530492.275805:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531704192 00000100:00100000:2.0:1788530492.275864:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 36 00000100:00100000:2.0:1788530492.275874:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3960f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:66d42348-56b8-4977-9cd3-df6ed37388a6+11:15630:x1875409531704192:12345-192.168.202.41@tcp:101:bash.0 00010000:00010000:2.0:1788530492.275895:0:17159:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530492.275928:0:17159:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141e00/0xb28d70e125751da8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550d65 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.276040:0:17159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141400/0xb28d70e125751daf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.276055:0:17159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141400/0xb28d70e125751daf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.276066:0:17159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141400/0xb28d70e125751daf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.276078:0:17159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141a00/0xb28d70e125751db6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.276085:0:17159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141a00/0xb28d70e125751db6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.276092:0:17159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141a00/0xb28d70e125751db6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.276166:0:17159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140800/0xb28d70e125751dbd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.276175:0:17159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140800/0xb28d70e125751dbd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.276183:0:17159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140800/0xb28d70e125751dbd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788530492.276224:0:17159:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788530492.276227:0:17159:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788530492.276263:0:17159:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140800/0xb28d70e125751dbd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.276286:0:17159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141400/0xb28d70e125751daf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.276292:0:17159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141400/0xb28d70e125751daf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.276300:0:17159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141400/0xb28d70e125751daf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.276306:0:17159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f18141400 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:2.0:1788530492.276310:0:17159:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141400/0xb28d70e125751daf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.276318:0:17159:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141400/0xb28d70e125751daf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.276333:0:17159:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a9e03284b00) 00010000:00010000:2.0:1788530492.276336:0:17159:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788530492.276341:0:17159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141400/0xb28d70e125751daf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.276346:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141400/0xb28d70e125751daf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.276359:0:17159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141a00/0xb28d70e125751db6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.276365:0:17159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141a00/0xb28d70e125751db6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.276371:0:17159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141a00/0xb28d70e125751db6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.276383:0:17159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f18141a00 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:2.0:1788530492.276386:0:17159:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141a00/0xb28d70e125751db6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.276392:0:17159:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141a00/0xb28d70e125751db6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.276399:0:17159:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9a9f2b995c00) 00010000:00010000:2.0:1788530492.276401:0:17159:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788530492.276404:0:17159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141a00/0xb28d70e125751db6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.276421:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141a00/0xb28d70e125751db6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.276449:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141e00/0xb28d70e125751da8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550d65 expref: 13 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.276461:0:17159:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140800/0xb28d70e125751dbd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550d65 expref: 12 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.276468:0:17159:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a9f0b171500) 00010000:00010000:2.0:1788530492.276470:0:17159:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788530492.276472:0:17159:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f18140800, rc 0) 00000100:00100000:2.0:1788530492.276539:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3960f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:66d42348-56b8-4977-9cd3-df6ed37388a6+12:15630:x1875409531704192:12345-192.168.202.41@tcp:101:bash.0 Request processed in 666us (987us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530492.276546:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 36 00000100:00100000:3.0:1788530492.280856:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530492.281108:0:17169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531704320 00000100:00100000:0.0:1788530492.281118:0:17169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531704320 00000100:00100000:0.0:1788530492.281173:0:17169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 7 00000100:00100000:0.0:1788530492.281185:0:17169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3960e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:66d42348-56b8-4977-9cd3-df6ed37388a6+5:15630:x1875409531704320:12345-192.168.202.41@tcp:900:bash.0 00000100:00100000:0.0:1788530492.281278:0:17169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3960e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:66d42348-56b8-4977-9cd3-df6ed37388a6+5:15630:x1875409531704320:12345-192.168.202.41@tcp:900:bash.0 Request processed in 95us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530492.281286:0:17169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 7 00000100:00100000:1.0:1788530492.284668:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530492.284826:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531704576 00000100:00100000:2.0:1788530492.284848:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531704576 00000100:00100000:2.0:1788530492.284912:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 37 00000100:00100000:2.0:1788530492.284922:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:66d42348-56b8-4977-9cd3-df6ed37388a6+12:15630:x1875409531704576:12345-192.168.202.41@tcp:101:bash.0 00010000:00010000:2.0:1788530492.284953:0:17158:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530492.284974:0:17158:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140200/0xb28d70e125751dc4 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550d6c expref: -99 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.285074:0:17158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140e00/0xb28d70e125751dcb lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.285090:0:17158:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140400/0xb28d70e125751da1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550d5e expref: 12 pid: 18163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.285099:0:17158:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140e00/0xb28d70e125751dcb lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.285133:0:17158:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140400/0xb28d70e125751da1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550d5e expref: 12 pid: 18163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.285146:0:17158:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140400/0xb28d70e125751da1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550d5e expref: 12 pid: 18163 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530492.285159:0:17158:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd1880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17158:1875409555928192:192.168.202.41@tcp:104: 00000100:00100000:2.0:1788530492.285247:0:17158:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f046a9cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788530492.287645:0:17158:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd1880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17158:1875409555928192:192.168.202.41@tcp:104: 00010000:00010000:2.0:1788530492.287682:0:17158:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140e00/0xb28d70e125751dcb lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530492.289449:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530492.291187:0:20204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531704704 00000100:00100000:0.0:1788530492.291205:0:20204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531704704 00010000:00010000:0.0:1788530492.291269:0:20204:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140400/0xb28d70e125751da1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550d5e expref: 13 pid: 18163 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530492.291325:0:20204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 19 00000100:00100000:0.0:1788530492.291336:0:20204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a55f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5fa0991a-e80a-4f33-96cf-7430c54598af+13:2399:x1875409531704704:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788530492.291353:0:20204:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788530492.291359:0:20204:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140400/0xb28d70e125751da1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550d5e expref: 13 pid: 18163 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530492.291373:0:20204:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140400/0xb28d70e125751da1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550d5e expref: 13 pid: 18163 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530492.291402:0:20204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140400/0xb28d70e125751da1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550d5e expref: 13 pid: 18163 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530492.291445:0:20204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a9f0b171500) 00010000:00010000:0.0:1788530492.291451:0:20204:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140e00/0xb28d70e125751dcb lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530492.291462:0:20204:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140e00/0xb28d70e125751dcb lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530492.291470:0:20204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140e00/0xb28d70e125751dcb lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530492.291503:0:20204:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788530492.291623:0:20204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a55f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5fa0991a-e80a-4f33-96cf-7430c54598af+12:2399:x1875409531704704:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 288us (2185us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530492.291631:0:20204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 19 00010000:00010000:2.0:1788530492.292043:0:17158:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140e00/0xb28d70e125751dcb lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.292053:0:17158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140e00/0xb28d70e125751dcb lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.292082:0:17158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141e00/0xb28d70e125751dd2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.292093:0:17158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141e00/0xb28d70e125751dd2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.292102:0:17158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141e00/0xb28d70e125751dd2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.292654:0:17158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141a00/0xb28d70e125751dd9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.292665:0:17158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141a00/0xb28d70e125751dd9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.292671:0:17158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141a00/0xb28d70e125751dd9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788530492.292681:0:17158:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788530492.292706:0:17158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140e00/0xb28d70e125751dcb lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.292713:0:17158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140e00/0xb28d70e125751dcb lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.292719:0:17158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140e00/0xb28d70e125751dcb lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.292731:0:17158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f18140e00 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:2.0:1788530492.292735:0:17158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140e00/0xb28d70e125751dcb lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.292744:0:17158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140e00/0xb28d70e125751dcb lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.292755:0:17158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a9f0b171500) 00010000:00010000:2.0:1788530492.292758:0:17158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788530492.292762:0:17158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140e00/0xb28d70e125751dcb lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.292768:0:17158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140e00/0xb28d70e125751dcb lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788530492.292781:0:17158:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c0b51d0e reply state 0000000076b7432e transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141e00/0xb28d70e125751dd2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.292790:0:17158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141e00/0xb28d70e125751dd2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.292796:0:17158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9a9f2b995900) 00010000:00010000:2.0:1788530492.292798:0:17158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788530492.292800:0:17158:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788530492.292835:0:17158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140200/0xb28d70e125751dc4 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550d6c expref: 15 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.292850:0:17158:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141a00/0xb28d70e125751dd9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550d6c expref: 14 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.292868:0:17158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a9f2b995100) 00010000:00010000:2.0:1788530492.292871:0:17158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1788530492.292873:0:17158:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f18141a00, rc 0) 00000100:00100000:2.0:1788530492.293019:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:66d42348-56b8-4977-9cd3-df6ed37388a6+15:15630:x1875409531704576:12345-192.168.202.41@tcp:101:bash.0 Request processed in 8098us (8370us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1788530492.293027:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 37 00000100:00100000:1.0:1788530492.323136:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530492.323307:0:19968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531704832 00000100:00100000:3.0:1788530492.323318:0:19968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531704832 00000100:00100000:3.0:1788530492.323386:0:19968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 38 00000100:00100000:3.0:1788530492.323398:0:19968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:66d42348-56b8-4977-9cd3-df6ed37388a6+15:15630:x1875409531704832:12345-192.168.202.41@tcp:101:bash.0 00010000:00010000:3.0:1788530492.323421:0:19968:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788530492.323442:0:19968:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb400/0xb28d70e125751de7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550d73 expref: -99 pid: 19968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530492.323510:0:19968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea000/0xb28d70e125751dee lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530492.323524:0:19968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea000/0xb28d70e125751dee lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530492.323535:0:19968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea000/0xb28d70e125751dee lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788530492.323638:0:19968:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788530492.323642:0:19968:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788530492.323667:0:19968:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea000/0xb28d70e125751dee lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530492.323679:0:19968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea000/0xb28d70e125751dee lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530492.323705:0:19968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb400/0xb28d70e125751de7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550d73 expref: 17 pid: 19968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530492.323724:0:19968:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea000/0xb28d70e125751dee lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550d73 expref: 16 pid: 19968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530492.323734:0:19968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a9f2b995100) 00010000:00010000:3.0:1788530492.323737:0:19968:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788530492.323741:0:19968:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f012ea000, rc 0) 00000100:00100000:3.0:1788530492.323807:0:19968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:66d42348-56b8-4977-9cd3-df6ed37388a6+16:15630:x1875409531704832:12345-192.168.202.41@tcp:101:bash.0 Request processed in 411us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530492.323814:0:19968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 38 00000100:00100000:3.0:1788530492.330919:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530492.330995:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531705088 00000100:00100000:2.0:1788530492.331005:0:17161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531705088 00000100:00100000:2.0:1788530492.331069:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 5 00000100:00100000:2.0:1788530492.331080:0:17161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3960d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:66d42348-56b8-4977-9cd3-df6ed37388a6+16:15630:x1875409531705088:12345-192.168.202.41@tcp:35:bash.0 00000100:00100000:2.0:1788530492.331402:0:17161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3960d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:66d42348-56b8-4977-9cd3-df6ed37388a6+17:15630:x1875409531705088:12345-192.168.202.41@tcp:35:bash.0 Request processed in 322us (492us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1788530492.331410:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 5 00000100:00100000:0.0:1788530492.422891:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530492.422991:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531705344 00000100:00100000:3.0:1788530492.423004:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531705344 00000100:00100000:3.0:1788530492.423063:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 39 00000100:00100000:3.0:1788530492.423072:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66d42348-56b8-4977-9cd3-df6ed37388a6+17:15640:x1875409531705344:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:3.0:1788530492.423096:0:17160:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788530492.423116:0:17160:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb400/0xb28d70e125751df5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550d7a expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788530492.423237:0:17160:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788530492.423340:0:17160:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb400/0xb28d70e125751df5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550d7a expref: 19 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530492.423352:0:17160:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a9e03284b00) 00010000:00010000:3.0:1788530492.423354:0:17160:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788530492.423358:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012eb400/0xb28d70e125751df5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550d7a expref: 19 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530492.423369:0:17160:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f012eb400, rc 0) 00000100:00100000:3.0:1788530492.423420:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66d42348-56b8-4977-9cd3-df6ed37388a6+18:15640:x1875409531705344:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 350us (542us total) trans 8589934602 rc 301/301 00000100:00100000:3.0:1788530492.423425:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 39 00000100:00100000:3.0:1788530492.425866:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530492.425974:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531705600 00000100:00100000:2.0:1788530492.425984:0:17161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531705600 00000100:00100000:2.0:1788530492.426187:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 6 00000100:00100000:2.0:1788530492.426212:0:17161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3960fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:66d42348-56b8-4977-9cd3-df6ed37388a6+18:15640:x1875409531705600:12345-192.168.202.41@tcp:35:lfs.0 00000100:00100000:2.0:1788530492.426469:0:17161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3960fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:66d42348-56b8-4977-9cd3-df6ed37388a6+19:15640:x1875409531705600:12345-192.168.202.41@tcp:35:lfs.0 Request processed in 271us (613us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1788530492.426478:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 6 00000100:00100000:0.0:1788530492.462876:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530492.463006:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531705856 00000100:00100000:2.0:1788530492.463020:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531705856 00000100:00100000:2.0:1788530492.464488:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 40 00000100:00100000:2.0:1788530492.464506:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:66d42348-56b8-4977-9cd3-df6ed37388a6+19:15643:x1875409531705856:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:2.0:1788530492.464546:0:17158:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530492.464588:0:17158:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140200/0xb28d70e125751e03 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550d81 expref: -99 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.464715:0:17158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140e00/0xb28d70e125751e0a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.464729:0:17158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140e00/0xb28d70e125751e0a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.464741:0:17158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140e00/0xb28d70e125751e0a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788530492.464752:0:17158:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788530492.464862:0:17158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140200/0xb28d70e125751e03 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550d81 expref: 22 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.464880:0:17158:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140e00/0xb28d70e125751e0a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550d81 expref: 21 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.464889:0:17158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a9f2b995100) 00010000:00010000:2.0:1788530492.464892:0:17158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788530492.464896:0:17158:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f18140e00, rc 0) 00000100:00100000:2.0:1788530492.464974:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:66d42348-56b8-4977-9cd3-df6ed37388a6+21:15643:x1875409531705856:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 473us (2105us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1788530492.464981:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 40 00000100:00100000:3.0:1788530492.471420:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530492.471556:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531705984 00000100:00100000:2.0:1788530492.471594:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531705984 00000100:00100000:2.0:1788530492.471658:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 41 00000100:00100000:2.0:1788530492.471684:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3960e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:66d42348-56b8-4977-9cd3-df6ed37388a6+21:15643:x1875409531705984:12345-192.168.202.41@tcp:54:lfs.0 00010000:00010000:2.0:1788530492.471768:0:17159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141400/0xb28d70e125751e18 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.471785:0:17159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141400/0xb28d70e125751e18 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.471797:0:17159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141400/0xb28d70e125751e18 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.471832:0:17159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141400/0xb28d70e125751e18 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.471839:0:17159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141400/0xb28d70e125751e18 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.471845:0:17159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141400/0xb28d70e125751e18 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.471851:0:17159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f18141400 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:2.0:1788530492.471856:0:17159:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141400/0xb28d70e125751e18 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.471864:0:17159:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141400/0xb28d70e125751e18 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.471876:0:17159:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a9f2b995100) 00010000:00010000:2.0:1788530492.471879:0:17159:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788530492.471883:0:17159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141400/0xb28d70e125751e18 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.471890:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141400/0xb28d70e125751e18 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530492.471995:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3960e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:66d42348-56b8-4977-9cd3-df6ed37388a6+21:15643:x1875409531705984:12345-192.168.202.41@tcp:54:lfs.0 Request processed in 312us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530492.472003:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 41 00000100:00100000:0.0:1788530492.475094:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530492.475557:0:20205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531706112 00000100:00100000:3.0:1788530492.475595:0:20205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531706112 00000100:00100000:3.0:1788530492.475662:0:20205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 0 00000100:00100000:3.0:1788530492.475674:0:20205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f178e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66d42348-56b8-4977-9cd3-df6ed37388a6+21:2401:x1875409531706112:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788530492.475703:0:20205:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788530492.475731:0:20205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140e00/0xb28d70e125751e0a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550d81 expref: 21 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530492.475747:0:20205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a9f2b995100) 00010000:00010000:3.0:1788530492.475753:0:20205:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788530492.476051:0:20205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f178e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66d42348-56b8-4977-9cd3-df6ed37388a6+20:2401:x1875409531706112:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 378us (967us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530492.476060:0:20205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 0 00000100:00100000:0.0:1788530492.476088:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530492.476222:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531706368 00000100:00100000:2.0:1788530492.476227:0:17161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531706368 00000100:00100000:2.0:1788530492.476267:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 7 00000100:00100000:2.0:1788530492.476274:0:17161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:66d42348-56b8-4977-9cd3-df6ed37388a6+20:15643:x1875409531706368:12345-192.168.202.41@tcp:35:lfs.0 00000100:00100000:2.0:1788530492.476466:0:17161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:66d42348-56b8-4977-9cd3-df6ed37388a6+21:15643:x1875409531706368:12345-192.168.202.41@tcp:35:lfs.0 Request processed in 181us (366us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1788530492.476474:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 7 00000100:00100000:1.0:1788530492.481150:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788530492.481179:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555928320:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788530492.481625:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530492.482078:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555928320 00000100:00100000:3.0:1788530492.482090:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555928320 00000100:00100000:3.0:1788530492.482162:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788530492.482177:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555928320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788530492.482222:0:18670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788530492.482286:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555928320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530492.482294:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:2.0:1788530492.482670:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788530492.482736:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788530492.482791:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555928320:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788530492.785812:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530492.785961:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531706624 00000100:00100000:3.0:1788530492.785973:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531706624 00000100:00100000:3.0:1788530492.786061:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 42 00000100:00100000:3.0:1788530492.786075:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66d42348-56b8-4977-9cd3-df6ed37388a6+21:15674:x1875409531706624:12345-192.168.202.41@tcp:101:cat.0 00010000:00010000:3.0:1788530492.786112:0:17160:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788530492.786146:0:17160:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030c00/0xb28d70e125751e1f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550d88 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530492.786427:0:17160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031a00/0xb28d70e125751e26 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530492.786447:0:17160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031a00/0xb28d70e125751e26 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530492.786553:0:17160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031a00/0xb28d70e125751e26 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788530492.786616:0:17160:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788530492.786826:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030c00/0xb28d70e125751e1f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550d88 expref: 24 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530492.786844:0:17160:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031a00/0xb28d70e125751e26 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550d88 expref: 23 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530492.786869:0:17160:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a9f2b995100) 00010000:00010000:3.0:1788530492.786872:0:17160:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788530492.786875:0:17160:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f00031a00, rc 0) 00000100:00100000:3.0:1788530492.787004:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66d42348-56b8-4977-9cd3-df6ed37388a6+23:15674:x1875409531706624:12345-192.168.202.41@tcp:101:cat.0 Request processed in 932us (1206us total) trans 8589934606 rc 0/0 00000100:00100000:3.0:1788530492.787012:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 42 00000100:00100000:3.0:1788530492.802402:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530492.802534:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531706752 00000100:00100000:0.0:1788530492.802545:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531706752 00000100:00100000:0.0:1788530492.802693:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 1 00000100:00100000:0.0:1788530492.802707:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3960ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66d42348-56b8-4977-9cd3-df6ed37388a6+23:2400:x1875409531706752:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788530492.802727:0:17146:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788530492.802761:0:17146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00031a00/0xb28d70e125751e26 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550d88 expref: 23 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530492.802808:0:17146:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a9f2b995100) 00010000:00010000:0.0:1788530492.802814:0:17146:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788530492.802891:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3960ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66d42348-56b8-4977-9cd3-df6ed37388a6+22:2400:x1875409531706752:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 186us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530492.802899:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 1 00000100:00100000:1.0:1788530492.810696:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530492.810806:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531707008 00000100:00100000:2.0:1788530492.810819:0:17161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531707008 00000100:00100000:2.0:1788530492.810889:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 8 00000100:00100000:2.0:1788530492.810900:0:17161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:66d42348-56b8-4977-9cd3-df6ed37388a6+22:15674:x1875409531707008:12345-192.168.202.41@tcp:35:cat.0 00000100:00100000:2.0:1788530492.811292:0:17161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:66d42348-56b8-4977-9cd3-df6ed37388a6+23:15674:x1875409531707008:12345-192.168.202.41@tcp:35:cat.0 Request processed in 392us (608us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1788530492.811300:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 8 00000100:00100000:3.0:1788530492.913515:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530492.913650:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531707264 00000100:00100000:2.0:1788530492.913660:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531707264 00000100:00100000:2.0:1788530492.913734:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 43 00000100:00100000:2.0:1788530492.913744:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3960f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:66d42348-56b8-4977-9cd3-df6ed37388a6+23:15680:x1875409531707264:12345-192.168.202.41@tcp:101:dd.0 00010000:00010000:2.0:1788530492.913775:0:17158:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530492.913796:0:17158:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141400/0xb28d70e125751e34 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550d8f expref: -99 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.913958:0:17158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140200/0xb28d70e125751e3b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.913973:0:17158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140200/0xb28d70e125751e3b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.913984:0:17158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140200/0xb28d70e125751e3b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788530492.913996:0:17158:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788530492.914121:0:17158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141400/0xb28d70e125751e34 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550d8f expref: 26 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.914139:0:17158:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140200/0xb28d70e125751e3b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550d8f expref: 25 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530492.914147:0:17158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a9f2b995100) 00010000:00010000:2.0:1788530492.914149:0:17158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788530492.914153:0:17158:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f18140200, rc 0) 00000100:00100000:2.0:1788530492.914282:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3960f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:66d42348-56b8-4977-9cd3-df6ed37388a6+25:15680:x1875409531707264:12345-192.168.202.41@tcp:101:dd.0 Request processed in 539us (777us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1788530492.914288:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 43 00000100:00100000:3.0:1788530492.919660:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530492.922437:0:18163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531707392 00000100:00100000:0.0:1788530492.922467:0:18163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531707392 00000100:00100000:0.0:1788530492.922551:0:18163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 44 00000100:00100000:0.0:1788530492.922613:0:18163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3960d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66d42348-56b8-4977-9cd3-df6ed37388a6+25:15680:x1875409531707392:12345-192.168.202.41@tcp:101:dd.0 00010000:00010000:0.0:1788530492.922642:0:18163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530492.922669:0:18163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a2200/0xb28d70e125751e49 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550d96 expref: -99 pid: 18163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530492.922713:0:18163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3000/0xb28d70e125751e50 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 18163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530492.922730:0:18163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3000/0xb28d70e125751e50 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530492.922742:0:18163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3000/0xb28d70e125751e50 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530492.922897:0:18163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a2200/0xb28d70e125751e49 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550d96 expref: 27 pid: 18163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530492.922919:0:18163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3000/0xb28d70e125751e50 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550d96 expref: 26 pid: 18163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530492.922951:0:18163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a9f2b995100) 00010000:00010000:0.0:1788530492.922954:0:18163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788530492.922958:0:18163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9e010a3000, rc 0) 00000100:00100000:0.0:1788530492.923041:0:18163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3960d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66d42348-56b8-4977-9cd3-df6ed37388a6+26:15680:x1875409531707392:12345-192.168.202.41@tcp:101:dd.0 Request processed in 479us (3406us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530492.923048:0:18163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 44 00000100:00100000:3.0:1788530492.929117:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530492.930446:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531707520 00000100:00100000:0.0:1788530492.930461:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531707520 00000100:00100000:0.0:1788530492.930528:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 2 00000100:00100000:0.0:1788530492.930538:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3960f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66d42348-56b8-4977-9cd3-df6ed37388a6+26:2401:x1875409531707520:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788530492.930551:0:17145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788530492.930591:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140200/0xb28d70e125751e3b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550d8f expref: 26 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530492.930610:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a9f2b995100) 00010000:00010000:0.0:1788530492.930616:0:17145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788530492.930677:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3960f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66d42348-56b8-4977-9cd3-df6ed37388a6+25:2401:x1875409531707520:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 140us (1570us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530492.930684:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 2 00000100:00100000:3.0:1788530492.937128:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530492.937215:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531707776 00000100:00100000:0.0:1788530492.937226:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531707776 00000100:00100000:0.0:1788530492.937287:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 45 00000100:00100000:0.0:1788530492.937297:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3960dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66d42348-56b8-4977-9cd3-df6ed37388a6+25:15680:x1875409531707776:12345-192.168.202.41@tcp:36:dd.0 00010000:00010000:0.0:1788530492.937353:0:17160:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788530492.937380:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ea000/0xb28d70e125751dee lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550d73 expref: 25 pid: 19968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530492.937415:0:17160:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a9f2b995100) 00010000:00010000:0.0:1788530492.937419:0:17160:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788530492.937608:0:17160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a2200/0xb28d70e125751e57 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530492.937622:0:17160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a2200/0xb28d70e125751e57 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530492.937632:0:17160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a2200/0xb28d70e125751e57 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788530492.937674:0:17160:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:0.0:1788530492.937698:0:17160:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e332c801 reply state 000000004efc6db4 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a2200/0xb28d70e125751e57 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530492.937710:0:17160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a2200/0xb28d70e125751e57 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530492.937716:0:17160:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a9f2b995100) 00010000:00010000:0.0:1788530492.937718:0:17160:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788530492.937721:0:17160:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788530492.937815:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3960dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66d42348-56b8-4977-9cd3-df6ed37388a6+27:15680:x1875409531707776:12345-192.168.202.41@tcp:36:dd.0 Request processed in 517us (694us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1788530492.937821:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 45 00000020:00080000:0.0:1788530492.937826:0:17160:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788530493.048871:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530493.052450:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531708032 00000100:00100000:2.0:1788530493.052615:0:17161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531708032 00000100:00100000:2.0:1788530493.052812:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 9 00000100:00100000:2.0:1788530493.052827:0:17161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:66d42348-56b8-4977-9cd3-df6ed37388a6+27:15680:x1875409531708032:12345-192.168.202.41@tcp:35:dd.0 00000100:00100000:2.0:1788530493.053077:0:17161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:66d42348-56b8-4977-9cd3-df6ed37388a6+28:15680:x1875409531708032:12345-192.168.202.41@tcp:35:dd.0 Request processed in 255us (4216us total) trans 8589934611 rc 0/0 00000100:00100000:2.0:1788530493.053101:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 9 00000100:00080000:3.0:1788530493.053798:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788530493.382616:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530493.386028:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531708160 00000100:00100000:2.0:1788530493.386048:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531708160 00000100:00100000:2.0:1788530493.386141:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 46 00000100:00100000:2.0:1788530493.386152:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:66d42348-56b8-4977-9cd3-df6ed37388a6+28:15694:x1875409531708160:12345-192.168.202.41@tcp:101:stat.0 00010000:00010000:2.0:1788530493.386178:0:17158:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530493.386200:0:17158:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141400/0xb28d70e125751e5e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550d9d expref: -99 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530493.386264:0:17158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141600/0xb28d70e125751e65 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530493.386280:0:17158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141600/0xb28d70e125751e65 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530493.386293:0:17158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141600/0xb28d70e125751e65 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530493.386306:0:17158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141800/0xb28d70e125751e6c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530493.386313:0:17158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141800/0xb28d70e125751e6c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530493.386320:0:17158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141800/0xb28d70e125751e6c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530493.386395:0:17158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140200/0xb28d70e125751e73 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530493.386425:0:17158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140200/0xb28d70e125751e73 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530493.386432:0:17158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140200/0xb28d70e125751e73 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788530493.386480:0:17158:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788530493.386485:0:17158:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788530493.386525:0:17158:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140200/0xb28d70e125751e73 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530493.386538:0:17158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140200/0xb28d70e125751e73 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530493.386546:0:17158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141600/0xb28d70e125751e65 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530493.386552:0:17158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141600/0xb28d70e125751e65 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530493.386616:0:17158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141600/0xb28d70e125751e65 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530493.386624:0:17158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f18141600 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:2.0:1788530493.386628:0:17158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141600/0xb28d70e125751e65 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530493.386636:0:17158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141600/0xb28d70e125751e65 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530493.386648:0:17158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a9f0b171500) 00010000:00010000:2.0:1788530493.386658:0:17158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788530493.386664:0:17158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141600/0xb28d70e125751e65 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530493.386671:0:17158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141600/0xb28d70e125751e65 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530493.386688:0:17158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141800/0xb28d70e125751e6c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530493.386694:0:17158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141800/0xb28d70e125751e6c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530493.386701:0:17158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141800/0xb28d70e125751e6c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530493.386706:0:17158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f18141800 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:2.0:1788530493.386709:0:17158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141800/0xb28d70e125751e6c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530493.386715:0:17158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141800/0xb28d70e125751e6c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530493.386723:0:17158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9a9f2b995900) 00010000:00010000:2.0:1788530493.386725:0:17158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788530493.386728:0:17158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141800/0xb28d70e125751e6c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530493.386734:0:17158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141800/0xb28d70e125751e6c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530493.386762:0:17158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141400/0xb28d70e125751e5e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550d9d expref: 30 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530493.386790:0:17158:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140200/0xb28d70e125751e73 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550d9d expref: 29 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530493.386798:0:17158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a9f2b995100) 00010000:00010000:2.0:1788530493.386801:0:17158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788530493.386804:0:17158:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f18140200, rc 0) 00000100:00100000:2.0:1788530493.387109:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:66d42348-56b8-4977-9cd3-df6ed37388a6+29:15694:x1875409531708160:12345-192.168.202.41@tcp:101:stat.0 Request processed in 957us (4545us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530493.387117:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 46 00010000:00010000:0.0:1788530493.505238:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788530493.558986:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530493.560390:0:18163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531708416 00000100:00100000:0.0:1788530493.560405:0:18163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531708416 00000100:00100000:0.0:1788530493.560500:0:18163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 47 00000100:00100000:0.0:1788530493.560512:0:18163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3960c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66d42348-56b8-4977-9cd3-df6ed37388a6+29:15700:x1875409531708416:12345-192.168.202.41@tcp:36:truncate.0 00010000:00010000:0.0:1788530493.560623:0:18163:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788530493.560652:0:18163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140200/0xb28d70e125751e73 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550d9d expref: 29 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530493.560675:0:18163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a9f2b995100) 00010000:00010000:0.0:1788530493.560680:0:18163:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788530493.560862:0:18163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3200/0xb28d70e125751e7a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530493.560875:0:18163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3200/0xb28d70e125751e7a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530493.560884:0:18163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3200/0xb28d70e125751e7a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18163 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788530493.560946:0:18163:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934612 00000004:00010000:0.0:1788530493.560970:0:18163:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f52be136 reply state 00000000ec6cd366 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3200/0xb28d70e125751e7a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530493.560982:0:18163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3200/0xb28d70e125751e7a lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530493.560989:0:18163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a9f2b995100) 00010000:00010000:0.0:1788530493.560991:0:18163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788530493.560994:0:18163:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788530493.561125:0:18163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3960c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66d42348-56b8-4977-9cd3-df6ed37388a6+31:15700:x1875409531708416:12345-192.168.202.41@tcp:36:truncate.0 Request processed in 615us (2301us total) trans 8589934613 rc 0/0 00000100:00100000:0.0:1788530493.561133:0:18163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 47 00000020:00080000:0.0:1788530493.561144:0:18163:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788530493.873545:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530493.873717:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531708544 00000100:00100000:2.0:1788530493.873729:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531708544 00000100:00100000:2.0:1788530493.873789:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 48 00000100:00100000:2.0:1788530493.873800:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f32a55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:66d42348-56b8-4977-9cd3-df6ed37388a6+31:15714:x1875409531708544:12345-192.168.202.41@tcp:101:stat.0 00010000:00010000:2.0:1788530493.873823:0:17159:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530493.874177:0:17159:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141400/0xb28d70e125751e81 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550da4 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530493.875131:0:17159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141800/0xb28d70e125751e88 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530493.876296:0:17159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141800/0xb28d70e125751e88 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530493.876314:0:17159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141800/0xb28d70e125751e88 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530493.876343:0:17159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141600/0xb28d70e125751e8f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530493.876374:0:17159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141600/0xb28d70e125751e8f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530493.876382:0:17159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141600/0xb28d70e125751e8f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530493.876508:0:17159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140e00/0xb28d70e125751e96 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530493.876519:0:17159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140e00/0xb28d70e125751e96 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530493.876527:0:17159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140e00/0xb28d70e125751e96 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788530493.876607:0:17159:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:2.0:1788530493.876612:0:17159:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788530493.876635:0:17159:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140e00/0xb28d70e125751e96 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530493.876648:0:17159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140e00/0xb28d70e125751e96 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530493.876657:0:17159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141800/0xb28d70e125751e88 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530493.876664:0:17159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141800/0xb28d70e125751e88 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530493.876670:0:17159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141800/0xb28d70e125751e88 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530493.876686:0:17159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f18141800 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:2.0:1788530493.876691:0:17159:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141800/0xb28d70e125751e88 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530493.876701:0:17159:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141800/0xb28d70e125751e88 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530493.876713:0:17159:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a9f0b171500) 00010000:00010000:2.0:1788530493.876717:0:17159:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788530493.876721:0:17159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141800/0xb28d70e125751e88 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530493.876728:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141800/0xb28d70e125751e88 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530493.876742:0:17159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141600/0xb28d70e125751e8f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530493.876749:0:17159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141600/0xb28d70e125751e8f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530493.876755:0:17159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141600/0xb28d70e125751e8f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530493.876760:0:17159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f18141600 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:2.0:1788530493.876763:0:17159:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141600/0xb28d70e125751e8f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530493.876769:0:17159:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141600/0xb28d70e125751e8f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530493.876787:0:17159:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9a9f2b995900) 00010000:00010000:2.0:1788530493.876789:0:17159:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788530493.876792:0:17159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141600/0xb28d70e125751e8f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530493.876798:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141600/0xb28d70e125751e8f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530493.876834:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141400/0xb28d70e125751e81 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550da4 expref: 33 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530493.876848:0:17159:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140e00/0xb28d70e125751e96 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550da4 expref: 32 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530493.876855:0:17159:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a9f2b995100) 00010000:00010000:2.0:1788530493.876858:0:17159:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788530493.876860:0:17159:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f18140e00, rc 0) 00000100:00100000:2.0:1788530493.876953:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f32a55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:66d42348-56b8-4977-9cd3-df6ed37388a6+32:15714:x1875409531708544:12345-192.168.202.41@tcp:101:stat.0 Request processed in 3153us (3421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530493.876962:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 48 00000100:00100000:1.0:1788530493.970258:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530493.970381:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531708800 00000100:00100000:2.0:1788530493.970389:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531708800 00000100:00100000:2.0:1788530493.970439:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 49 00000100:00100000:2.0:1788530493.970446:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:66d42348-56b8-4977-9cd3-df6ed37388a6+32:15724:x1875409531708800:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:2.0:1788530493.970473:0:17158:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530493.970493:0:17158:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141400/0xb28d70e125751e9d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550dab expref: -99 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788530493.970655:0:17158:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788530493.970737:0:17158:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141400/0xb28d70e125751e9d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550dab expref: 34 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530493.970757:0:17158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a9e03284b00) 00010000:00010000:2.0:1788530493.970760:0:17158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788530493.970764:0:17158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141400/0xb28d70e125751e9d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550dab expref: 34 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530493.970774:0:17158:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f18141400, rc 0) 00000100:00100000:2.0:1788530493.970822:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:66d42348-56b8-4977-9cd3-df6ed37388a6+33:15724:x1875409531708800:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 376us (573us total) trans 8589934614 rc 301/301 00000100:00100000:2.0:1788530493.970827:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 49 00000100:00100000:3.0:1788530493.978808:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530493.978866:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531709056 00000100:00100000:2.0:1788530493.978876:0:17161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531709056 00000100:00100000:2.0:1788530493.978975:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 10 00000100:00100000:2.0:1788530493.978983:0:17161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f39608450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:66d42348-56b8-4977-9cd3-df6ed37388a6+33:15724:x1875409531709056:12345-192.168.202.41@tcp:35:lfs.0 00000100:00100000:2.0:1788530493.979242:0:17161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f39608450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:66d42348-56b8-4977-9cd3-df6ed37388a6+34:15724:x1875409531709056:12345-192.168.202.41@tcp:35:lfs.0 Request processed in 258us (441us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1788530493.979251:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 10 00000100:00100000:1.0:1788530494.071701:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530494.071902:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531709312 00000100:00100000:3.0:1788530494.071953:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531709312 00000100:00100000:3.0:1788530494.072036:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 50 00000100:00100000:3.0:1788530494.072049:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e027d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66d42348-56b8-4977-9cd3-df6ed37388a6+34:15730:x1875409531709312:12345-192.168.202.41@tcp:101:bash.0 00010000:00010000:3.0:1788530494.072083:0:17160:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788530494.072106:0:17160:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030a00/0xb28d70e125751eab lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550db2 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530494.072277:0:17160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030c00/0xb28d70e125751eb2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530494.072294:0:17160:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141a00/0xb28d70e125751dd9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550d6c expref: 35 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530494.072308:0:17160:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140e00/0xb28d70e125751e96 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550da4 expref: 35 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530494.072319:0:17160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030c00/0xb28d70e125751eb2 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530494.072368:0:17160:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140e00/0xb28d70e125751e96 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550da4 expref: 35 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530494.072384:0:17160:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140e00/0xb28d70e125751e96 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550da4 expref: 35 pid: 17159 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530494.072400:0:17160:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3960ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17160:1875409555928448:192.168.202.41@tcp:104: 00010000:00010000:3.0:1788530494.072524:0:17160:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141a00/0xb28d70e125751dd9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550d6c expref: 35 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530494.072534:0:17160:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141a00/0xb28d70e125751dd9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550d6c expref: 35 pid: 17158 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530494.072543:0:17160:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3960d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17160:1875409555928576:192.168.202.41@tcp:104: 00000100:00100000:3.0:1788530494.072629:0:17160:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f32a53b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788530494.074708:0:17160:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3960ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17160:1875409555928448:192.168.202.41@tcp:104: 00000100:00100000:3.0:1788530494.074847:0:17160:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3960d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17160:1875409555928576:192.168.202.41@tcp:104: 00010000:00010000:3.0:1788530494.074879:0:17160:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030c00/0xb28d70e125751eb2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530494.075482:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530494.075840:0:20205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531709440 00000100:00100000:2.0:1788530494.075848:0:20205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531709440 00010000:00010000:2.0:1788530494.075888:0:20205:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140e00/0xb28d70e125751e96 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550da4 expref: 36 pid: 17159 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530494.075937:0:20205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 20 00000100:00100000:2.0:1788530494.075959:0:20205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f06272300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66d42348-56b8-4977-9cd3-df6ed37388a6+36:2399:x1875409531709440:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788530494.075974:0:20205:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788530494.075982:0:20205:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140e00/0xb28d70e125751e96 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550da4 expref: 36 pid: 17159 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530494.075993:0:20205:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140e00/0xb28d70e125751e96 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550da4 expref: 36 pid: 17159 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530494.076016:0:20205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140e00/0xb28d70e125751e96 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550da4 expref: 36 pid: 17159 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530494.076032:0:20205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a9f2b995100) 00010000:00010000:2.0:1788530494.076036:0:20205:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030c00/0xb28d70e125751eb2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530494.076055:0:20205:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030c00/0xb28d70e125751eb2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530494.076062:0:20205:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788530494.076114:0:20205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f06272300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66d42348-56b8-4977-9cd3-df6ed37388a6+35:2399:x1875409531709440:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 157us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530494.076122:0:20205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 20 00000100:00100000:3.0:1788530494.076350:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530494.076509:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531709568 00000100:00100000:0.0:1788530494.076515:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531709568 00010000:00010000:0.0:1788530494.076534:0:17146:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141a00/0xb28d70e125751dd9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550d6c expref: 35 pid: 17158 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530494.076596:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 21 00000100:00100000:0.0:1788530494.076605:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3960d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66d42348-56b8-4977-9cd3-df6ed37388a6+35:2399:x1875409531709568:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788530494.076614:0:17146:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788530494.076620:0:17146:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141a00/0xb28d70e125751dd9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550d6c expref: 35 pid: 17158 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530494.076629:0:17146:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141a00/0xb28d70e125751dd9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550d6c expref: 35 pid: 17158 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530494.076643:0:17146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141a00/0xb28d70e125751dd9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550d6c expref: 35 pid: 17158 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530494.076872:0:17146:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a9f2b995100) 00010000:00010000:0.0:1788530494.076878:0:17146:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030c00/0xb28d70e125751eb2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530494.076888:0:17146:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030c00/0xb28d70e125751eb2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530494.076895:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030c00/0xb28d70e125751eb2 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530494.076934:0:17146:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788530494.076971:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3960d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66d42348-56b8-4977-9cd3-df6ed37388a6+34:2399:x1875409531709568:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 367us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530494.076990:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 21 00010000:00010000:3.0:1788530494.077673:0:17160:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030c00/0xb28d70e125751eb2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530494.077683:0:17160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030c00/0xb28d70e125751eb2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788530494.077702:0:17160:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:3.0:1788530494.077841:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030a00/0xb28d70e125751eab lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550db2 expref: 35 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530494.077941:0:17160:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030c00/0xb28d70e125751eb2 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550db2 expref: 34 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530494.077950:0:17160:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a9f2b995100) 00010000:00010000:3.0:1788530494.077953:0:17160:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788530494.077956:0:17160:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f00030c00, rc 0) 00000100:00100000:3.0:1788530494.077994:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e027d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66d42348-56b8-4977-9cd3-df6ed37388a6+34:15730:x1875409531709312:12345-192.168.202.41@tcp:101:bash.0 Request processed in 5948us (6302us total) trans 8589934616 rc 0/0 00000100:00100000:3.0:1788530494.078002:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 50 00000100:00100000:1.0:1788530494.081097:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530494.081237:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531709824 00000100:00100000:2.0:1788530494.081250:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531709824 00000100:00100000:2.0:1788530494.081317:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 51 00000100:00100000:2.0:1788530494.081329:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f06271180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:66d42348-56b8-4977-9cd3-df6ed37388a6+34:15730:x1875409531709824:12345-192.168.202.41@tcp:36:bash.0 00010000:00010000:2.0:1788530494.081634:0:17159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141400/0xb28d70e125751ec0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530494.081680:0:17159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141400/0xb28d70e125751ec0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530494.081693:0:17159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141400/0xb28d70e125751ec0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788530494.081755:0:17159:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000004:00010000:2.0:1788530494.081776:0:17159:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000053f1f566 reply state 000000007ddee9e3 transno 8589934618 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141400/0xb28d70e125751ec0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530494.081789:0:17159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141400/0xb28d70e125751ec0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530494.081797:0:17159:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a9f2b995100) 00010000:00010000:2.0:1788530494.081801:0:17159:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788530494.081806:0:17159:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788530494.081932:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f06271180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:66d42348-56b8-4977-9cd3-df6ed37388a6+37:15730:x1875409531709824:12345-192.168.202.41@tcp:36:bash.0 Request processed in 604us (843us total) trans 8589934618 rc 0/0 00000100:00100000:2.0:1788530494.081939:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 51 00000020:00080000:2.0:1788530494.081945:0:17159:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788530494.087057:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530494.087139:0:18163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531709952 00000100:00100000:0.0:1788530494.087152:0:18163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531709952 00000100:00100000:0.0:1788530494.087224:0:18163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 52 00000100:00100000:0.0:1788530494.087237:0:18163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66d42348-56b8-4977-9cd3-df6ed37388a6+37:15730:x1875409531709952:12345-192.168.202.41@tcp:101:bash.0 00010000:00010000:0.0:1788530494.087269:0:18163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530494.087292:0:18163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3400/0xb28d70e125751ec7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550db9 expref: -99 pid: 18163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530494.087352:0:18163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3400/0xb28d70e125751ec7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550db9 expref: 38 pid: 18163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530494.087367:0:18163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3400/0xb28d70e125751ec7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550db9 expref: 38 pid: 18163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530494.087386:0:18163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a9f2b995100) 00010000:00010000:0.0:1788530494.087389:0:18163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788530494.087393:0:18163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9e010a3400, rc 0) 00000100:00100000:0.0:1788530494.087452:0:18163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66d42348-56b8-4977-9cd3-df6ed37388a6+38:15730:x1875409531709952:12345-192.168.202.41@tcp:101:bash.0 Request processed in 218us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530494.087460:0:18163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 52 00000100:00100000:0.0:1788530494.093140:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530494.093240:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531710080 00000100:00100000:3.0:1788530494.093253:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531710080 00000100:00100000:3.0:1788530494.093321:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 53 00000100:00100000:3.0:1788530494.093333:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66d42348-56b8-4977-9cd3-df6ed37388a6+38:15730:x1875409531710080:12345-192.168.202.41@tcp:101:bash.0 00010000:00010000:3.0:1788530494.093359:0:17160:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788530494.093387:0:17160:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030a00/0xb28d70e125751ece lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550dc0 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530494.093504:0:17160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030200/0xb28d70e125751ed5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530494.093520:0:17160:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030c00/0xb28d70e125751eb2 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550db2 expref: 39 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530494.093529:0:17160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030200/0xb28d70e125751ed5 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530494.093953:0:17160:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030c00/0xb28d70e125751eb2 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550db2 expref: 39 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530494.093968:0:17160:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030c00/0xb28d70e125751eb2 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550db2 expref: 39 pid: 17160 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530494.093982:0:17160:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f3960ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17160:1875409555928704:192.168.202.41@tcp:104: 00000100:00100000:3.0:1788530494.094729:0:17160:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f32a53480 going to sleep for 11 seconds 00000100:00100000:1.0:1788530494.103050:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530494.103174:0:17160:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f3960ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17160:1875409555928704:192.168.202.41@tcp:104: 00010000:00010000:3.0:1788530494.103211:0:17160:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030200/0xb28d70e125751ed5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530494.103328:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531710208 00000100:00100000:2.0:1788530494.103335:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531710208 00010000:00010000:2.0:1788530494.103375:0:17144:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030c00/0xb28d70e125751eb2 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550db2 expref: 40 pid: 17160 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530494.103421:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 22 00000100:00100000:2.0:1788530494.103430:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66d42348-56b8-4977-9cd3-df6ed37388a6+40:2400:x1875409531710208:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788530494.103445:0:17144:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788530494.103453:0:17144:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030c00/0xb28d70e125751eb2 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550db2 expref: 40 pid: 17160 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530494.103471:0:17144:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030c00/0xb28d70e125751eb2 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550db2 expref: 40 pid: 17160 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530494.103498:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030c00/0xb28d70e125751eb2 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550db2 expref: 40 pid: 17160 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530494.103514:0:17144:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a9f2b995100) 00010000:00010000:2.0:1788530494.103519:0:17144:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030200/0xb28d70e125751ed5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530494.103529:0:17144:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030200/0xb28d70e125751ed5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530494.103537:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030200/0xb28d70e125751ed5 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530494.103608:0:17144:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788530494.103669:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66d42348-56b8-4977-9cd3-df6ed37388a6+39:2400:x1875409531710208:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 239us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530494.103678:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 22 00010000:00010000:3.0:1788530494.106036:0:17160:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030200/0xb28d70e125751ed5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530494.106054:0:17160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030200/0xb28d70e125751ed5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788530494.106117:0:17160:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788530494.106141:0:17160:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788530494.106170:0:17160:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030200/0xb28d70e125751ed5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530494.106281:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030a00/0xb28d70e125751ece lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550dc0 expref: 39 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530494.106302:0:17160:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030200/0xb28d70e125751ed5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550dc0 expref: 38 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530494.106311:0:17160:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a9f2b995100) 00010000:00010000:3.0:1788530494.106314:0:17160:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788530494.106317:0:17160:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f00030200, rc 0) 00000100:00100000:3.0:1788530494.106453:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66d42348-56b8-4977-9cd3-df6ed37388a6+38:15730:x1875409531710080:12345-192.168.202.41@tcp:101:bash.0 Request processed in 13121us (13323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530494.106462:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 53 00000100:00100000:1.0:1788530494.112380:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530494.114015:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531710464 00000100:00100000:3.0:1788530494.114030:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531710464 00000100:00100000:2.0:1788530494.114610:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 3 00000100:00100000:2.0:1788530494.114624:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66d42348-56b8-4977-9cd3-df6ed37388a6+38:15730:x1875409531710464:12345-192.168.202.41@tcp:103:bash.0 00010000:00010000:2.0:1788530494.114651:0:17145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788530494.114685:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3400/0xb28d70e125751ec7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550db9 expref: 38 pid: 18163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530494.114708:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030200/0xb28d70e125751ed5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550dc0 expref: 37 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530494.114733:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a9f2b995100) 00010000:00010000:2.0:1788530494.114737:0:17145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788530494.114802:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66d42348-56b8-4977-9cd3-df6ed37388a6+36:15730:x1875409531710464:12345-192.168.202.41@tcp:103:bash.0 Request processed in 181us (2437us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530494.114810:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 3 00000100:00100000:1.0:1788530494.117720:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530494.117907:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531710592 00000100:00100000:3.0:1788530494.117926:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531710592 00000100:00100000:3.0:1788530494.117979:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 54 00000100:00100000:3.0:1788530494.117988:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:66d42348-56b8-4977-9cd3-df6ed37388a6+36:15730:x1875409531710592:12345-192.168.202.41@tcp:58:bash.0 00010000:00010000:3.0:1788530494.118112:0:17158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030e00/0xb28d70e125751edc lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530494.118129:0:17158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030e00/0xb28d70e125751edc lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530494.118139:0:17158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030e00/0xb28d70e125751edc lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788530494.119903:0:17158:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788530494.120536:0:17158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:3.0:1788530494.120948:0:17158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:3.0:1788530494.121090:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:66d42348-56b8-4977-9cd3-df6ed37388a6+36:15730:x1875409531710592:12345-192.168.202.41@tcp:58:bash.0 Request processed in 3096us (3372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530494.121102:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 54 00000100:00100000:3.0:1788530494.123966:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530494.124085:0:19968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531710720 00000100:00100000:2.0:1788530494.124095:0:19968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531710720 00000100:00100000:2.0:1788530494.124173:0:19968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 55 00000100:00100000:2.0:1788530494.124194:0:19968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3960ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:66d42348-56b8-4977-9cd3-df6ed37388a6+36:15730:x1875409531710720:12345-192.168.202.41@tcp:101:bash.0 00010000:00010000:2.0:1788530494.124215:0:19968:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530494.124238:0:19968:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141600/0xb28d70e125751ee3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550dc7 expref: -99 pid: 19968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530494.124298:0:19968:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030e00/0xb28d70e125751edc lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530494.124322:0:19968:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141600/0xb28d70e125751ee3 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550dc7 expref: 37 pid: 19968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530494.124344:0:19968:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030e00/0xb28d70e125751edc lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530494.124357:0:19968:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141600/0xb28d70e125751ee3 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550dc7 expref: 37 pid: 19968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530494.124592:0:19968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a9f2b995100) 00010000:00010000:2.0:1788530494.124608:0:19968:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788530494.124612:0:19968:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141600/0xb28d70e125751ee3 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550dc7 expref: 37 pid: 19968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530494.124620:0:19968:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f18141600, rc 0) 00000100:00100000:2.0:1788530494.124681:0:19968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3960ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:66d42348-56b8-4977-9cd3-df6ed37388a6+37:15730:x1875409531710720:12345-192.168.202.41@tcp:101:bash.0 Request processed in 497us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530494.124688:0:19968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 55 00000100:00100000:1.0:1788530494.439973:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530494.440014:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530494.440052:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530494.440070:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530494.440086:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530494.440107:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530494.440124:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530494.440173:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530494.440214:0:18163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531711360 00000100:00100000:1.0:1788530494.440225:0:18163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531711360 00000100:00100000:1.0:1788530494.440292:0:18163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531710976 00000100:00100000:1.0:1788530494.440296:0:18163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531710976 00000100:00100000:1.0:1788530494.440325:0:18163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531711488 00000100:00100000:1.0:1788530494.440328:0:18163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531711488 00000100:00100000:1.0:1788530494.440345:0:18163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 75 00000100:00100000:1.0:1788530494.440355:0:18163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5fa0991a-e80a-4f33-96cf-7430c54598af+12:2400:x1875409531711360:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1788530494.440446:0:18163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5fa0991a-e80a-4f33-96cf-7430c54598af+12:2400:x1875409531711360:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 92us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530494.440454:0:18163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 75 00000100:00100000:1.0:1788530494.440470:0:18163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 76 00000100:00100000:1.0:1788530494.440478:0:18163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66d42348-56b8-4977-9cd3-df6ed37388a6+5:2400:x1875409531710976:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1788530494.440504:0:18163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66d42348-56b8-4977-9cd3-df6ed37388a6+5:2400:x1875409531710976:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 27us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530494.440510:0:18163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 76 00000100:00100000:1.0:1788530494.440522:0:18163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 77 00000100:00100000:1.0:1788530494.440539:0:18163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5fa0991a-e80a-4f33-96cf-7430c54598af+5:2400:x1875409531711488:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:1.0:1788530494.440606:0:18163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5fa0991a-e80a-4f33-96cf-7430c54598af+5:2400:x1875409531711488:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 67us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530494.440612:0:18163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 77 00000100:00080000:1.0:1788530494.440630:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788530494.440920:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788530494.441098:0:18666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531711104 00000100:00100000:2.0:1788530494.441104:0:18666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531711104 00000100:00100000:2.0:1788530494.441146:0:18666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531711616 00000100:00100000:2.0:1788530494.441149:0:18666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531711616 00000100:00100000:2.0:1788530494.441165:0:18666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531711232 00000100:00100000:2.0:1788530494.441167:0:18666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531711232 00000100:00100000:2.0:1788530494.441190:0:18666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531711744 00000100:00100000:2.0:1788530494.441193:0:18666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531711744 00000100:00100000:2.0:1788530494.441207:0:18666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 27 00000100:00100000:2.0:1788530494.441214:0:18666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3d2b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66d42348-56b8-4977-9cd3-df6ed37388a6+5:2400:x1875409531711104:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1788530494.441246:0:18666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3d2b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66d42348-56b8-4977-9cd3-df6ed37388a6+5:2400:x1875409531711104:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 33us (1232us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530494.441252:0:18666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 27 00000100:00100000:2.0:1788530494.441265:0:18666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 28 00000100:00100000:2.0:1788530494.441271:0:18666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5fa0991a-e80a-4f33-96cf-7430c54598af+5:2400:x1875409531711616:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1788530494.441292:0:18666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5fa0991a-e80a-4f33-96cf-7430c54598af+5:2400:x1875409531711616:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 21us (1221us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530494.441299:0:18666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 28 00000100:00100000:2.0:1788530494.441323:0:18666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 29 00000100:00100000:2.0:1788530494.441341:0:18666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66d42348-56b8-4977-9cd3-df6ed37388a6+5:2400:x1875409531711232:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1788530494.441367:0:18666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66d42348-56b8-4977-9cd3-df6ed37388a6+5:2400:x1875409531711232:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 28us (1259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530494.441373:0:18666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 29 00000100:00100000:2.0:1788530494.441384:0:18666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 30 00000100:00100000:2.0:1788530494.441390:0:18666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5fa0991a-e80a-4f33-96cf-7430c54598af+5:2400:x1875409531711744:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:2.0:1788530494.441411:0:18666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5fa0991a-e80a-4f33-96cf-7430c54598af+5:2400:x1875409531711744:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 21us (1239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530494.441431:0:18666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 30 00000100:00100000:0.0:1788530494.442035:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531710848 00000100:00100000:0.0:1788530494.442044:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531710848 00000100:00100000:0.0:1788530494.442099:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 196 00000100:00100000:0.0:1788530494.442106:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fc207521-3937-4a55-9052-ed3c297904d3+14:2400:x1875409531710848:12345-192.168.202.41@tcp:400:kworker.0 00000100:00100000:0.0:1788530494.442154:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fc207521-3937-4a55-9052-ed3c297904d3+14:2400:x1875409531710848:12345-192.168.202.41@tcp:400:kworker.0 Request processed in 49us (2193us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530494.442160:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 196 00000100:00080000:1.0:1788530494.443808:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788530494.443817:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788530494.529181:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555929216:0@lo:400:kworker.0 00000100:00100000:2.0:1788530494.529286:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530494.529331:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555929728:0@lo:400:kworker.0 00000100:00100000:2.0:1788530494.529351:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530494.529418:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555928960:0@lo:400:kworker.0 00000100:00100000:2.0:1788530494.529444:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03c5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875409555930240:0@lo:400:kworker.0 00000100:00100000:3.0:1788530494.529465:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530494.529480:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530494.529498:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555929472:0@lo:400:kworker.0 00000100:00100000:2.0:1788530494.529515:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788530494.529524:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555929088:0@lo:400:kworker.0 00000100:00100000:3.0:1788530494.529530:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530494.529552:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530494.529595:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555929600:0@lo:400:kworker.0 00000100:00100000:2.0:1788530494.529614:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530494.529630:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32a55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875409555930112:0@lo:400:kworker.0 00000100:00100000:2.0:1788530494.529648:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530494.529679:0:18667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555929216 00000100:00100000:2.0:1788530494.529688:0:18667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555929216 00000100:00100000:1.0:1788530494.529832:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555930624:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788530494.529862:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530494.529897:0:18163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555930240 00000100:00100000:1.0:1788530494.529901:0:18163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555930240 00000100:00100000:1.0:1788530494.529965:0:18163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555930112 00000100:00100000:1.0:1788530494.529969:0:18163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555930112 00000100:00100000:1.0:1788530494.529991:0:18163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788530494.530000:0:18163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875409555930240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530494.530049:0:18163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875409555930240:12345-0@lo:400:kworker.0 Request processed in 49us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530494.530056:0:18163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788530494.530072:0:18163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788530494.530077:0:18163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875409555930112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530494.530096:0:18163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875409555930112:12345-0@lo:400:kworker.0 Request processed in 21us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530494.530100:0:18163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:1.0:1788530494.530111:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788530494.530114:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788530494.530133:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9f32a55c00 x1875409555930112/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530510 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788530494.530152:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32a55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875409555930112:0@lo:400:kworker.0 00000100:00100000:1.0:1788530494.530162:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03c5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875409555930240:0@lo:400:kworker.0 00000100:00100000:1.0:1788530494.530213:0:18669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555929728 00000100:00100000:1.0:1788530494.530216:0:18669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555929728 00000100:00100000:1.0:1788530494.530235:0:18669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555929088 00000100:00100000:1.0:1788530494.530238:0:18669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555929088 00000100:00100000:1.0:1788530494.530251:0:18669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555929600 00000100:00100000:1.0:1788530494.530253:0:18669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555929600 00000100:00100000:1.0:1788530494.530266:0:18669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788530494.530272:0:18669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555929728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530494.530302:0:18669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555929728:12345-0@lo:400:kworker.0 Request processed in 31us (950us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530494.530306:0:18669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788530494.530314:0:18669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788530494.530317:0:18669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555929088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530494.530333:0:18669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555929088:12345-0@lo:400:kworker.0 Request processed in 16us (783us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530494.530337:0:18669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788530494.530342:0:18669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788530494.530345:0:18669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555929600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530494.530358:0:18669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875409555929600:12345-0@lo:400:kworker.0 Request processed in 13us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530494.530361:0:18669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:1.0:1788530494.530368:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788530494.530370:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788530494.530390:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555929088:0@lo:400:kworker.0 00000100:00100000:1.0:1788530494.530397:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555929600:0@lo:400:kworker.0 00000100:00100000:1.0:1788530494.530402:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875409555929728:0@lo:400:kworker.0 00000100:00100000:1.0:1788530494.530426:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555930624 00000100:00100000:1.0:1788530494.530429:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555930624 00000100:00100000:1.0:1788530494.530452:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788530494.530458:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555930624:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788530494.530481:0:18670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788530494.530518:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875409555930624:12345-0@lo:13:osp-pre-1-1.0 Request processed in 60us (655us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530494.530524:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788530494.530543:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555928960 00000100:00100000:1.0:1788530494.530546:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555928960 00000100:00100000:1.0:1788530494.530590:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555929472 00000100:00100000:1.0:1788530494.530593:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555929472 00000100:00100000:1.0:1788530494.530605:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788530494.530610:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3960fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555928960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530494.530641:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3960fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555928960:12345-0@lo:400:kworker.0 Request processed in 31us (1177us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530494.530648:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788530494.530660:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788530494.530665:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3735c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555929472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530494.530689:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3735c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875409555929472:12345-0@lo:400:kworker.0 Request processed in 25us (1161us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530494.530693:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788530494.530707:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32a54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875409555929984:0@lo:400:kworker.0 00000100:00100000:1.0:1788530494.530725:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875409555930624:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788530494.530745:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530494.530764:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555929984 00000100:00100000:1.0:1788530494.530768:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555929984 00000100:00100000:3.0:1788530494.530775:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555930496:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788530494.530780:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788530494.530801:0:18163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788530494.530807:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530494.530810:0:18163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3735ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875409555929984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530494.530842:0:18163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3735ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875409555929984:12345-0@lo:400:kworker.0 Request processed in 37us (100us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530494.530846:0:18163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788530494.530851:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555928960:0@lo:400:kworker.0 00000100:00100000:3.0:1788530494.530867:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875409555929472:0@lo:400:kworker.0 00000100:00100000:3.0:1788530494.530876:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32a54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875409555929984:0@lo:400:kworker.0 00000100:00100000:3.0:1788530494.530890:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:3.0:1788530494.530897:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:3648:1875409555928832:0@lo:400:kworker.0 00000100:00100000:3.0:1788530494.530938:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530494.530971:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875409555929344:0@lo:400:kworker.0 00000100:00100000:3.0:1788530494.530991:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530494.531031:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f32bd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875409555929856:0@lo:400:kworker.0 00000100:00100000:3.0:1788530494.531053:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788530494.531070:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03c5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875409555930368:0@lo:400:kworker.0 00000100:00100000:3.0:1788530494.531091:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530494.531103:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555928832 00000100:00100000:1.0:1788530494.531109:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555928832 00000100:00100000:1.0:1788530494.531141:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1788530494.531147:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f04d59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+29:3648:x1875409555928832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530494.531204:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f04d59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219+29:3648:x1875409555928832:12345-0@lo:400:kworker.0 Request processed in 57us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530494.531210:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1788530494.531248:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555930496 00000100:00100000:1.0:1788530494.531255:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555930496 00000100:00100000:1.0:1788530494.531280:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788530494.531285:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3735df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555930496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788530494.531294:0:18670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788530494.531319:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3735df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875409555930496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 34us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530494.531325:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1788530494.531338:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788530494.532991:0:19968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555929344 00000100:00100000:0.0:1788530494.533003:0:19968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555929344 00000100:00100000:3.0:1788530494.533027:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875409555930496:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788530494.533058:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:516d0d0a-8182-4c2b-8a3c-00c8cd0e9219:3648:1875409555928832:0@lo:400:kworker.0 00000100:00100000:0.0:1788530494.533058:0:19968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555929856 00000100:00100000:0.0:1788530494.533063:0:19968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555929856 00000100:00100000:3.0:1788530494.533089:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555930368 00000100:00100000:3.0:1788530494.533095:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555930368 00000100:00100000:0.0:1788530494.533106:0:19968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788530494.533118:0:19968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3735e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875409555929344:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788530494.533121:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788530494.533151:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788530494.533160:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3735ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875409555929856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788530494.533385:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788530494.533394:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3735d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875409555930368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788530494.533433:0:19968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3735e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875409555929344:12345-0@lo:400:kworker.0 Request processed in 318us (2440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530494.533441:0:19968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788530494.534733:0:18667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788530494.534745:0:18667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555929216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788530494.534821:0:18667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555929216:12345-0@lo:400:kworker.0 Request processed in 79us (5536us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530494.534828:0:18667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:2.0:1788530494.534889:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788530494.534894:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555929216:0@lo:400:kworker.0 00000100:00100000:2.0:1788530494.535285:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875409555929344:0@lo:400:kworker.0 00000100:00100000:3.0:1788530494.539987:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3735ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875409555929856:12345-0@lo:400:kworker.0 Request processed in 6817us (8922us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530494.540004:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788530494.540221:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f32bd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875409555929856:0@lo:400:kworker.0 00000100:00100000:1.0:1788530494.540456:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3735d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875409555930368:12345-0@lo:400:kworker.0 Request processed in 7062us (9362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530494.540480:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:2.0:1788530494.540541:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a9e03c5b800 x1875409555930368/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788530510 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788530494.540552:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03c5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875409555930368:0@lo:400:kworker.0 00000040:00080000:0.0:1788530494.980007:0:17192:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788530494.980020:0:17192:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788530494.980050:0:17192:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788530494.980074:0:17192:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788530494.980241:0:17192:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037e7800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17192:1875409555930752:192.168.202.41@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788530494.980345:0:17192:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f3b007a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788530494.985677:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530494.985848:0:19968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531711872 00000100:00100000:0.0:1788530494.985857:0:19968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531711872 00000100:00100000:0.0:1788530494.985934:0:19968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 56 00000100:00100000:0.0:1788530494.985946:0:19968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:66d42348-56b8-4977-9cd3-df6ed37388a6+38:15731:x1875409531711872:12345-192.168.202.41@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788530494.985982:0:19968:0:(mdt_handler.c:7977:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788530494.986133:0:19968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:66d42348-56b8-4977-9cd3-df6ed37388a6+38:15731:x1875409531711872:12345-192.168.202.41@tcp:53:lhsmtool_posix.0 Request processed in 188us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530494.986173:0:19968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 56 00000100:00100000:2.0:1788530494.992390:0:17192:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037e7800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17192:1875409555930752:192.168.202.41@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788530494.992544:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530494.992779:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531712000 00000100:00100000:0.0:1788530494.992787:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531712000 00000100:00100000:0.0:1788530494.992842:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 57 00000100:00100000:0.0:1788530494.992852:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3735ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66d42348-56b8-4977-9cd3-df6ed37388a6+37:15731:x1875409531712000:12345-192.168.202.41@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788530494.992944:0:17160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3e00/0xb28d70e125751eea lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530494.992963:0:17160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3e00/0xb28d70e125751eea lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530494.992975:0:17160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3e00/0xb28d70e125751eea lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530494.993047:0:17160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a2c00/0xb28d70e125751ef1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530494.993055:0:17160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a2c00/0xb28d70e125751ef1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530494.994604:0:17160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a2c00/0xb28d70e125751ef1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530494.994969:0:17160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a2a00/0xb28d70e125751ef8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530494.994984:0:17160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a2a00/0xb28d70e125751ef8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530494.994994:0:17160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a2a00/0xb28d70e125751ef8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788530494.995073:0:17160:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788530494.995079:0:17160:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788530494.995097:0:17160:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a2a00/0xb28d70e125751ef8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530494.995109:0:17160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3e00/0xb28d70e125751eea lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530494.995116:0:17160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3e00/0xb28d70e125751eea lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530494.995122:0:17160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3e00/0xb28d70e125751eea lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530494.995128:0:17160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9e010a3e00 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:0.0:1788530494.995133:0:17160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3e00/0xb28d70e125751eea lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530494.995140:0:17160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3e00/0xb28d70e125751eea lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530494.995153:0:17160:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a9e03284300) 00010000:00010000:0.0:1788530494.995156:0:17160:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788530494.995707:0:17160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3e00/0xb28d70e125751eea lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530494.995715:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3e00/0xb28d70e125751eea lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530494.995730:0:17160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a2c00/0xb28d70e125751ef1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530494.995748:0:17160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a2c00/0xb28d70e125751ef1 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530494.995754:0:17160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a2c00/0xb28d70e125751ef1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530494.995760:0:17160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9e010a2c00 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:0.0:1788530494.995763:0:17160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a2c00/0xb28d70e125751ef1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530494.995770:0:17160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a2c00/0xb28d70e125751ef1 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530494.995779:0:17160:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9a9e03284600) 00010000:00010000:0.0:1788530494.995781:0:17160:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788530494.995784:0:17160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a2c00/0xb28d70e125751ef1 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530494.995790:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a2c00/0xb28d70e125751ef1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530494.995807:0:17160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a2a00/0xb28d70e125751ef8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530494.995812:0:17160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a2a00/0xb28d70e125751ef8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530494.995817:0:17160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a2a00/0xb28d70e125751ef8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530494.995822:0:17160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9e010a2a00 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:0.0:1788530494.995833:0:17160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a2a00/0xb28d70e125751ef8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530494.995840:0:17160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a2a00/0xb28d70e125751ef8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530494.995848:0:17160:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a9f2b995100) 00010000:00010000:0.0:1788530494.995850:0:17160:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788530494.995853:0:17160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a2a00/0xb28d70e125751ef8 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530494.995859:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a2a00/0xb28d70e125751ef8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530494.995961:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3735ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66d42348-56b8-4977-9cd3-df6ed37388a6+37:15731:x1875409531712000:12345-192.168.202.41@tcp:34:lhsmtool_posix.0 Request processed in 3107us (3415us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530494.995971:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 57 00000100:00100000:1.0:1788530494.999681:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530494.999830:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531712256 00000100:00100000:2.0:1788530494.999840:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531712256 00000100:00100000:2.0:1788530494.999903:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 58 00000100:00100000:2.0:1788530494.999923:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:66d42348-56b8-4977-9cd3-df6ed37388a6+37:15731:x1875409531712256:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788530494.999945:0:17159:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530494.999970:0:17159:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141800/0xb28d70e125751eff lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550dce expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530495.000274:0:17159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140400/0xb28d70e125751f06 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530495.000293:0:17159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140400/0xb28d70e125751f06 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530495.000325:0:17159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140400/0xb28d70e125751f06 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788530495.000396:0:17159:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788530495.000678:0:17159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140400/0xb28d70e125751f06 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530495.000688:0:17159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140400/0xb28d70e125751f06 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530495.000695:0:17159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140400/0xb28d70e125751f06 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530495.000700:0:17159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f18140400 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:2.0:1788530495.000705:0:17159:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140400/0xb28d70e125751f06 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530495.000713:0:17159:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140400/0xb28d70e125751f06 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530495.000726:0:17159:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a9f2b995100) 00010000:00010000:2.0:1788530495.000729:0:17159:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788530495.000733:0:17159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140400/0xb28d70e125751f06 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530495.000739:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140400/0xb28d70e125751f06 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530495.000799:0:17159:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141800/0xb28d70e125751eff lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550dce expref: 39 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530495.000818:0:17159:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a9e03284300) 00010000:00010000:2.0:1788530495.000820:0:17159:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788530495.000824:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141800/0xb28d70e125751eff lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550dce expref: 39 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530495.000834:0:17159:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f18141800, rc 0) 00000100:00100000:2.0:1788530495.000951:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:66d42348-56b8-4977-9cd3-df6ed37388a6+38:15731:x1875409531712256:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 1029us (1280us total) trans 8589934619 rc 301/301 00000100:00100000:2.0:1788530495.000959:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 58 00000100:00100000:0.0:1788530495.013322:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530495.013597:0:19968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531712384 00000100:00100000:1.0:1788530495.013610:0:19968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531712384 00000100:00100000:1.0:1788530495.014301:0:19968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 59 00000100:00100000:1.0:1788530495.014315:0:19968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:66d42348-56b8-4977-9cd3-df6ed37388a6+38:15731:x1875409531712384:12345-192.168.202.41@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788530495.014516:0:19968:0:(mdt_handler.c:7977:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00080000:3.0:1788530495.014818:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788530495.014978:0:19968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:66d42348-56b8-4977-9cd3-df6ed37388a6+38:15731:x1875409531712384:12345-192.168.202.41@tcp:53:lhsmtool_posix.0 Request processed in 665us (1670us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530495.014987:0:19968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 59 00000100:00100000:1.0:1788530495.021878:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530495.022692:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531712640 00000100:00100000:0.0:1788530495.022707:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531712640 00000100:00100000:0.0:1788530495.022786:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 60 00000100:00100000:0.0:1788530495.022796:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66d42348-56b8-4977-9cd3-df6ed37388a6+38:15731:x1875409531712640:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788530495.022818:0:17160:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788530495.022841:0:17160:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a2c00/0xb28d70e125751f14 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550dd5 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788530495.025589:0:17160:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x7:0x0], count =27 00000004:00080000:0.0:1788530495.025606:0:17160:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x7:0x0]+27 in llog 00000004:00080000:0.0:1788530495.025750:0:17160:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x22:0x0], index 1: 0 00010000:00010000:0.0:1788530495.025972:0:17160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3e00/0xb28d70e125751f1b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530495.027715:0:17160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3e00/0xb28d70e125751f1b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530495.027731:0:17160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3e00/0xb28d70e125751f1b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530495.027834:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a2c00/0xb28d70e125751f14 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550dd5 expref: 41 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530495.027856:0:17160:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3e00/0xb28d70e125751f1b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550dd5 expref: 40 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530495.027865:0:17160:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a9e03284600) 00010000:00010000:0.0:1788530495.027868:0:17160:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788530495.027872:0:17160:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9e010a3e00, rc 0) 00000100:00100000:0.0:1788530495.027954:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66d42348-56b8-4977-9cd3-df6ed37388a6+40:15731:x1875409531712640:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 5158us (6085us total) trans 8589934620 rc 0/0 00000100:00100000:0.0:1788530495.027964:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 60 00000100:00100000:0.0:1788530495.034669:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530495.035060:0:18163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531712896 00000100:00100000:1.0:1788530495.035071:0:18163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531712896 00000100:00100000:1.0:1788530495.035129:0:18163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 61 00000100:00100000:1.0:1788530495.035139:0:18163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66d42348-56b8-4977-9cd3-df6ed37388a6+40:15731:x1875409531712896:12345-192.168.202.41@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788530495.035207:0:18163:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788530495.035232:0:18163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3e00/0xb28d70e125751f1b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550dd5 expref: 40 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530495.035250:0:18163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a9e03284600) 00010000:00010000:1.0:1788530495.035262:0:18163:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788530495.035297:0:18163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166600/0xb28d70e125751f29 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530495.035313:0:18163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166600/0xb28d70e125751f29 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530495.035348:0:18163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166600/0xb28d70e125751f29 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530495.035364:0:18163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166800/0xb28d70e125751f30 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xf54ea7a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530495.035372:0:18163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166800/0xb28d70e125751f30 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf54ea7a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530495.035378:0:18163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166800/0xb28d70e125751f30 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf54ea7a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530495.035439:0:18163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166600/0xb28d70e125751f29 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530495.035447:0:18163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166600/0xb28d70e125751f29 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530495.035454:0:18163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166600/0xb28d70e125751f29 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530495.035459:0:18163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f42166600 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:1.0:1788530495.035464:0:18163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166600/0xb28d70e125751f29 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530495.035471:0:18163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166600/0xb28d70e125751f29 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530495.035480:0:18163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a9f0b171500) 00010000:00010000:1.0:1788530495.035483:0:18163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788530495.035487:0:18163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166600/0xb28d70e125751f29 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530495.035499:0:18163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166600/0xb28d70e125751f29 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530495.035523:0:18163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166800/0xb28d70e125751f30 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf54ea7a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530495.035530:0:18163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166800/0xb28d70e125751f30 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf54ea7a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530495.035535:0:18163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166800/0xb28d70e125751f30 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf54ea7a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530495.035539:0:18163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f42166800 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:1.0:1788530495.035543:0:18163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166800/0xb28d70e125751f30 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf54ea7a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530495.035548:0:18163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166800/0xb28d70e125751f30 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf54ea7a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530495.035555:0:18163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xf54ea7a9 (ffff9a9f32abd800) 00010000:00010000:1.0:1788530495.035588:0:18163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788530495.035592:0:18163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166800/0xb28d70e125751f30 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xf54ea7a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530495.035598:0:18163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166800/0xb28d70e125751f30 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xf54ea7a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18163 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530495.035685:0:18163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66d42348-56b8-4977-9cd3-df6ed37388a6+39:15731:x1875409531712896:12345-192.168.202.41@tcp:36:lhsmtool_posix.0 Request processed in 546us (1026us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788530495.035692:0:18163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 61 00000100:00100000:3.0:1788530495.038466:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530495.038896:0:19968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531713024 00000100:00100000:1.0:1788530495.038916:0:19968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531713024 00000100:00100000:1.0:1788530495.038970:0:19968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 62 00000100:00100000:1.0:1788530495.038979:0:19968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3735fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:66d42348-56b8-4977-9cd3-df6ed37388a6+39:15731:x1875409531713024:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788530495.038999:0:19968:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788530495.039034:0:19968:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167200/0xb28d70e125751f37 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550ddc expref: -99 pid: 19968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530495.039070:0:19968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166400/0xb28d70e125751f3e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530495.039083:0:19968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166400/0xb28d70e125751f3e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530495.039095:0:19968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166400/0xb28d70e125751f3e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530495.039215:0:19968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167200/0xb28d70e125751f37 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550ddc expref: 41 pid: 19968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530495.039245:0:19968:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166400/0xb28d70e125751f3e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550ddc expref: 40 pid: 19968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530495.039253:0:19968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a9f32abdf00) 00010000:00010000:1.0:1788530495.039255:0:19968:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788530495.039259:0:19968:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f42166400, rc 0) 00000100:00100000:1.0:1788530495.039466:0:19968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3735fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:66d42348-56b8-4977-9cd3-df6ed37388a6+40:15731:x1875409531713024:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 487us (1009us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530495.039474:0:19968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 62 00000100:00100000:3.0:1788530495.049135:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530495.049639:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531713280 00000100:00100000:0.0:1788530495.049650:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531713280 00000100:00100000:0.0:1788530495.049709:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 63 00000100:00100000:0.0:1788530495.049719:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3735f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66d42348-56b8-4977-9cd3-df6ed37388a6+40:15731:x1875409531713280:12345-192.168.202.41@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788530495.049797:0:17160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3600/0xb28d70e125751f45 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530495.049814:0:17160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3600/0xb28d70e125751f45 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530495.049841:0:17160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3600/0xb28d70e125751f45 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788530495.050019:0:17160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:0.0:1788530495.050043:0:17160:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 702952481745ns, next at 703952479408ns, rc = 0 00000004:00010000:0.0:1788530495.050095:0:17160:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e6b79f12 reply state 00000000af042b4a transno 8589934621 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3600/0xb28d70e125751f45 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530495.050109:0:17160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3600/0xb28d70e125751f45 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530495.050117:0:17160:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a9f32abdf00) 00010000:00010000:0.0:1788530495.050119:0:17160:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788530495.050123:0:17160:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788530495.050232:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3735f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66d42348-56b8-4977-9cd3-df6ed37388a6+42:15731:x1875409531713280:12345-192.168.202.41@tcp:36:lhsmtool_posix.0 Request processed in 513us (1107us total) trans 8589934621 rc 0/0 00000100:00100000:0.0:1788530495.050239:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 63 00000100:00100000:0.0:1788530495.054240:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530495.054522:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531713408 00000100:00100000:3.0:1788530495.054535:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531713408 00000100:00100000:3.0:1788530495.054634:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 64 00000100:00100000:3.0:1788530495.054645:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:66d42348-56b8-4977-9cd3-df6ed37388a6+42:15731:x1875409531713408:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788530495.054669:0:17158:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788530495.054689:0:17158:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030a00/0xb28d70e125751f4c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550de3 expref: -99 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530495.054767:0:17158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030a00/0xb28d70e125751f4c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550de3 expref: 43 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530495.054781:0:17158:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030a00/0xb28d70e125751f4c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550de3 expref: 43 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530495.054800:0:17158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a9f32abdf00) 00010000:00010000:3.0:1788530495.054803:0:17158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788530495.054806:0:17158:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f00030a00, rc 0) 00000100:00100000:3.0:1788530495.054862:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:66d42348-56b8-4977-9cd3-df6ed37388a6+43:15731:x1875409531713408:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 217us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530495.054869:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 64 00000100:00100000:3.0:1788530495.058240:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530495.058349:0:18666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531713536 00000100:00100000:1.0:1788530495.058360:0:18666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531713536 00000100:00100000:1.0:1788530495.058419:0:18666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 27 00000100:00100000:1.0:1788530495.058429:0:18666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3735e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66d42348-56b8-4977-9cd3-df6ed37388a6+5:2399:x1875409531713536:12345-192.168.202.41@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788530495.058740:0:18666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3735e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66d42348-56b8-4977-9cd3-df6ed37388a6+6:2399:x1875409531713536:12345-192.168.202.41@tcp:2:lhsmtool_posix.0 Request processed in 311us (512us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1788530495.058749:0:18666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 27 00000100:00100000:1.0:1788530495.062181:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530495.062281:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531713792 00000100:00100000:0.0:1788530495.062293:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531713792 00000100:00100000:0.0:1788530495.062364:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 11 00000100:00100000:0.0:1788530495.062375:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:66d42348-56b8-4977-9cd3-df6ed37388a6+43:15731:x1875409531713792:12345-192.168.202.41@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788530495.062632:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:66d42348-56b8-4977-9cd3-df6ed37388a6+44:15731:x1875409531713792:12345-192.168.202.41@tcp:35:lhsmtool_posix.0 Request processed in 259us (471us total) trans 8589934622 rc 0/0 00000100:00100000:0.0:1788530495.062640:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 11 00000100:00100000:2.0:1788530495.079861:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530495.079967:0:19968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531714048 00000100:00100000:1.0:1788530495.079978:0:19968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531714048 00000100:00100000:1.0:1788530495.080045:0:19968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 65 00000100:00100000:1.0:1788530495.080056:0:19968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:66d42348-56b8-4977-9cd3-df6ed37388a6+44:15731:x1875409531714048:12345-192.168.202.41@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788530495.080191:0:19968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:66d42348-56b8-4977-9cd3-df6ed37388a6+44:15731:x1875409531714048:12345-192.168.202.41@tcp:57:lhsmtool_posix.0 Request processed in 136us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530495.080201:0:19968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 65 00000100:00100000:1.0:1788530495.083780:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530495.087159:0:18163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531714176 00000100:00100000:3.0:1788530495.087186:0:18163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531714176 00000100:00100000:3.0:1788530495.087259:0:18163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 66 00000100:00100000:3.0:1788530495.087271:0:18163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66d42348-56b8-4977-9cd3-df6ed37388a6+44:15731:x1875409531714176:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788530495.087292:0:18163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788530495.087312:0:18163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030400/0xb28d70e125751f53 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550dea expref: -99 pid: 18163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530495.087813:0:18163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030000/0xb28d70e125751f5a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 18163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530495.087830:0:18163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030000/0xb28d70e125751f5a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530495.087859:0:18163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030000/0xb28d70e125751f5a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788530495.087919:0:18163:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788530495.087945:0:18163:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030000/0xb28d70e125751f5a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530495.087976:0:18163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030400/0xb28d70e125751f53 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550dea expref: 46 pid: 18163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530495.087996:0:18163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030000/0xb28d70e125751f5a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550dea expref: 45 pid: 18163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530495.088005:0:18163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a9f32abdf00) 00010000:00010000:3.0:1788530495.088008:0:18163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788530495.088012:0:18163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f00030000, rc 0) 00000100:00100000:2.0:1788530495.088621:0:18163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66d42348-56b8-4977-9cd3-df6ed37388a6+45:15731:x1875409531714176:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 1349us (4848us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530495.088631:0:18163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 66 00000100:00100000:1.0:1788530495.099747:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530495.107780:0:18669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531714304 00000100:00100000:2.0:1788530495.107799:0:18669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531714304 00000100:00100000:2.0:1788530495.107882:0:18669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 28 00000100:00100000:2.0:1788530495.107892:0:18669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66d42348-56b8-4977-9cd3-df6ed37388a6+6:2399:x1875409531714304:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788530495.107921:0:18669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530495.107950:0:18669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000096a6e85c/0xb28d70e125751f61 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550df1 expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788530495.107983:0:18669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9acf3e, blocks: 0x0 00010000:00010000:2.0:1788530495.108006:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=703s v=(0 0) 00010000:00010000:2.0:1788530495.108011:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788530495.108499:0:18669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096a6e85c/0xb28d70e125751f61 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550df1 expref: 7 pid: 18669 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530495.108542:0:18669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000096a6e85c/0xb28d70e125751f61 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550df1 expref: 7 pid: 18669 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530495.108588:0:18669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f18140400, rc 0) 00000100:00100000:2.0:1788530495.108666:0:18669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66d42348-56b8-4977-9cd3-df6ed37388a6+7:2399:x1875409531714304:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 775us (8930us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530495.108674:0:18669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 28 00000100:00100000:0.0:1788530495.113837:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530495.115653:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531714560 00000100:00100000:2.0:1788530495.115671:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531714560 00000100:00100000:2.0:1788530495.115748:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 67 00000100:00100000:2.0:1788530495.115759:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f05f45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:66d42348-56b8-4977-9cd3-df6ed37388a6+45:15731:x1875409531714560:12345-192.168.202.41@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788530495.115959:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f05f45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:66d42348-56b8-4977-9cd3-df6ed37388a6+45:15731:x1875409531714560:12345-192.168.202.41@tcp:57:lhsmtool_posix.0 Request processed in 200us (2130us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530495.115967:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 67 00000100:00100000:1.0:1788530495.131602:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530495.132014:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531714688 00000100:00100000:0.0:1788530495.132050:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531714688 00000100:00100000:0.0:1788530495.132125:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 68 00000100:00100000:0.0:1788530495.132135:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66d42348-56b8-4977-9cd3-df6ed37388a6+45:15731:x1875409531714688:12345-192.168.202.41@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788530495.134843:0:17139:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000004:00080000:2.0:1788530495.134862:0:17139:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:2.0:1788530495.134939:0:17139:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00010000:00010000:3.0:1788530495.135082:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141c00/0xb28d70e125751d23 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530495.135095:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141c00/0xb28d70e125751d23 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530495.135102:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141c00/0xb28d70e125751d23 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530495.135108:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f18141c00 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:3.0:1788530495.135113:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141c00/0xb28d70e125751d23 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530495.135120:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141c00/0xb28d70e125751d23 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530495.135143:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9a9f2b995c00) 00010000:00010000:3.0:1788530495.135147:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788530495.135152:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141c00/0xb28d70e125751d23 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530495.135158:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141c00/0xb28d70e125751d23 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530495.135193:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ebc00/0xb28d70e125751d2a lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530495.135199:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ebc00/0xb28d70e125751d2a lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530495.135204:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ebc00/0xb28d70e125751d2a lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530495.135208:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f012ebc00 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:3.0:1788530495.135211:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ebc00/0xb28d70e125751d2a lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530495.135216:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ebc00/0xb28d70e125751d2a lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530495.135223:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a9f0b171500) 00010000:00010000:3.0:1788530495.135225:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788530495.135228:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ebc00/0xb28d70e125751d2a lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530495.135232:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f012ebc00/0xb28d70e125751d2a lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530495.135256:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141e00/0xb28d70e125751dd2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530495.135261:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141e00/0xb28d70e125751dd2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530495.135266:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141e00/0xb28d70e125751dd2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530495.135271:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f18141e00 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:3.0:1788530495.135274:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141e00/0xb28d70e125751dd2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530495.135279:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141e00/0xb28d70e125751dd2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530495.135287:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9a9f2b995900) 00010000:00010000:3.0:1788530495.135289:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788530495.135292:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141e00/0xb28d70e125751dd2 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530495.135298:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141e00/0xb28d70e125751dd2 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530495.135312:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a2200/0xb28d70e125751e57 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530495.135318:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a2200/0xb28d70e125751e57 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530495.135323:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a2200/0xb28d70e125751e57 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530495.135333:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9e010a2200 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:3.0:1788530495.135346:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a2200/0xb28d70e125751e57 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530495.135352:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a2200/0xb28d70e125751e57 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530495.135362:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a9f2b995100) 00010000:00010000:3.0:1788530495.135364:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788530495.135367:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a2200/0xb28d70e125751e57 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530495.135372:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a2200/0xb28d70e125751e57 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530495.135384:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3200/0xb28d70e125751e7a lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530495.135389:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3200/0xb28d70e125751e7a lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 18163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530495.135395:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3200/0xb28d70e125751e7a lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 18163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530495.135399:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9e010a3200 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:3.0:1788530495.135402:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3200/0xb28d70e125751e7a lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 18163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530495.135407:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3200/0xb28d70e125751e7a lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 18163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530495.135424:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a9f2b995100) 00010000:00010000:3.0:1788530495.135426:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788530495.135439:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3200/0xb28d70e125751e7a lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 18163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530495.135445:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3200/0xb28d70e125751e7a lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 18163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530495.135457:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141400/0xb28d70e125751ec0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530495.135463:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141400/0xb28d70e125751ec0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530495.135468:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141400/0xb28d70e125751ec0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530495.135473:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f18141400 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:3.0:1788530495.135475:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141400/0xb28d70e125751ec0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530495.135481:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141400/0xb28d70e125751ec0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530495.135489:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a9f2b995100) 00010000:00010000:3.0:1788530495.135491:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788530495.135493:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141400/0xb28d70e125751ec0 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530495.135498:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141400/0xb28d70e125751ec0 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530495.135520:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3600/0xb28d70e125751f45 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530495.135526:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3600/0xb28d70e125751f45 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530495.135532:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3600/0xb28d70e125751f45 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530495.135536:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9e010a3600 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:3.0:1788530495.135538:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3600/0xb28d70e125751f45 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530495.135543:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3600/0xb28d70e125751f45 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530495.135551:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a9f32abdf00) 00010000:00010000:3.0:1788530495.135553:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788530495.135556:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3600/0xb28d70e125751f45 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530495.135606:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3600/0xb28d70e125751f45 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530495.135931:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141000/0xb28d70e125751d77 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530495.135939:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141000/0xb28d70e125751d77 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530495.135945:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141000/0xb28d70e125751d77 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530495.135950:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f18141000 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:0.0:1788530495.135952:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141000/0xb28d70e125751d77 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530495.135958:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141000/0xb28d70e125751d77 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530495.135968:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a9f0b171500) 00010000:00010000:0.0:1788530495.135970:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1788530495.135973:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141000/0xb28d70e125751d77 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530495.135978:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141000/0xb28d70e125751d77 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17159 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530495.136155:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66d42348-56b8-4977-9cd3-df6ed37388a6+14:15731:x1875409531714688:12345-192.168.202.41@tcp:44:lhsmtool_posix.0 Request processed in 4017us (4596us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530495.136176:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 68 00000100:00100000:0.0:1788530495.139558:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555930880:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788530495.139657:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530495.140611:0:18666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555930880 00000100:00100000:1.0:1788530495.140621:0:18666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555930880 00000100:00100000:1.0:1788530495.140672:0:18666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788530495.140682:0:18666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f05f45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555930880:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1788530495.140803:0:18666:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788530495.140806:0:18666:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1788530495.140808:0:18666:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788530495.140810:0:18666:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1788530494 -> 1788530494 00002000:00010000:1.0:1788530495.140821:0:18666:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1788530495.140881:0:18666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f05f45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3650:x1875409555930880:12345-0@lo:2:osp-syn-1-0.0 Request processed in 200us (1224us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1788530495.140888:0:18666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:3.0:1788530495.140999:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a9e037d5c00/2, rc 0, transno 8589934596 00000100:00100000:3.0:1788530495.141006:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555930880:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788530495.142664:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530495.142861:0:18667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531714816 00000100:00100000:3.0:1788530495.142869:0:18667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531714816 00000100:00100000:3.0:1788530495.142923:0:18667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 30 00000100:00100000:3.0:1788530495.142933:0:18667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f05f44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:66d42348-56b8-4977-9cd3-df6ed37388a6+7:2400:x1875409531714816:12345-192.168.202.41@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788530495.143325:0:18667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f05f44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:66d42348-56b8-4977-9cd3-df6ed37388a6+7:2400:x1875409531714816:12345-192.168.202.41@tcp:16:lhsmtool_posix.0 Request processed in 392us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530495.143332:0:18667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 30 00000100:00100000:3.0:1788530495.165041:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530495.165221:0:18163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531715072 00000100:00100000:2.0:1788530495.165231:0:18163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531715072 00000100:00100000:2.0:1788530495.165303:0:18163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 69 00000100:00100000:2.0:1788530495.165315:0:18163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3735d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66d42348-56b8-4977-9cd3-df6ed37388a6+14:15731:x1875409531715072:12345-192.168.202.41@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788530495.165394:0:18163:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788530495.165425:0:18163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030000/0xb28d70e125751f5a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550dea expref: 14 pid: 18163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530495.165459:0:18163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a9f32abdf00) 00010000:00010000:2.0:1788530495.165465:0:18163:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788530495.165498:0:18163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140600/0xb28d70e125751f68 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530495.165512:0:18163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140600/0xb28d70e125751f68 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530495.165523:0:18163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140600/0xb28d70e125751f68 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788530495.165920:0:18163:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000174dbc5b reply state 00000000aee960e8 transno 8589934623 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140600/0xb28d70e125751f68 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530495.165934:0:18163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140600/0xb28d70e125751f68 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530495.165939:0:18163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a9f32abdf00) 00010000:00010000:2.0:1788530495.165941:0:18163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788530495.165945:0:18163:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788530495.166234:0:18163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3735d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66d42348-56b8-4977-9cd3-df6ed37388a6+15:15731:x1875409531715072:12345-192.168.202.41@tcp:36:lhsmtool_posix.0 Request processed in 920us (1212us total) trans 8589934623 rc 0/0 00000100:00100000:2.0:1788530495.166242:0:18163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 69 00000100:00100000:1.0:1788530495.172899:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530495.172977:0:18666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531715200 00000100:00100000:2.0:1788530495.172987:0:18666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531715200 00000100:00100000:2.0:1788530495.173055:0:18666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 31 00000100:00100000:2.0:1788530495.173064:0:18666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66d42348-56b8-4977-9cd3-df6ed37388a6+7:15731:x1875409531715200:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788530495.173083:0:18666:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530495.173113:0:18666:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb885740/0xb28d70e125751f6f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550df8 expref: -99 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530495.173156:0:18666:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000096a6e85c/0xb28d70e125751f61 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550df1 expref: 8 pid: 18669 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530495.173176:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788530495.173187:0:18666:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788530495.173193:0:18666:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb885740/0xb28d70e125751f6f lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550df8 expref: 8 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530495.173229:0:18666:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000096a6e85c/0xb28d70e125751f61 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550df1 expref: 8 pid: 18669 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530495.173244:0:18666:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000096a6e85c/0xb28d70e125751f61 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550df1 expref: 8 pid: 18669 timeout: 803 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530495.173258:0:18666:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03c58700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:18666:1875409555931008:192.168.202.41@tcp:104: 00000100:00100000:2.0:1788530495.173337:0:18666:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f046a9b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788530495.178495:0:18666:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03c58700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:18666:1875409555931008:192.168.202.41@tcp:104: 00010000:00010000:2.0:1788530495.178539:0:18666:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fb885740/0xb28d70e125751f6f lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550df8 expref: 8 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530495.178597:0:18666:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f18141200, rc 0) 00000100:00100000:2.0:1788530495.178664:0:18666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66d42348-56b8-4977-9cd3-df6ed37388a6+8:15731:x1875409531715200:12345-192.168.202.41@tcp:101:lhsmtool_posix.0 Request processed in 5599us (5773us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530495.178689:0:18666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 31 00000100:00100000:3.0:1788530495.178916:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530495.178990:0:20204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531715328 00000100:00100000:2.0:1788530495.178998:0:20204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531715328 00010000:00010000:2.0:1788530495.179036:0:20204:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000096a6e85c/0xb28d70e125751f61 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550df1 expref: 8 pid: 18669 timeout: 803 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530495.179074:0:20204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 23 00000100:00100000:2.0:1788530495.179084:0:20204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f178e8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66d42348-56b8-4977-9cd3-df6ed37388a6+8:2400:x1875409531715328:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788530495.179098:0:20204:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788530495.179121:0:20204:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000096a6e85c/0xb28d70e125751f61 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550df1 expref: 8 pid: 18669 timeout: 803 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530495.179135:0:20204:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000096a6e85c/0xb28d70e125751f61 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550df1 expref: 8 pid: 18669 timeout: 803 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530495.179156:0:20204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096a6e85c/0xb28d70e125751f61 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550df1 expref: 8 pid: 18669 timeout: 803 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530495.179280:0:20204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788530495.179286:0:20204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788530495.179295:0:20204:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fb885740/0xb28d70e125751f6f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550df8 expref: 7 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530495.179305:0:20204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb885740/0xb28d70e125751f6f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550df8 expref: 7 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530495.179353:0:20204:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000fb885740/0xb28d70e125751f6f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550df8 expref: 7 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530495.179366:0:20204:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03c58700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:20204:1875409555931136:192.168.202.41@tcp:105: 00000100:00100000:2.0:1788530495.179435:0:20204:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f046a9b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788530495.186332:0:20204:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03c58700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:20204:1875409555931136:192.168.202.41@tcp:105: 00010000:00010000:2.0:1788530495.186365:0:20204:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788530495.186431:0:20204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f178e8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66d42348-56b8-4977-9cd3-df6ed37388a6+7:2400:x1875409531715328:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 7347us (7523us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530495.186442:0:20204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 23 00000100:00100000:0.0:1788530495.188727:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530495.188809:0:18669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531715456 00000100:00100000:2.0:1788530495.188818:0:18669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531715456 00000100:00100000:2.0:1788530495.188871:0:18669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 32 00000100:00100000:2.0:1788530495.188881:0:18669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37377100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66d42348-56b8-4977-9cd3-df6ed37388a6+7:2399:x1875409531715456:12345-192.168.202.41@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788530495.189037:0:18669:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788530495.189041:0:18669:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1788530493 00002000:00010000:2.0:1788530495.189044:0:18669:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 1788530491 00002000:00010000:2.0:1788530495.189046:0:18669:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1788530494 -> 1788530493 00002000:00010000:2.0:1788530495.189048:0:18669:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1788530495.189113:0:18669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37377100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66d42348-56b8-4977-9cd3-df6ed37388a6+8:2399:x1875409531715456:12345-192.168.202.41@tcp:2:lhsmtool_posix.0 Request processed in 233us (395us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1788530495.189120:0:18669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 32 00000100:00100000:3.0:1788530495.190980:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530495.192998:0:18966:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531715584 00000100:00100000:0.0:1788530495.193012:0:18966:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531715584 00000100:00100000:0.0:1788530495.193091:0:18966:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 33 00000100:00100000:0.0:1788530495.193102:0:18966:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3735ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:66d42348-56b8-4977-9cd3-df6ed37388a6+8:2401:x1875409531715584:12345-192.168.202.41@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788530495.193145:0:18966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e87cbf31/0xb28d70e125751f76 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530495.193176:0:18966:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fb885740/0xb28d70e125751f6f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550df8 expref: 8 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530495.193185:0:18966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788530495.193190:0:18966:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788530495.193194:0:18966:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e87cbf31/0xb28d70e125751f76 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530495.193232:0:18966:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fb885740/0xb28d70e125751f6f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550df8 expref: 8 pid: 18666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530495.193247:0:18966:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fb885740/0xb28d70e125751f6f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550df8 expref: 8 pid: 18666 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530495.193261:0:18966:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37376d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:18966:1875409555931264:192.168.202.41@tcp:104: 00000100:00100000:0.0:1788530495.193389:0:18966:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f3b007cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788530495.203819:0:18966:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37376d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:18966:1875409555931264:192.168.202.41@tcp:104: 00010000:00010000:0.0:1788530495.203851:0:18966:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e87cbf31/0xb28d70e125751f76 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530495.205695:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530495.207015:0:20205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531715712 00000100:00100000:1.0:1788530495.207028:0:20205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531715712 00010000:00010000:1.0:1788530495.207078:0:20205:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fb885740/0xb28d70e125751f6f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550df8 expref: 9 pid: 18666 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530495.207124:0:20205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 24 00000100:00100000:1.0:1788530495.207135:0:20205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3735f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66d42348-56b8-4977-9cd3-df6ed37388a6+9:2400:x1875409531715712:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788530495.207151:0:20205:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788530495.207181:0:20205:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fb885740/0xb28d70e125751f6f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550df8 expref: 9 pid: 18666 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530495.207196:0:20205:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fb885740/0xb28d70e125751f6f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550df8 expref: 9 pid: 18666 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530495.207220:0:20205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb885740/0xb28d70e125751f6f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550df8 expref: 9 pid: 18666 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530495.207237:0:20205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788530495.207241:0:20205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788530495.207247:0:20205:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e87cbf31/0xb28d70e125751f76 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530495.207275:0:20205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e87cbf31/0xb28d70e125751f76 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530495.207313:0:20205:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788530495.207379:0:20205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3735f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:66d42348-56b8-4977-9cd3-df6ed37388a6+8:2400:x1875409531715712:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 245us (1695us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530495.207387:0:20205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 24 00010000:00010000:2.0:1788530495.208445:0:18966:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e87cbf31/0xb28d70e125751f76 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530495.208481:0:18966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e87cbf31/0xb28d70e125751f76 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530495.208505:0:18966:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e87cbf31/0xb28d70e125751f76 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530495.208514:0:18966:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e87cbf31/0xb28d70e125751f76 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530495.208522:0:18966:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e87cbf31/0xb28d70e125751f76 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530495.208529:0:18966:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9e010a3600 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:2.0:1788530495.208534:0:18966:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e87cbf31/0xb28d70e125751f76 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530495.208544:0:18966:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e87cbf31/0xb28d70e125751f76 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530495.208599:0:18966:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e87cbf31/0xb28d70e125751f76 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530495.208607:0:18966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e87cbf31/0xb28d70e125751f76 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530495.208703:0:18966:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3735ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:66d42348-56b8-4977-9cd3-df6ed37388a6+7:2401:x1875409531715584:12345-192.168.202.41@tcp:1:lhsmtool_posix.0 Request processed in 15601us (17729us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530495.208711:0:18966:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 33 00000100:00100000:3.0:1788530495.212078:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530495.212171:0:19968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531715968 00000100:00100000:1.0:1788530495.212188:0:19968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531715968 00000100:00100000:1.0:1788530495.212251:0:19968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 70 00000100:00100000:1.0:1788530495.212262:0:19968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3735c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:66d42348-56b8-4977-9cd3-df6ed37388a6+15:15731:x1875409531715968:12345-192.168.202.41@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788530495.212367:0:19968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166600/0xb28d70e125751f7d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530495.212386:0:19968:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3000/0xb28d70e125751e50 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550d96 expref: 15 pid: 18163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530495.212395:0:19968:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166600/0xb28d70e125751f7d lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530495.212442:0:19968:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3000/0xb28d70e125751e50 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550d96 expref: 15 pid: 18163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530495.212456:0:19968:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3000/0xb28d70e125751e50 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550d96 expref: 15 pid: 18163 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530495.212493:0:19968:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037d6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19968:1875409555931392:192.168.202.41@tcp:104: 00000100:00100000:1.0:1788530495.212597:0:19968:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f06a6b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788530495.215718:0:19968:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037d6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19968:1875409555931392:192.168.202.41@tcp:104: 00010000:00010000:0.0:1788530495.215761:0:19968:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166600/0xb28d70e125751f7d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530495.228529:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530495.234334:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531716096 00000100:00100000:2.0:1788530495.239711:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531716096 00010000:00010000:3.0:1788530495.241681:0:17145:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3000/0xb28d70e125751e50 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550d96 expref: 16 pid: 18163 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530495.241738:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 25 00000100:00100000:3.0:1788530495.241751:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f37376d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66d42348-56b8-4977-9cd3-df6ed37388a6+16:2399:x1875409531716096:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788530495.241768:0:17145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788530495.241775:0:17145:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3000/0xb28d70e125751e50 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550d96 expref: 16 pid: 18163 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530495.241788:0:17145:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3000/0xb28d70e125751e50 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550d96 expref: 16 pid: 18163 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530495.241811:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3000/0xb28d70e125751e50 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550d96 expref: 16 pid: 18163 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530495.241828:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a9f2b995100) 00010000:00010000:3.0:1788530495.241834:0:17145:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141600/0xb28d70e125751ee3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550dc7 expref: 15 pid: 19968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530495.241866:0:17145:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166600/0xb28d70e125751f7d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530495.241873:0:17145:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166600/0xb28d70e125751f7d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530495.241880:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166600/0xb28d70e125751f7d lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530495.241927:0:17145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788530495.241994:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f37376d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66d42348-56b8-4977-9cd3-df6ed37388a6+15:2399:x1875409531716096:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 246us (13475us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530495.242002:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 25 00010000:00010000:1.0:1788530495.243764:0:19968:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166600/0xb28d70e125751f7d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530495.243780:0:19968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166600/0xb28d70e125751f7d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530495.244080:0:19968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167200/0xb28d70e125751f84 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530495.244097:0:19968:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030a00/0xb28d70e125751f4c lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550de3 expref: 15 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530495.244106:0:19968:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167200/0xb28d70e125751f84 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530495.244145:0:19968:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030a00/0xb28d70e125751f4c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550de3 expref: 15 pid: 17158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530495.244161:0:19968:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030a00/0xb28d70e125751f4c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550de3 expref: 15 pid: 17158 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788530495.244186:0:19968:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e037d6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19968:1875409555931520:192.168.202.41@tcp:104: 00000100:00100000:1.0:1788530495.244281:0:19968:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f17715480 going to sleep for 11 seconds 00000100:00100000:1.0:1788530495.247384:0:19968:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e037d6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19968:1875409555931520:192.168.202.41@tcp:104: 00010000:00010000:1.0:1788530495.247421:0:19968:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167200/0xb28d70e125751f84 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530495.247859:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530495.247943:0:20204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531716224 00000100:00100000:0.0:1788530495.247952:0:20204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531716224 00010000:00010000:0.0:1788530495.247989:0:20204:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030a00/0xb28d70e125751f4c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550de3 expref: 16 pid: 17158 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530495.248037:0:20204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 26 00000100:00100000:0.0:1788530495.248047:0:20204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c58700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66d42348-56b8-4977-9cd3-df6ed37388a6+16:2399:x1875409531716224:12345-192.168.202.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788530495.248061:0:20204:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788530495.248068:0:20204:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030a00/0xb28d70e125751f4c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550de3 expref: 16 pid: 17158 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530495.248078:0:20204:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030a00/0xb28d70e125751f4c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550de3 expref: 16 pid: 17158 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530495.248099:0:20204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030a00/0xb28d70e125751f4c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.41@tcp remote: 0x2b1406819a550de3 expref: 16 pid: 17158 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530495.248114:0:20204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a9f32abdf00) 00010000:00010000:0.0:1788530495.248125:0:20204:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167200/0xb28d70e125751f84 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530495.248135:0:20204:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167200/0xb28d70e125751f84 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530495.248143:0:20204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167200/0xb28d70e125751f84 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530495.248183:0:20204:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788530495.248235:0:20204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c58700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:66d42348-56b8-4977-9cd3-df6ed37388a6+15:2399:x1875409531716224:12345-192.168.202.41@tcp:103:ldlm_bl.0 Request processed in 189us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530495.248244:0:20204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 26 00010000:00010000:2.0:1788530495.248441:0:19968:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167200/0xb28d70e125751f84 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530495.248450:0:19968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167200/0xb28d70e125751f84 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788530495.248591:0:19968:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:2.0:1788530495.248709:0:19968:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000001:00080000:2.0:1788530495.248744:0:19968:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934626 00000100:00100000:2.0:1788530495.248819:0:19968:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e03c58000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:19968:1875409555931648:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788530495.248868:0:19968:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530495.248913:0:19968:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f046a9900 going to sleep for 11 seconds 00000100:00100000:1.0:1788530495.249050:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555931648 00000100:00100000:1.0:1788530495.249056:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555931648 00000100:00100000:1.0:1788530495.249102:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788530495.249111:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:19968:x1875409555931648:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1788530495.249205:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:19968:x1875409555931648:12345-0@lo:1000:mdt00_004.0 Request processed in 95us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530495.249212:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788530495.249517:0:19968:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e03c58000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:19968:1875409555931648:0@lo:1000:mdt00_004.0 00000001:00080000:0.0:1788530495.249716:0:19968:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000100:00100000:0.0:1788530495.249770:0:19968:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f37376300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:19968:1875409555931776:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1788530495.249809:0:19968:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530495.249825:0:19968:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f3b007480 going to sleep for 11 seconds 00000100:00100000:1.0:1788530495.249950:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555931776 00000100:00100000:1.0:1788530495.249955:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555931776 00000100:00100000:1.0:1788530495.249991:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788530495.249999:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f328e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:19968:x1875409555931776:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1788530495.250127:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f328e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:19968:x1875409555931776:12345-0@lo:1000:mdt00_004.0 Request processed in 129us (317us total) trans 8589934598 rc 0/0 00000100:00100000:1.0:1788530495.250135:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788530495.251422:0:19968:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f37376300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:19968:1875409555931776:0@lo:1000:mdt00_004.0 00010000:00010000:0.0:1788530495.251516:0:19968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167200/0xb28d70e125751f84 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530495.251526:0:19968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167200/0xb28d70e125751f84 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530495.251535:0:19968:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167200/0xb28d70e125751f84 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530495.251541:0:19968:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f42167200 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:0.0:1788530495.251546:0:19968:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167200/0xb28d70e125751f84 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530495.251600:0:19968:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167200/0xb28d70e125751f84 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530495.251620:0:19968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a9f32abdf00) 00010000:00010000:0.0:1788530495.251624:0:19968:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788530495.251630:0:19968:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167200/0xb28d70e125751f84 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530495.251636:0:19968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167200/0xb28d70e125751f84 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530495.251686:0:19968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030e00/0xb28d70e125751edc lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530495.251692:0:19968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030e00/0xb28d70e125751edc lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530495.251697:0:19968:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030e00/0xb28d70e125751edc lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530495.251702:0:19968:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f00030e00 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:0.0:1788530495.251705:0:19968:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030e00/0xb28d70e125751edc lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530495.251710:0:19968:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030e00/0xb28d70e125751edc lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530495.251718:0:19968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a9f2b995100) 00010000:00010000:0.0:1788530495.251720:0:19968:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788530495.251728:0:19968:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141600/0xb28d70e125751ee3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550dc7 expref: 18 pid: 19968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530495.251754:0:19968:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141600/0xb28d70e125751ee3 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550dc7 expref: 18 pid: 19968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530495.251765:0:19968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141600/0xb28d70e125751ee3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550dc7 expref: 18 pid: 19968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530495.251840:0:19968:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141600/0xb28d70e125751ee3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550dc7 expref: 18 pid: 19968 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530495.251857:0:19968:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19968:1875409555931904:192.168.202.41@tcp:105: 00000100:00100000:0.0:1788530495.251958:0:19968:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a9f3b007900 going to sleep for 11 seconds 00000100:00100000:2.0:1788530495.256835:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:0.0:1788530495.256991:0:19968:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19968:1875409555931904:192.168.202.41@tcp:105: 00010000:00010000:0.0:1788530495.257045:0:19968:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030e00/0xb28d70e125751edc lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530495.257061:0:19968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f00030e00/0xb28d70e125751edc lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 17158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530495.257104:0:19968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3200/0xb28d70e125751f8b lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530495.257122:0:19968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3200/0xb28d70e125751f8b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530495.257137:0:19968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3200/0xb28d70e125751f8b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530495.257151:0:19968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3200/0xb28d70e125751f8b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530495.257416:0:19968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3200/0xb28d70e125751f8b lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530495.257423:0:19968:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3200/0xb28d70e125751f8b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788530495.257538:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531716352 00000100:00100000:3.0:1788530495.257545:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531716352 00010000:00010000:0.0:1788530495.257671:0:19968:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9e010a3200 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:0.0:1788530495.257678:0:19968:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3200/0xb28d70e125751f8b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530495.257687:0:19968:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3200/0xb28d70e125751f8b lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530495.257702:0:19968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a9f2b995100) 00010000:00010000:0.0:1788530495.257705:0:19968:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788530495.257710:0:19968:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3200/0xb28d70e125751f8b lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530495.257714:0:19968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9e010a3200/0xb28d70e125751f8b lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530495.257725:0:19968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166600/0xb28d70e125751f7d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530495.257730:0:19968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166600/0xb28d70e125751f7d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530495.257736:0:19968:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166600/0xb28d70e125751f7d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530495.257741:0:19968:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f42166600 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:0.0:1788530495.257751:0:19968:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166600/0xb28d70e125751f7d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530495.257758:0:19968:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166600/0xb28d70e125751f7d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530495.257768:0:19968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a9f2b995100) 00010000:00010000:0.0:1788530495.257770:0:19968:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788530495.257773:0:19968:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166600/0xb28d70e125751f7d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788530495.257779:0:19968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42166600/0xb28d70e125751f7d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788530495.257967:0:19968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3735c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:66d42348-56b8-4977-9cd3-df6ed37388a6+19:15731:x1875409531715968:12345-192.168.202.41@tcp:57:lhsmtool_posix.0 Request processed in 45704us (45896us total) trans 8589934628 rc 0/0 00000100:00100000:0.0:1788530495.257977:0:19968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 70 00000020:00080000:0.0:1788530495.257984:0:19968:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1788530495.258101:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 12 00000100:00100000:3.0:1788530495.258113:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:66d42348-56b8-4977-9cd3-df6ed37388a6+18:15730:x1875409531716352:12345-192.168.202.41@tcp:49:bash.0 00000100:00100000:3.0:1788530495.258704:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:66d42348-56b8-4977-9cd3-df6ed37388a6+18:15730:x1875409531716352:12345-192.168.202.41@tcp:49:bash.0 Request processed in 592us (1880us total) trans 0 rc 0/0 00000100:00100000:3.0:1788530495.258711:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 12 00000040:00080000:2.0:1788530495.259668:0:17192:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788530495.259676:0:17192:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788530495.259699:0:17192:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788530495.259713:0:17192:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788530495.263537:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530495.263675:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530495.264460:0:18669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531716736 00000100:00100000:2.0:1788530495.264472:0:18669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531716736 00000100:00100000:2.0:1788530495.264532:0:18669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 34 00000100:00100000:2.0:1788530495.264542:0:18669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3735f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66d42348-56b8-4977-9cd3-df6ed37388a6+7:15730:x1875409531716736:12345-192.168.202.41@tcp:101:bash.0 00010000:00010000:2.0:1788530495.264601:0:18669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530495.264622:0:18669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000df8fdd5c/0xb28d70e125751f92 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550dff expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788530495.264648:0:18669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x6a9acf3d, atime: 0x6a9acf3b, ctime: 0x6a9acf3d, blocks: 0x0 00010000:00010000:2.0:1788530495.264670:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=703s v=(0 0) 00010000:00010000:2.0:1788530495.264675:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788530495.264685:0:18669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000df8fdd5c/0xb28d70e125751f92 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550dff expref: 8 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530495.264701:0:18669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000df8fdd5c/0xb28d70e125751f92 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550dff expref: 8 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530495.264713:0:18669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f18141e00, rc 0) 00000100:00100000:2.0:1788530495.264770:0:18669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3735f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66d42348-56b8-4977-9cd3-df6ed37388a6+8:15730:x1875409531716736:12345-192.168.202.41@tcp:101:bash.0 Request processed in 228us (1094us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530495.264777:0:18669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 34 00000100:00100000:1.0:1788530495.268785:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530495.269874:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531716864 00000100:00100000:2.0:1788530495.269886:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531716864 00000100:00100000:2.0:1788530495.269958:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 71 00000100:00100000:2.0:1788530495.269968:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66d42348-56b8-4977-9cd3-df6ed37388a6+18:15730:x1875409531716864:12345-192.168.202.41@tcp:101:bash.0 00010000:00010000:2.0:1788530495.269991:0:17160:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530495.270014:0:17160:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141c00/0xb28d70e125751f99 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550e06 expref: -99 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530495.270062:0:17160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141800/0xb28d70e125751fa0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530495.270090:0:17160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141800/0xb28d70e125751fa0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530495.270102:0:17160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141800/0xb28d70e125751fa0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530495.270238:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141c00/0xb28d70e125751f99 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550e06 expref: 20 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530495.270257:0:17160:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141800/0xb28d70e125751fa0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550e06 expref: 19 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530495.270266:0:17160:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a9f2b995100) 00010000:00010000:2.0:1788530495.270268:0:17160:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788530495.270272:0:17160:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f18141800, rc 0) 00000100:00100000:2.0:1788530495.270352:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66d42348-56b8-4977-9cd3-df6ed37388a6+19:15730:x1875409531716864:12345-192.168.202.41@tcp:101:bash.0 Request processed in 385us (1574us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530495.270359:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 71 00000100:00100000:0.0:1788530495.271899:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531716608 00000100:00100000:0.0:1788530495.271922:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531716608 00000100:00100000:1.0:1788530495.272058:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 13 00000100:00100000:1.0:1788530495.272070:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3735d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:66d42348-56b8-4977-9cd3-df6ed37388a6+19:15731:x1875409531716608:12345-192.168.202.41@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788530495.274701:0:17162:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788530495.274739:0:17162:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934629 00010000:00010000:1.0:1788530495.274780:0:17162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167200/0xb28d70e125751fa7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530495.274797:0:17162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167200/0xb28d70e125751fa7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530495.274808:0:17162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167200/0xb28d70e125751fa7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530495.274831:0:17162:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167200/0xb28d70e125751fa7 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530495.274837:0:17162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167200/0xb28d70e125751fa7 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530495.274843:0:17162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167200/0xb28d70e125751fa7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788530495.274924:0:17162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788530495.275040:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3735d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:66d42348-56b8-4977-9cd3-df6ed37388a6+21:15731:x1875409531716608:12345-192.168.202.41@tcp:35:lhsmtool_posix.0 Request processed in 2968us (11509us total) trans 8589934630 rc 0/0 00000100:00100000:1.0:1788530495.275050:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 13 00000020:00080000:1.0:1788530495.275055:0:17162:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788530495.275969:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530495.276007:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531717120 00000100:00100000:2.0:1788530495.276015:0:17161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531717120 00000100:00100000:2.0:1788530495.276059:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 14 00000100:00100000:2.0:1788530495.276067:0:17161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e03c59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:66d42348-56b8-4977-9cd3-df6ed37388a6+21:15730:x1875409531717120:12345-192.168.202.41@tcp:35:bash.0 00000001:00080000:2.0:1788530495.276251:0:17161:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934631 00000001:00080000:2.0:1788530495.276353:0:17161:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934632 00000100:00100000:2.0:1788530495.276423:0:17161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e03c59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:66d42348-56b8-4977-9cd3-df6ed37388a6+24:15730:x1875409531717120:12345-192.168.202.41@tcp:35:bash.0 Request processed in 356us (459us total) trans 8589934633 rc 0/0 00000100:00100000:2.0:1788530495.276450:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 14 00000020:00080000:2.0:1788530495.276454:0:17161:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1788530495.284711:0:18991:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788530495.284726:0:18991:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167200/0xb28d70e125751fa7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530495.284738:0:18991:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f42167200 already unused, calling callback (ffffffffc0d3e660) 00010000:00010000:3.0:1788530495.284762:0:18991:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167200/0xb28d70e125751fa7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530495.284774:0:18991:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167200/0xb28d70e125751fa7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530495.284793:0:18991:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a9f32abdf00) 00010000:00010000:3.0:1788530495.284796:0:18991:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788530495.284802:0:18991:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167200/0xb28d70e125751fa7 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530495.284808:0:18991:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f42167200/0xb28d70e125751fa7 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788530495.284842:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530495.284844:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788530495.284846:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788530495.394033:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530495.394177:0:18163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531717376 00000100:00100000:2.0:1788530495.394187:0:18163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531717376 00000100:00100000:2.0:1788530495.394260:0:18163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 72 00000100:00100000:2.0:1788530495.394272:0:18163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3735dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66d42348-56b8-4977-9cd3-df6ed37388a6+24:15741:x1875409531717376:12345-192.168.202.41@tcp:101:lfs.0 00010000:00010000:2.0:1788530495.394306:0:18163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788530495.394331:0:18163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141c00/0xb28d70e125751fae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b1406819a550e0d expref: -99 pid: 18163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788530495.394486:0:18163:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788530495.394644:0:18163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141c00/0xb28d70e125751fae lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550e0d expref: 26 pid: 18163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530495.394657:0:18163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a9e03284b00) 00010000:00010000:2.0:1788530495.394660:0:18163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788530495.394665:0:18163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141c00/0xb28d70e125751fae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.41@tcp remote: 0x2b1406819a550e0d expref: 26 pid: 18163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530495.394678:0:18163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a9f18141c00, rc 0) 00000100:00100000:2.0:1788530495.394742:0:18163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3735dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66d42348-56b8-4977-9cd3-df6ed37388a6+25:15741:x1875409531717376:12345-192.168.202.41@tcp:101:lfs.0 Request processed in 473us (734us total) trans 8589934634 rc 301/301 00000100:00100000:2.0:1788530495.394749:0:18163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 72 00000100:00100000:0.0:1788530495.409853:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530495.409960:0:19968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531717504 00000100:00100000:2.0:1788530495.409972:0:19968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531717504 00000100:00100000:2.0:1788530495.410047:0:19968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 73 00000100:00100000:2.0:1788530495.410059:0:19968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f328e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:66d42348-56b8-4977-9cd3-df6ed37388a6+25:15741:x1875409531717504:12345-192.168.202.41@tcp:34:lfs.0 00010000:00010000:2.0:1788530495.410160:0:19968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141c00/0xb28d70e125751fbc lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530495.410195:0:19968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141c00/0xb28d70e125751fbc lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530495.410207:0:19968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141c00/0xb28d70e125751fbc lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530495.410223:0:19968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141a00/0xb28d70e125751fc3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530495.410230:0:19968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141a00/0xb28d70e125751fc3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530495.410237:0:19968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141a00/0xb28d70e125751fc3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530495.410324:0:19968:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140200/0xb28d70e125751fca lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530495.410334:0:19968:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140200/0xb28d70e125751fca lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530495.410354:0:19968:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140200/0xb28d70e125751fca lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788530495.410405:0:19968:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140200/0xb28d70e125751fca lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530495.410419:0:19968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141c00/0xb28d70e125751fbc lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530495.410800:0:19968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141c00/0xb28d70e125751fbc lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530495.410807:0:19968:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141c00/0xb28d70e125751fbc lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530495.410813:0:19968:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f18141c00 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:2.0:1788530495.410818:0:19968:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141c00/0xb28d70e125751fbc lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530495.410825:0:19968:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141c00/0xb28d70e125751fbc lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530495.410839:0:19968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a9f0b171500) 00010000:00010000:2.0:1788530495.410842:0:19968:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788530495.410847:0:19968:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141c00/0xb28d70e125751fbc lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530495.410853:0:19968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141c00/0xb28d70e125751fbc lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530495.410869:0:19968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141a00/0xb28d70e125751fc3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530495.410876:0:19968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141a00/0xb28d70e125751fc3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530495.410881:0:19968:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141a00/0xb28d70e125751fc3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530495.410886:0:19968:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f18141a00 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:2.0:1788530495.410896:0:19968:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141a00/0xb28d70e125751fc3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530495.410911:0:19968:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141a00/0xb28d70e125751fc3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530495.410920:0:19968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9a9f2b995000) 00010000:00010000:2.0:1788530495.410923:0:19968:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788530495.410926:0:19968:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141a00/0xb28d70e125751fc3 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530495.410932:0:19968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18141a00/0xb28d70e125751fc3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530495.410950:0:19968:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140200/0xb28d70e125751fca lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530495.410955:0:19968:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140200/0xb28d70e125751fca lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530495.410961:0:19968:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140200/0xb28d70e125751fca lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530495.410966:0:19968:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a9f18140200 already unused, calling callback (ffffffffc19604f0) 00010000:00010000:2.0:1788530495.410969:0:19968:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140200/0xb28d70e125751fca lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530495.410975:0:19968:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140200/0xb28d70e125751fca lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530495.410983:0:19968:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a9f2b995100) 00010000:00010000:2.0:1788530495.410985:0:19968:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788530495.410994:0:19968:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140200/0xb28d70e125751fca lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788530495.411000:0:19968:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a9f18140200/0xb28d70e125751fca lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788530495.411152:0:19968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f328e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:66d42348-56b8-4977-9cd3-df6ed37388a6+25:15741:x1875409531717504:12345-192.168.202.41@tcp:34:lfs.0 Request processed in 1092us (1306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530495.411261:0:19968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 73 00000100:00100000:1.0:1788530495.414818:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:2.0:1788530495.417407:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531717760 00000100:00100000:2.0:1788530495.417425:0:17161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531717760 00000100:00100000:2.0:1788530495.417507:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 15 00000100:00100000:2.0:1788530495.417518:0:17161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e037d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:66d42348-56b8-4977-9cd3-df6ed37388a6+25:15741:x1875409531717760:12345-192.168.202.41@tcp:35:lfs.0 00000100:00100000:2.0:1788530495.417776:0:17161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e037d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:66d42348-56b8-4977-9cd3-df6ed37388a6+26:15741:x1875409531717760:12345-192.168.202.41@tcp:35:lfs.0 Request processed in 259us (2989us total) trans 8589934635 rc 0/0 00000100:00100000:2.0:1788530495.417785:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 15 00010000:00010000:0.0:1788530495.553721:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788530496.580740:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788530496.593337:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555932032:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788530496.593447:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530496.593537:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555932032 00000100:00100000:1.0:1788530496.593547:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555932032 00000100:00100000:1.0:1788530496.593678:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788530496.593692:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f3735c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555932032:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788530496.593734:0:18670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00080000:2.0:1788530496.593825:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788530496.597860:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f3735c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555932032:12345-0@lo:13:osp-pre-0-1.0 Request processed in 4159us (4400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530496.597876:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788530496.602142:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555932032:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788530497.088861:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788530497.088905:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f328e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555932160:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788530497.088991:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788530497.089054:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555932160 00000100:00100000:0.0:1788530497.089063:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555932160 00000100:00100000:0.0:1788530497.089121:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788530497.089132:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9f2b92c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555932160:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788530497.089315:0:17164:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1788530497.089380:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9f2b92c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875409555932160:12345-0@lo:41:osp-pre-0-1.0 Request processed in 249us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788530497.089387:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788530497.089548:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f328e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875409555932160:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788530497.099391:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9e031a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555932288:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788530497.099504:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788530497.102270:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555932288 00000100:00100000:2.0:1788530497.102282:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555932288 00000100:00100000:2.0:1788530497.102347:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788530497.102357:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e031a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555932288:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788530497.102392:0:17163:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788530497.102478:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e031a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875409555932288:12345-0@lo:41:osp-pre-1-0.0 Request processed in 122us (2974us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530497.102486:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788530497.102538:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9e031a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875409555932288:0@lo:41:osp-pre-1-0.0 00000001:02000400:0.0:1788530497.130338:0:20355:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: /mnt/lustre/d1c.sanity-pcc/f1c.sanity-pcc expected pcc state: readwrite, but got: none 00000100:00100000:3.0:1788530497.601002:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a9f2b92d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555932416:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788530497.601079:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788530497.602113:0:18671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409555932416 00000100:00100000:1.0:1788530497.602123:0:18671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409555932416 00000100:00100000:1.0:1788530497.602211:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788530497.602224:0:18671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e031a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555932416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788530497.602247:0:18671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788530497.602327:0:18671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e031a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875409555932416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (1248us total) trans 0 rc 0/0 00000100:00100000:1.0:1788530497.602335:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788530497.602386:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a9f2b92d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875409555932416:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788530497.603812:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788530497.604296:0:18991:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788530498.026903:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:3.0:1788530498.026960:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.41@tcp (source: 12345-192.168.202.41@tcp) 00000100:00100000:1.0:1788530498.027374:0:18672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531717888 00000100:00100000:1.0:1788530498.027387:0:18672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531717888 00002000:00100000:1.0:1788530498.027450:0:18672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x22:0x0] (0->8) req@ffff9a9e031a1180 x1875409531717888/t0(0) o4->66d42348-56b8-4977-9cd3-df6ed37388a6@192.168.202.41@tcp:439/0 lens 504/0 e 0 to 0 dl 1788530509 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:1.0:1788530498.027462:0:18672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a9e031a1180 with x1875409531717888 ext(0->8) 00002000:00010000:1.0:1788530498.027468:0:18672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a9e031a1180 00000100:00100000:1.0:1788530498.027504:0:18672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 0 00000100:00100000:1.0:1788530498.027515:0:18672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e031a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:66d42348-56b8-4977-9cd3-df6ed37388a6+8:2401:x1875409531717888:12345-192.168.202.41@tcp:4:bash.0 00000100:00080000:1.0:1788530498.028095:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788530498.028632:0:18666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875409531718016 00000100:00100000:0.0:1788530498.028639:0:18666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875409531718016 00000100:00100000:0.0:1788530498.028680:0:18666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.41@tcp, seq: 35 00000100:00100000:0.0:1788530498.028690:0:18666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a9e031a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66d42348-56b8-4977-9cd3-df6ed37388a6+11:2401:x1875409531718016:12345-192.168.202.41@tcp:16:kworker.0 00000100:00100000:0.0:1788530498.032444:0:18672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e031a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:66d42348-56b8-4977-9cd3-df6ed37388a6+11:2401:x1875409531717888:12345-192.168.202.41@tcp:4:bash.0 Request processed in 4922us (5542us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1788530498.032463:0:18672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 0 00002000:00100000:0.0:1788530498.032475:0:18672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x22:0x0] (0->8) req@ffff9a9e031a1180 x1875409531717888/t8589934599(0) o4->66d42348-56b8-4977-9cd3-df6ed37388a6@192.168.202.41@tcp:439/0 lens 504/448 e 0 to 0 dl 1788530509 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:0.0:1788530498.032486:0:18672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a9e031a1180 with x1875409531717888 ext(0->8) 00002000:00010000:0.0:1788530498.032493:0:18672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a9e031a1180 00000001:00080000:0.0:1788530498.054924:0:19495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000001:00080000:0.0:1788530498.054955:0:19495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00000100:00100000:2.0:1788530498.059710:0:18666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a9e031a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66d42348-56b8-4977-9cd3-df6ed37388a6+6:2401:x1875409531718016:12345-192.168.202.41@tcp:16:kworker.0 Request processed in 31013us (32740us total) trans 0 rc 0/0 00000100:00100000:2.0:1788530498.059725:0:18666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.41@tcp, seq: 35 00000040:00080000:1.0:1788530498.177496:0:17913:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1788530498.370131:0:17192:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788530498.370635:0:17192:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788530498.370991:0:17192:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788530498.371001:0:17192:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1788530498.632804:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 47741 lines, 47741 kept, 0 dropped, 0 bad.